-
Notifications
You must be signed in to change notification settings - Fork 4.5k
fix pyyaml/cython dependency issue when building base-normalization #28451
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix pyyaml/cython dependency issue when building base-normalization #28451
Conversation
|
Step | Result |
---|---|
Validate airbyte-integrations/connectors/destination-mysql-strict-encrypt/metadata.yaml | ✅ |
Connector version semver check | ✅ |
QA checks | ✅ |
Build connector tar | ✅ |
Build destination-mysql-strict-encrypt docker image for platform linux/x86_64 | ✅ |
Build airbyte/normalization-mysql:dev | ✅ |
./gradlew :airbyte-integrations:connectors:destination-mysql-strict-encrypt:integrationTest | ❌ |
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-mysql-strict-encrypt test
|
Step | Result |
---|---|
Validate airbyte-integrations/connectors/destination-exasol/metadata.yaml | ✅ |
Connector version semver check | ✅ |
QA checks | ❌ |
Build connector tar | ✅ |
Build destination-exasol docker image for platform linux/x86_64 | ✅ |
./gradlew :airbyte-integrations:connectors:destination-exasol:integrationTest | ❌ |
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-exasol test
|
Step | Result |
---|---|
Validate airbyte-integrations/connectors/destination-redshift/metadata.yaml | ✅ |
Connector version semver check | ✅ |
QA checks | ✅ |
Build connector tar | ✅ |
Build destination-redshift docker image for platform linux/x86_64 | ✅ |
Build airbyte/normalization-redshift:dev | ✅ |
./gradlew :airbyte-integrations:connectors:destination-redshift:integrationTest | ✅ |
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-redshift test
|
Step | Result |
---|---|
Validate airbyte-integrations/connectors/destination-mssql-strict-encrypt/metadata.yaml | ✅ |
Connector version semver check | ✅ |
QA checks | ✅ |
Build connector tar | ✅ |
Build destination-mssql-strict-encrypt docker image for platform linux/x86_64 | ✅ |
Build airbyte/normalization-mssql:dev | ✅ |
./gradlew :airbyte-integrations:connectors:destination-mssql-strict-encrypt:integrationTest | ❌ |
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-mssql-strict-encrypt test
Connectors Base build failure was due to a failing test on airbyte-cdk that has been fixed in master |
/approve-and-merge reason="fix build" |
|
Step | Result |
---|---|
Validate airbyte-integrations/connectors/destination-rockset/metadata.yaml | ✅ |
Connector version semver check | ✅ |
QA checks | ❌ |
Build connector tar | ✅ |
Build destination-rockset docker image for platform linux/x86_64 | ✅ |
./gradlew :airbyte-integrations:connectors:destination-rockset:integrationTest | ❌ |
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-rockset test
What
Applies a workaround for yaml/pyyaml#601
This error is introduced by
COPY --from=airbyte/base-airbyte-protocol-python:0.1.1 /airbyte /airbyte
. When we get to installing dependencies in the dockerfile for this image here:We error out with the
cython_sources
error.airbyte/base-airbyte-protocol-python has only been published once, 2 years ago. It is unclear where this image comes from, what's in it, and how it was built. This isn't a great spot to be in, but we can workaround it for now with this fix until we know more.