Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

connectors-ci: PyYaml 0.5.4 is incompatible with Cython 3 -> broken connector build #28391

Closed
alafanechere opened this issue Jul 18, 2023 · 3 comments

Comments

@alafanechere
Copy link
Contributor

alafanechere commented Jul 18, 2023

Cython 3 was just released, an PyYaml 5.4.0 depends on Cython but is incompatible with Cython 3.
This leads to Python connector build error like: AttributeError: cython_sources on pip install.

PyYaml released a fix for compatibility with Cython 3 but its on a different major version (6) that has dependency conflict with pyarrow

Solutions

A. Upgrade PyYaml to 6 in Airbyte CDK and fix the dependency conflict with PyArrow. Potential regression if some connector make direct use of PyYaml.
B. Patch the connector Dockerfile at build time to install Cython < 3.0 before the other dependencies.

@sryabkov
Copy link

Cython 3 was just released, an PyYaml 0.5.4 depends on Cython but is incompatible with Cython 3.

Should be PyYaml 5.4, right?

@mfractal
Copy link

any updates on this ?

@bnchrch
Copy link
Contributor

bnchrch commented Sep 6, 2023

This has been resolved

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants