Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-1943067: Add support for writing arrow data as implemented in snowpark-python #2180

Open
pep-sanwer opened this issue Feb 20, 2025 · 1 comment
Assignees
Labels
feature status-triage_done Initial triage done, will be further handled by the driver team

Comments

@pep-sanwer
Copy link

What is the current behavior?

Currently Arrow backed dataframes (polars etc.) must be converted to pandas before write_pandas to write local dataframes into Snowflake

What is the desired behavior?

Support an Arrow native write API similar to write_pandas

How would this improve snowflake-connector-python?

Streamlines non-pandas based workflows (ex: polars)

References and other background

Implemented in snowpark-python @ snowflakedb/snowpark-python#2959

@github-actions github-actions bot changed the title Add support for writing arrow data as implemented in snowpark-python SNOW-1943067: Add support for writing arrow data as implemented in snowpark-python Feb 20, 2025
@sfc-gh-sghosh
Copy link

Hello @pep-sanwer ,

Thanks for raising the issue, down the line the support for writing arrow data is implemented in python connector but it has dependency issue, will check with team and update.

Regards,
Sujan

@sfc-gh-sghosh sfc-gh-sghosh added the status-triage_done Initial triage done, will be further handled by the driver team label Feb 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature status-triage_done Initial triage done, will be further handled by the driver team
Projects
None yet
Development

No branches or pull requests

3 participants