Skip to content

feat(flink): support StringSplit #11049

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Mar 27, 2025
Merged

feat(flink): support StringSplit #11049

merged 3 commits into from
Mar 27, 2025

Conversation

ted0928
Copy link
Contributor

@ted0928 ted0928 commented Mar 27, 2025

Description of changes

Issues closed

@github-actions github-actions bot added tests Issues or PRs related to tests pyspark The Apache PySpark backend sql Backends that generate SQL flink Issues or PRs related to Flink labels Mar 27, 2025
Copy link
Member

@cpcloud cpcloud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've simplified the implementation a bit.

We can rely solely on the test in test_string.py for now, and since StringSplit is already mapped to "split" in the base compiler class we don't can simply remove ops.StringSplit from the UNSUPPORTED_OPS list in the Flink compiler.

I also removed the same (redundant) mapping from the Databricks compiler.

@cpcloud cpcloud marked this pull request as ready for review March 27, 2025 12:13
@cpcloud cpcloud changed the title feat(pyflink): support StringSplit feat(flink): support StringSplit Mar 27, 2025
@cpcloud cpcloud enabled auto-merge (squash) March 27, 2025 12:14
@cpcloud cpcloud merged commit b83a88e into ibis-project:main Mar 27, 2025
107 of 108 checks passed
ted0928 added a commit to ted0928/ibis that referenced this pull request Apr 10, 2025
* origin/main:
  chore: make gdal buildable on macos arm64
  chore(deps): bump and relock
  chore(deps): update astral-sh/setup-uv action to v5.4.1
  chore(deps): update ghcr.io/astral-sh/uv docker tag to v0.6.11
  test(datafusion): enable various xpassing tests
  chore(deps): bump and relock
  chore(deps): update `flake.lock`
  chore(deps): bump and relock
  fix(postgres): clean up possible transaction hangs
  chore(deps): update actions/create-github-app-token action to v1.12.0
  chore(deps): update clickhouse/clickhouse-server docker tag to v25.3.2.39
  chore(release): 10.4.0
  chore(deps): bump and relock (ibis-project#11050)
  feat(datatypes): add string length (ibis-project#11045)
  feat(flink): support `StringSplit` (ibis-project#11049)
  chore(deps): update ghcr.io/astral-sh/uv docker tag to v0.6.10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
flink Issues or PRs related to Flink pyspark The Apache PySpark backend sql Backends that generate SQL tests Issues or PRs related to tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants