Skip to content

feat(pyspark): add mode computation #11254

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 task done
KDra opened this issue May 27, 2025 · 1 comment
Open
1 task done

feat(pyspark): add mode computation #11254

KDra opened this issue May 27, 2025 · 1 comment
Labels
feature Features or general enhancements pyspark The Apache PySpark backend

Comments

@KDra
Copy link

KDra commented May 27, 2025

Is your feature request related to a problem?

No

What is the motivation behind your request?

table.describe() is a very useful feature that I would like to also run on PySpark tables

Describe the solution you'd like

I could implement it myself but I am unsure where to start

What version of ibis are you running?

10.5.0

What backend(s) are you using, if any?

PySpark

Code of Conduct

  • I agree to follow this project's Code of Conduct
@KDra KDra added the feature Features or general enhancements label May 27, 2025
@cpcloud
Copy link
Member

cpcloud commented May 27, 2025

You can add ops.Mode: "mode" to the SIMPLE_OPS mapping in the PySpark compiler, then run the test suite with pytest -m pyspark -k mode and remove the "pyspark" string from whichever tests are now passing.

@cpcloud cpcloud changed the title feat: Add mode computation for PySpark tables feat(pyspark): add mode computation May 27, 2025
@cpcloud cpcloud added the pyspark The Apache PySpark backend label May 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Features or general enhancements pyspark The Apache PySpark backend
Projects
Status: backlog
Development

No branches or pull requests

2 participants