Skip to content

arrow-55.1.0 breaks filter_record_batch #7500

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ion-elgreco opened this issue May 13, 2025 · 0 comments
Open

arrow-55.1.0 breaks filter_record_batch #7500

ion-elgreco opened this issue May 13, 2025 · 0 comments
Labels

Comments

@ion-elgreco
Copy link

ion-elgreco commented May 13, 2025

Describe the bug
With latest minor release the filter_record_batch function stopped working: https://github.com/delta-io/delta-rs/actions/runs/14999489487/job/42142313983?pr=3426#step:4:2506

cannot use StructArray::new_unchecked if there are no fields, length is unknown

To Reproduce
Run delta-rs codebase and do cargo test.

Expected behavior
Being able to filter recordbatch by predicate.

I tried doing this, to verify whether the recordbatch had fields, but it doesn't seem to be an issue with there being no fields

        if filtered.num_columns() > 0 {
            Ok(filter_record_batch(&filtered, &BooleanArray::from(keep))?)
        } else {
            Ok(filtered)
        }

Also not entirely sure, what we can do on our end here. With another failure I was able to swap out the function for StructArray to try_new_with_length

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant