-
Notifications
You must be signed in to change notification settings - Fork 944
Add compression flush callback #7298
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add compression flush callback #7298
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #7298 +/- ##
===========================================
+ Coverage 80.06% 92.26% +12.19%
===========================================
Files 190 205 +15
Lines 37181 38567 +1386
Branches 9450 9999 +549
===========================================
+ Hits 29770 35583 +5813
+ Misses 2997 2984 -13
+ Partials 4414 0 -4414 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
row_compressor->on_flush(row_compressor, | ||
row_compressor->rows_compressed_into_current_value); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I assume for the following PRs we'll have some tests for covering it, right?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, there is no code coverage now because nothing is using it. But the table access method will be using it.
54dad24
to
e2289a1
Compare
Add the ability to define a callback function that gets called every time a new segment is flushed during compression. The callback can be used to report compression progress. Also expose the function to create a tuple sort state for compression.
e2289a1
to
39a7bd2
Compare
Add the ability to define a callback function that gets called every time a new segment is flushed during compression. The callback can be used to report compression progress.
Also expose the function to create a tuple sort state for compression.
Disable-check: force-changelog-file