2023-10-12 kernel meeting notes

[zachschuermann]

summary

some discussion on expression PR, ideas for benchmarks in CI, overall checkpoint/sync.

action items:

• expression PR review

attendees

@rtyler @wjones127 @nicklan @MrPowers @zachschuermann @tdas

notes stream

https://github.com/ibis-project/ibis getting read_delta added
@nicklan to review @wjones127 expression PR

• expressions design and discussion, @wjones127 to sync more as things come up
  @MrPowers updates
• lots of interactions with OSS people
• getting some buy-in from go side to use kernel
• DuckDB has C FFI layer for Go bindings and perf is bad --> we should understand why
  rust has 'toll-free' interop (we will just pass raw pointers)
  Go may have to perform some conversion
  some todos
• bench for perf checks
• zach idea: count allocs!
  slides to review: https://docs.google.com/presentation/d/1PGSSuJ8ndghucSF9GpYgCi9oeRpWolFyehjQbPh92-U/edit#slide=id.gf7b9ec9ce5_0_1087
  DataFusion 32 released
  why does arrow/datafusion do major version bumps at every release?
  more overhead for semver