You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If there is no requirement on the ordering of a state key, we may want to permute keys for stateful operators so that watermark columns are the first column. This allows us to easily perform state cleaning in downstream operators such as HashAgg and HashJoin.
To achieve this, we may have an optimization pass that walks the child nodes of a Watermark-emitting operator such as WatermarkFilter and attempt to permute the group by and join keys.
The text was updated successfully, but these errors were encountered:
jon-chuang
changed the title
opt(frontend): Permute primary keys that contain Watermark column
opt(frontend): Permute state keys that contain Watermark column
Nov 18, 2022
Uh oh!
There was an error while loading. Please reload this page.
If there is no requirement on the ordering of a state key, we may want to permute keys for stateful operators so that watermark columns are the first column. This allows us to easily perform state cleaning in downstream operators such as HashAgg and HashJoin.
To achieve this, we may have an optimization pass that walks the child nodes of a Watermark-emitting operator such as
WatermarkFilter
and attempt to permute the group by and join keys.The text was updated successfully, but these errors were encountered: