You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A random thought, if a watermark column exists as the first column in the pk, can we emit the watermark when backfill? Even maybe we can do some optimization for backfill with that watermark?
I found that it is almost impossible to emit a watermark even when the first column of the backfill executor is a watermark column because the value of the watermark column keeps increasing, so the backfill existing data will usually have a value lower than the upstream watermark. That is to say, no watermark should be sent downstream while performing backfill.
Originally posted by @st1page in #7790 (comment)
The text was updated successfully, but these errors were encountered: