You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
support get partition info at frontend
add the project node to compute the partition value and exchange node to shuffle by it
However, if the iceberg table partition key has been changed, iceberg sink will use the wrong partition key, or even worse it might generate data files that don't match the partition spec. Iceberg's hidden partitioning So I think we should only use the partition spec of creation to shuffle data, but when we write data to iceberg table, we should leverage iceberg's hidden partition to deal with the partition key changed problem.