Destination Redshift: Adopt CDK changes for airbyte_meta
#35981
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
octavia-squidington-iii
added
area/connectors
gisripa
force-pushed
the
gireesh/cdk_airbyte_meta
branch
from
fb9bc6d to
81e28c1
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
3 times, most recently
from
cb2b5cc to
434460e
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
b91227c to
e8933ad
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
2 times, most recently
from
5535781 to
9b70387
Compare
gisripa
force-pushed
the
gireesh/cdk_airbyte_meta
branch
from
fb325ab to
c1e2f16
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
d4fcf7a to
3f2f246
Compare
gisripa
force-pushed
the
gireesh/cdk_airbyte_meta
branch
from
c1e2f16 to
6d8d44b
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
3f2f246 to
6a9d78f
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
6a9d78f to
1b495b4
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
1b495b4 to
e2cf3fd
Compare
jbfbell
changed the base branch from
gireesh/cdk_airbyte_meta
to
03-12-add_tests
This stack of pull requests is managed by Graphite. Learn more about stacking. |
jbfbell
force-pushed
the
03-12-add_tests
branch
from
61166ad to
41d9330
Compare
jbfbell
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
2e8687f to
f478f00
Compare
jbfbell
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
f478f00 to
37acfc0
Compare
jbfbell
changed the base branch from
03-12-add_tests
to
gireesh/cdk_airbyte_meta
jbfbell
force-pushed
the
gireesh/cdk_airbyte_meta
branch
from
6d29cad to
cb2f682
Compare
jbfbell
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
37acfc0 to
86a4081
Compare
gisripa
force-pushed
the
gireesh/cdk_airbyte_meta
branch
from
cb2f682 to
0154bbc
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
86a4081 to
1834fb1
Compare
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
1834fb1 to
434c35c
Compare
jbfbell
approved these changes
Mar 14, 2024
gisripa
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
4ab6072 to
cda0ef9
Compare
Summary ======= Associated changes in fixtures and tests V1V2 migration to add meta column too.
jbfbell
force-pushed
the
gireesh/redshift_airbyte_meta
branch
from
cda0ef9 to
3dd5a28
Compare
Merged
octavia-squidington-iii
added
the
area/documentation
|
Standard inserts run with pre-release: https://cloud.airbyte.com/workspaces/b61bc266-ef3c-460c-af2f-f70da4a2993c/connections/4e5476f3-79d6-4541-810a-4666f4e156c0/job-history#9315990::0 Staging inserts run with pre-release: https://cloud.airbyte.com/workspaces/b61bc266-ef3c-460c-af2f-f70da4a2993c/connections/e1e1f841-ca63-4524-9c87-9da81f928a79/job-history#9320375::0 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Plumbing of
_airbyte_metain Raw tables.Preserve the meta information received from upstream in T+D insert.
Updated tests with new
AirbyteRecordMessageMetaformat and mixed cases with old syncs and new syncs.Note that, as part of this change, We have to mute the BaseV1V2 migrator to account for columns with and without meta to avoid a complete rebuild of the raw table. Instead we run another migration with an additive nullable column using
ALTER TABLEstatement on raw table.