Skip to content

Commit d21068c

Browse files
authored
Tentatively disallowed normalization for DuckDB (#22528)
1 parent 4180b57 commit d21068c

File tree

4 files changed

+58
-65
lines changed

4 files changed

+58
-65
lines changed

airbyte-config/init/src/main/resources/seed/destination_definitions.yaml

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -449,9 +449,4 @@
449449
dockerImageTag: 0.1.0
450450
documentationUrl: https://docs.airbyte.io/integrations/destinations/duckdb
451451
icon: duckdb.svg
452-
normalizationConfig:
453-
normalizationRepository: airbyte/normalization-duckdb
454-
normalizationTag: 0.2.25
455-
normalizationIntegrationType: duckdb
456-
supportsDbt: true
457452
releaseStage: alpha

airbyte-integrations/bases/base-normalization/integration_tests/dbt_integration_test.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -59,8 +59,6 @@ def setup_db(self, destinations_to_test: List[str]):
5959
self.setup_clickhouse_db()
6060
if DestinationType.TIDB.value in destinations_to_test:
6161
self.setup_tidb_db()
62-
if DestinationType.DUCKDB.value in destinations_to_test:
63-
self.setup_duckdb_db()
6462

6563
def setup_postgres_db(self):
6664
start_db = True

docs/integrations/destinations/duckdb.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ This destination writes data to a file on the _local_ filesystem on the host run
1919

2020
If you set [Normalization](https://docs.airbyte.com/understanding-airbyte/basic-normalization/), source data will be normalized to a tabular form. Let's say you have a source such as GitHub with nested JSONs; the Normalization ensures you end up with tables and columns. Suppose you have a many-to-many relationship between the users and commits. Normalization will create separate tables for it. The end state is the [third normal form](https://en.wikipedia.org/wiki/Third_normal_form) (3NF).
2121

22-
If turn off the Normalization, each stream will be output into its own table `_airbyte_raw_{stream_name}`. Each table will contain 3 columns:
22+
Each table will contain 3 columns:
2323

2424
* `_airbyte_ab_id`: a uuid assigned by Airbyte to each event that is processed.
2525
* `_airbyte_emitted_at`: a timestamp representing when the event was pulled from the data source.

0 commit comments

Comments
 (0)