You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|[Catalog Selection](/cloud/managing-airbyte-cloud/configuring-connections.md#modify-streams-in-your-connection)| What data should be replicated from the source to the destination? |
29
+
|[Stream and Field Selection](/cloud/managing-airbyte-cloud/configuring-connections.md#modify-streams-in-your-connection)| What data should be replicated from the source to the destination? |
30
30
|[Sync Mode](/using-airbyte/core-concepts/sync-modes/README.md)| How should the streams be replicated (read and written)? |
31
31
|[Sync Schedule](/using-airbyte/core-concepts/sync-schedules.md)| When should a data sync be triggered? |
32
32
|[Destination Namespace and Stream Prefix](/using-airbyte/core-concepts/namespaces.md)| Where should the replicated data be written? |
33
33
|[Schema Propagation](/cloud/managing-airbyte-cloud/manage-schema-changes.md)| How should Airbyte handle schema drift in sources? |
34
34
35
35
## Stream
36
36
37
-
A stream is a group of related records.
37
+
A stream is a group of related records. Depending on the destination, it may be called a table, file, or blob. We use the term `stream` to generalize the flow of data to various destinations.
38
38
39
39
Examples of streams:
40
40
41
41
- A table in a relational database
42
42
- A resource or API endpoint for a REST API
43
43
- The records from a directory containing many files in a filesystem
44
44
45
+
## Record
46
+
47
+
A record is a single entry or unit of data. This is commonly known as a "row". A record is usually unique and contains information related to a particular entity, like a customer or transaction.
48
+
49
+
Examples of records:
50
+
51
+
- A row in the table in a relational database
52
+
- A line in a file
53
+
- A unit of data returned from an API
54
+
45
55
## Field
46
56
47
-
A field is an attribute of a record in a stream.
57
+
A field is an attribute of a record in a stream.
48
58
49
59
Examples of fields:
50
60
51
61
- A column in the table in a relational database
52
62
- A field in an API response
53
63
64
+
65
+
54
66
## Sync Schedule
55
67
56
68
There are three options for scheduling a sync to run:
@@ -65,11 +77,13 @@ For more details, see our [Sync Schedules documentation](sync-schedules.md).
65
77
66
78
A namespace defines where the data will be written to your destination. You can use the namespace to group streams in a source or destination. In a relational database system, this is typically known as a schema.
67
79
80
+
Depending on your destination, you may know this more commonly as the "Dataset", "Schema" or "Bucket Path". The term "Namespace" is used to generalize the concept across various destinations.
81
+
68
82
For more details, see our [Namespace documentation](namespaces.md).
69
83
70
84
## Sync Mode
71
85
72
-
A sync mode governs how Airbyte reads from a source and writes to a destination. Airbyte provides different sync modes depending on what you want to accomplish.
86
+
A sync mode governs how Airbyte reads from a source and writes to a destination. Airbyte provides several sync modes depending what you want to accomplish. The sync modes define how your data will sync and whether duplicates will exist in the dstination.
73
87
74
88
Read more about each [sync mode](/using-airbyte/core-concepts/sync-modes/README.md) and how they differ.
75
89
@@ -88,21 +102,15 @@ For more details, see our [Typing & Deduping documentation](/using-airbyte/core-
88
102
89
103
## Basic Normalization
90
104
91
-
Basic Normalization transforms data after a sync to denest columns into their own tables. Note that normalization is only available for the following relational database & warehouse destinations:
92
-
93
-
- Redshift
94
-
- Postgres
95
-
- Oracle
96
-
- MySQL
97
-
- MSSQL
105
+
Basic Normalization transforms data after a sync to denest columns into their own tables. Note that normalization is only available for relational database & warehouse destinations that have not yet migrated to Destinations V2, and will eventually be fully deprecated.
98
106
99
107
For more details, see our [Basic Normalization documentation](/using-airbyte/core-concepts/basic-normalization.md).
100
108
101
109
## Custom Transformations
102
110
103
-
Airbyte integrates natively with dbt to allow you to use dbt for post-sync transformations. This is useful if you would like to trigger dbt models after a sync successfully completes.
111
+
Airbyte Cloud integrates natively with dbt to allow you to use dbt for post-sync transformations. This is useful if you would like to trigger dbt models after a sync successfully completes.
104
112
105
-
For more details, see our [dbt integration documentation](/cloud/managing-airbyte-cloud/dbt-cloud-integration.md).
113
+
Custom transformation is not available for Airbyte Open-Source.
0 commit comments