Skip to content

Commit f8675b1

Browse files
authored
[Docs] Define a record (#37768)
1 parent 231bc52 commit f8675b1

File tree

1 file changed

+21
-13
lines changed

1 file changed

+21
-13
lines changed

docs/using-airbyte/core-concepts/readme.md

+21-13
Original file line numberDiff line numberDiff line change
@@ -26,31 +26,43 @@ A connection is an automated data pipeline that replicates data from a source to
2626

2727
| Concept | Description |
2828
|-----------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------|
29-
| [Catalog Selection](/cloud/managing-airbyte-cloud/configuring-connections.md#modify-streams-in-your-connection) | What data should be replicated from the source to the destination? |
29+
| [Stream and Field Selection](/cloud/managing-airbyte-cloud/configuring-connections.md#modify-streams-in-your-connection) | What data should be replicated from the source to the destination? |
3030
| [Sync Mode](/using-airbyte/core-concepts/sync-modes/README.md) | How should the streams be replicated (read and written)? |
3131
| [Sync Schedule](/using-airbyte/core-concepts/sync-schedules.md) | When should a data sync be triggered? |
3232
| [Destination Namespace and Stream Prefix](/using-airbyte/core-concepts/namespaces.md) | Where should the replicated data be written? |
3333
| [Schema Propagation](/cloud/managing-airbyte-cloud/manage-schema-changes.md) | How should Airbyte handle schema drift in sources? |
3434

3535
## Stream
3636

37-
A stream is a group of related records.
37+
A stream is a group of related records. Depending on the destination, it may be called a table, file, or blob. We use the term `stream` to generalize the flow of data to various destinations.
3838

3939
Examples of streams:
4040

4141
- A table in a relational database
4242
- A resource or API endpoint for a REST API
4343
- The records from a directory containing many files in a filesystem
4444

45+
## Record
46+
47+
A record is a single entry or unit of data. This is commonly known as a "row". A record is usually unique and contains information related to a particular entity, like a customer or transaction.
48+
49+
Examples of records:
50+
51+
- A row in the table in a relational database
52+
- A line in a file
53+
- A unit of data returned from an API
54+
4555
## Field
4656

47-
A field is an attribute of a record in a stream.
57+
A field is an attribute of a record in a stream.
4858

4959
Examples of fields:
5060

5161
- A column in the table in a relational database
5262
- A field in an API response
5363

64+
65+
5466
## Sync Schedule
5567

5668
There are three options for scheduling a sync to run:
@@ -65,11 +77,13 @@ For more details, see our [Sync Schedules documentation](sync-schedules.md).
6577

6678
A namespace defines where the data will be written to your destination. You can use the namespace to group streams in a source or destination. In a relational database system, this is typically known as a schema.
6779

80+
Depending on your destination, you may know this more commonly as the "Dataset", "Schema" or "Bucket Path". The term "Namespace" is used to generalize the concept across various destinations.
81+
6882
For more details, see our [Namespace documentation](namespaces.md).
6983

7084
## Sync Mode
7185

72-
A sync mode governs how Airbyte reads from a source and writes to a destination. Airbyte provides different sync modes depending on what you want to accomplish.
86+
A sync mode governs how Airbyte reads from a source and writes to a destination. Airbyte provides several sync modes depending what you want to accomplish. The sync modes define how your data will sync and whether duplicates will exist in the dstination.
7387

7488
Read more about each [sync mode](/using-airbyte/core-concepts/sync-modes/README.md) and how they differ.
7589

@@ -88,21 +102,15 @@ For more details, see our [Typing & Deduping documentation](/using-airbyte/core-
88102

89103
## Basic Normalization
90104

91-
Basic Normalization transforms data after a sync to denest columns into their own tables. Note that normalization is only available for the following relational database & warehouse destinations:
92-
93-
- Redshift
94-
- Postgres
95-
- Oracle
96-
- MySQL
97-
- MSSQL
105+
Basic Normalization transforms data after a sync to denest columns into their own tables. Note that normalization is only available for relational database & warehouse destinations that have not yet migrated to Destinations V2, and will eventually be fully deprecated.
98106

99107
For more details, see our [Basic Normalization documentation](/using-airbyte/core-concepts/basic-normalization.md).
100108

101109
## Custom Transformations
102110

103-
Airbyte integrates natively with dbt to allow you to use dbt for post-sync transformations. This is useful if you would like to trigger dbt models after a sync successfully completes.
111+
Airbyte Cloud integrates natively with dbt to allow you to use dbt for post-sync transformations. This is useful if you would like to trigger dbt models after a sync successfully completes.
104112

105-
For more details, see our [dbt integration documentation](/cloud/managing-airbyte-cloud/dbt-cloud-integration.md).
113+
Custom transformation is not available for Airbyte Open-Source.
106114

107115
## Workspace
108116

0 commit comments

Comments
 (0)