Skip to content

Commit 6edefbe

Browse files
evantahlerevantahler
authored
destination-redshift - remove docs about standard inserts (#43935)
1 parent eb9168c commit 6edefbe

File tree

1 file changed

+5
-27
lines changed

1 file changed

+5
-27
lines changed

‎docs/integrations/destinations/redshift.md

+5-27
Original file line numberDiff line numberDiff line change
@@ -4,18 +4,9 @@ This page guides you through the process of setting up the Redshift destination
44

55
## Prerequisites
66

7-
The Airbyte Redshift destination allows you to sync data to Redshift.
7+
The Airbyte Redshift destination allows you to sync data to Redshift. Airbyte replicates data by first uploading data to an S3 bucket and issuing a COPY command. This is the recommended loading approach described by Redshift [best practices](https://docs.aws.amazon.com/redshift/latest/dg/c_best-practices-single-copy-command.html). Requires an S3 bucket and credentials. Data is copied into S3 as multiple files with a manifest file.
88

9-
This Redshift destination connector has two replication strategies:
10-
11-
1. INSERT: Replicates data via SQL INSERT queries. This is built on top of the destination-jdbc code
12-
base and is configured to rely on JDBC 4.2 standard drivers provided by Amazon via Maven Central
13-
[here](https://mvnrepository.com/artifact/com.amazon.redshift/redshift-jdbc42) as described in
14-
Redshift documentation
15-
[here](https://docs.aws.amazon.com/redshift/latest/mgmt/jdbc20-install.html). **Not recommended
16-
for production workloads as this does not scale well**.
17-
18-
### For INSERT strategy:
9+
### Configuration Options
1910

2011
- **Host**
2112
- **Port**
@@ -24,19 +15,6 @@ This Redshift destination connector has two replication strategies:
2415
- **Schema**
2516
- **Database**
2617
- This database needs to exist within the cluster provided.
27-
- **JDBC URL Params** (optional)
28-
29-
2. COPY: Replicates data by first uploading data to an S3 bucket and issuing a COPY command. This is
30-
the recommended loading approach described by Redshift
31-
[best practices](https://docs.aws.amazon.com/redshift/latest/dg/c_best-practices-single-copy-command.html).
32-
Requires an S3 bucket and credentials. Data is copied into S3 as multiple files with a manifest
33-
file.
34-
35-
Airbyte automatically picks an approach depending on the given configuration - if S3 configuration
36-
is present, Airbyte will use the COPY strategy and vice versa.
37-
38-
### For COPY strategy:
39-
4018
- **S3 Bucket Name**
4119
- See [this](https://docs.aws.amazon.com/AmazonS3/latest/userguide/create-bucket-overview.html) to
4220
create an S3 bucket.
@@ -59,7 +37,7 @@ Optional parameters:
5937
`yourFavoriteSubdirectory`, we will place the staging data inside
6038
`s3://yourBucket/yourFavoriteSubdirectory`. If not provided, defaults to the root directory.
6139
- **S3 Filename pattern**
62-
- The pattern allows you to set the file-name format for the S3 staging file(s), next placeholders combinations are currently supported: `{date}`, `{date:yyyy_MM}`, `{timestamp}`,
40+
- The pattern allows you to set the file-name format for the S3 staging file(s), next placeholders combinations are currently supported: `{date}`, `{date:yyyy_MM}`, `{timestamp}`,
6341
`{timestamp:millis}`, `{timestamp:micros}`, `{part_number}`, `{sync_id}`, `{format_extension}`.
6442
The pattern you supply will apply to anything under the Bucket Path. If this field is left blank, everything syncs under the Bucket Path. Please, don't use empty space and not supportable placeholders, as they won't recognized.
6543
- **Purge Staging Data**
@@ -243,7 +221,7 @@ Each stream will be output into its own raw table in Redshift. Each table will c
243221
<summary>Expand to review</summary>
244222

245223
| Version | Date | Pull Request | Subject |
246-
|:--------|:-----------|:-----------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
224+
| :------ | :--------- | :--------------------------------------------------------- | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
247225
| 3.4.0 | 2024-07-23 | [42445](https://github.com/airbytehq/airbyte/pull/42445) | Respect the `drop cascade` option on raw tables |
248226
| 3.3.1 | 2024-07-15 | [41968](https://github.com/airbytehq/airbyte/pull/41968) | Don't hang forever on empty stream list; shorten error message on INCOMPLETE stream status |
249227
| 3.3.0 | 2024-07-02 | [40567](https://github.com/airbytehq/airbyte/pull/40567) | Support for [refreshes](../../operator-guides/refreshes.md) and resumable full refresh. WARNING: You must upgrade to platform 0.63.7 before upgrading to this connector version. |
@@ -321,7 +299,7 @@ Each stream will be output into its own raw table in Redshift. Each table will c
321299
| 0.3.55 | 2023-01-26 | [\#20631](https://github.com/airbytehq/airbyte/pull/20631) | Added support for destination checkpointing with staging |
322300
| 0.3.54 | 2023-01-18 | [\#21087](https://github.com/airbytehq/airbyte/pull/21087) | Wrap Authentication Errors as Config Exceptions |
323301
| 0.3.53 | 2023-01-03 | [\#17273](https://github.com/airbytehq/airbyte/pull/17273) | Flatten JSON arrays to fix maximum size check for SUPER field |
324-
| 0.3.52 | 2022-12-30 | [\#20879](https://github.com/airbytehq/airbyte/pull/20879) | Added configurable parameter for number of file buffers (⛔ this version has a bug and will not work; use `0.3.56` instead) |
302+
| 0.3.52 | 2022-12-30 | [\#20879](https://github.com/airbytehq/airbyte/pull/20879) | Added configurable parameter for number of file buffers (⛔ this version has a bug and will not work; use `0.3.56` instead) |
325303
| 0.3.51 | 2022-10-26 | [\#18434](https://github.com/airbytehq/airbyte/pull/18434) | Fix empty S3 bucket path handling |
326304
| 0.3.50 | 2022-09-14 | [\#15668](https://github.com/airbytehq/airbyte/pull/15668) | Wrap logs in AirbyteLogMessage |
327305
| 0.3.49 | 2022-09-01 | [\#16243](https://github.com/airbytehq/airbyte/pull/16243) | Fix Json to Avro conversion when there is field name clash from combined restrictions (`anyOf`, `oneOf`, `allOf` fields) |

0 commit comments

Comments
 (0)