You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: documentation/modules/configuring/con-config-kafka-connect.adoc
+3-2
Original file line number
Diff line number
Diff line change
@@ -167,8 +167,9 @@ In this example, JSON convertors are specified.
167
167
A replication factor of 3 is set for the internal topics used by Kafka Connect (minimum requirement for production environment).
168
168
Changing the replication factor after the topics have been created has no effect.
169
169
<6> Requests for reservation of supported resources, currently `cpu` and `memory`, and limits to specify the maximum resources that can be consumed.
170
-
<7> Authentication for the Kafka Connect cluster, specified as mTLS, token-based OAuth, SASL-based SCRAM-SHA-256/SCRAM-SHA-512, or PLAIN.
171
-
By default, Kafka Connect connects to Kafka brokers using a plain text connection.
170
+
<7> Authentication for the Kafka Connect cluster, specified as `tls`, `scram-sha-256`, `scram-sha-512`, `plain`, or `oauth`.
171
+
By default, Kafka Connect connects to Kafka brokers using a plaintext connection.
172
+
For details on configuring authentication, see the link:{BookURLConfiguring}#type-KafkaConnectSpec-schema-reference[`KafkaConnectSpec` schema properties^].
172
173
<8> TLS configuration for encrypted connections to the Kafka cluster, with trusted certificates stored in X.509 format within the specified secrets.
173
174
<9> Build configuration properties for building a container image with connector plugins automatically.
174
175
<10> (Required) Configuration of the container registry where new images are pushed.
Copy file name to clipboardExpand all lines: documentation/modules/deploying/proc-deploy-kafka-connect.adoc
+34-17
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@
8
8
[role="_abstract"]
9
9
This procedure shows how to deploy a Kafka Connect cluster to your Kubernetes cluster using the Cluster Operator.
10
10
11
-
A Kafka Connect cluster deployment is implemented with a configurable number of nodes (also called _workers_) that distribute the workload of connectors as _tasks_ so that the message flow is highly scalable and reliable.
11
+
A Kafka Connect cluster deployment is implemented with a configurable number of nodes (also called _workers_) that distribute the workload of connectors as _tasks_, ensuring a scalable and reliable message flow.
12
12
13
13
The deployment uses a YAML file to provide the specification to create a `KafkaConnect` resource.
14
14
@@ -17,45 +17,62 @@ In this procedure, we use the following example file:
17
17
18
18
* `examples/connect/kafka-connect.yaml`
19
19
20
-
IMPORTANT: If deploying Kafka Connect clusters to run in parallel, each instance must use unique names for internal Kafka Connect topics.
21
-
To do this, xref:con-config-kafka-connect-multiple-instances-{context}[configure each Kafka Connect instance to replace the defaults].
22
-
23
20
.Prerequisites
24
21
25
-
* xref:deploying-cluster-operator-str[The Cluster Operator must be deployed.]
22
+
* Cluster Operator is deployed.
23
+
* Kafka cluster is running.
24
+
+
25
+
This procedure assumes that the Kafka cluster was deployed using Strimzi.
26
26
27
27
.Procedure
28
28
29
+
30
+
. Edit the deployment file to configure connection details (if required).
31
+
+
32
+
In `examples/connect/kafka-connect.yaml`, add or update the following properties as needed:
33
+
+
34
+
* `spec.bootstrapServers` to specify the Kafka bootstrap address.
35
+
* `spec.authentication` to specify the authentication type as `tls`, `scram-sha-256`, `scram-sha-512`, `plain`, or `oauth`. +
36
+
See the link:{BookURLConfiguring}#type-KafkaConnectSpec-schema-reference[`KafkaConnectSpec` schema properties^] for configuration details.
37
+
* `spec.tls.trustedCertificates` to configure the TLS certificate. +
38
+
Use `[]` (an empty array) to trust the default Java CAs, or specify secrets containing trusted certificates. +
39
+
See link:{BookURLConfiguring}#con-common-configuration-trusted-certificates-reference[`trustedCertificates` properties^] for configuration details.
40
+
41
+
. Configure the deployment for multiple Kafka Connect clusters (if required).
42
+
+
43
+
If you plan to run more than one Kafka Connect cluster in the same environment, each instance must use unique internal topic names and a unique group ID.
44
+
+
45
+
Update the `spec.config` properties in `kafka-connect.yaml` to replace the default values.
46
+
+
47
+
See xref:con-config-kafka-connect-multiple-instances-{context}[Configuring multiple Kafka Connect clusters] for details.
48
+
29
49
. Deploy Kafka Connect to your Kubernetes cluster.
30
50
Use the `examples/connect/kafka-connect.yaml` file to deploy Kafka Connect.
0 commit comments