Skip to content

Commit 4c75fb5

Browse files
Add Kafka Message Version Notes For DSM Kafka Monitoring (#28871)
* Monitoring Kafka pipelines * refine * refine * refine
1 parent f94c617 commit 4c75fb5

File tree

4 files changed

+12
-0
lines changed

4 files changed

+12
-0
lines changed

content/en/data_streams/dotnet.md

+3
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,9 @@ environment:
3232
- DD_DATA_STREAMS_ENABLED: "true"
3333
```
3434
35+
### Monitoring Kafka Pipelines
36+
Data Streams Monitoring uses message headers to propagate context through Kafka streams. If `log.message.format.version` is set in the Kafka broker configuration, it must be set to `0.11.0.0` or higher. Data Streams Monitoring is not supported for versions lower than this.
37+
3538
### Monitoring SQS pipelines
3639
Data Streams Monitoring uses one [message attribute][2] to track a message's path through an SQS queue. As Amazon SQS has a maximum limit of 10 message attributes allowed per message, all messages streamed through the data pipelines must have 9 or fewer message attributes set, allowing the remaining attribute for Data Streams Monitoring.
3740

content/en/data_streams/go.md

+3
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,9 @@ To start with Data Streams Monitoring, you need recent versions of the Datadog A
2727

2828
### Installation
2929

30+
### Monitoring Kafka Pipelines
31+
Data Streams Monitoring uses message headers to propagate context through Kafka streams. If `log.message.format.version` is set in the Kafka broker configuration, it must be set to `0.11.0.0` or higher. Data Streams Monitoring is not supported for versions lower than this.
32+
3033
#### Automatic Instrumentation
3134

3235
Automatic instrumentation uses [Orchestrion][4] to install dd-trace-go and supports both the Sarama and Confluent Kafka libraries.

content/en/data_streams/nodejs.md

+3
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,9 @@ environment:
3636
- DD_DATA_STREAMS_ENABLED: "true"
3737
```
3838
39+
### Monitoring Kafka Pipelines
40+
Data Streams Monitoring uses message headers to propagate context through Kafka streams. If `log.message.format.version` is set in the Kafka broker configuration, it must be set to `0.11.0.0` or higher. Data Streams Monitoring is not supported for versions lower than this.
41+
3942
### Monitoring SQS pipelines
4043
Data Streams Monitoring uses one [message attribute][4] to track a message's path through an SQS queue. As Amazon SQS has a maximum limit of 10 message attributes allowed per message, all messages streamed through the data pipelines must have 9 or fewer message attributes set, allowing the remaining attribute for Data Streams Monitoring.
4144

content/en/data_streams/python.md

+3
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,9 @@ environment:
3636
- DD_DATA_STREAMS_ENABLED: "true"
3737
```
3838
39+
### Monitoring Kafka Pipelines
40+
Data Streams Monitoring uses message headers to propagate context through Kafka streams. If `log.message.format.version` is set in the Kafka broker configuration, it must be set to `0.11.0.0` or higher. Data Streams Monitoring is not supported for versions lower than this.
41+
3942
### Monitoring SQS Pipelines
4043
Data Streams Monitoring uses one [message attribute][4] to track a message's path through an SQS queue. As Amazon SQS has a maximum limit of 10 message attributes allowed per message, all messages streamed through the data pipelines must have 9 or fewer message attributes set, allowing the remaining attribute for Data Streams Monitoring.
4144

0 commit comments

Comments
 (0)