Not able to drop the duplicate labels using the exclude dimensions in span metrics

[adithya-r-nathan]

Component(s)

connector/spanmetrics

Describe the issue you're reporting

I'm trying to drop extra or duplicate labels using the exclude_dimensions in the span metrics connector, but they still appear in the output metrics

span metrics connector config:

connectors:
  spanmetrics:
    histogram:
      explicit:
        buckets: [4ms, 10ms, 25ms, 50ms, 100ms, 200ms, 400ms, 800ms, 1s, 1500ms, 2s, 4s, 10s, 20s, 40s]
    exclude_dimensions:
      - index
      - container.id
      - host.name
      - service.instance.id
      - k8s_replicaset_name
      - k8s_pod_name
      - service_instance_id
      - process_pid
      - process_runtime_description
      - process_runtime_name
      - process_command_args
      - job
      - `k8s_container_name`

Additional Question

Is it possible to include the span name as a field in the service graph connector?

[github-actions]

Pinging code owners:

• connector/spanmetrics: @portertech @Frapschen @iblancasa

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[iblancasa]

Hi @adithya-r-nathan. What are the duplicated labels that you cannot remove? Can you provide a reproducer or something?

[adithya-r-nathan]

Hi @iblancasa,
- index
- container.id
- host.name
- service.instance.id
- k8s_replicaset_name
- k8s_pod_name
- service_instance_id
- process_pid
- process_runtime_description
- process_runtime_name
- process_command_args
- job
- k8s_container_name
These are the fields that I am trying to drop. For example if we take index I am getting the same thing as cluster as well as k8s_cluster_name

Also what are the fields that we can additionally include in the service graph for example span_name etc..

[iblancasa]

These are the fields that I am trying to drop. For example if we take index I am getting the same thing as cluster as well as k8s_cluster_name

Sorry I'm not understanding.

1. All those dimensions are being added even when you added them to exclude_dimensions?
2. For example if we take index I am getting the same thing as cluster as well as k8s_cluster_name: do you mean the value? exclude_dimensions will just remove those dimensions from the resulting metric. Is the resulting metric containing those?
3. How are you checking the output metrics?

[adithya-r-nathan]

Sorry @iblancasa, that I wasn't clear. What I meant was even after adding a particular field in the exclude dimension I am still getting that field in the metrics and not getting dropped. I have verified this by querying.

[iblancasa]

Note that exclude_dimensions is for service.name, span.name, span.kind and status.code. The others will be added only if you added them to dimensions.

Can you check using the logging exporter and pasting here the output for one of the metrics?

[Frapschen]

@adithya-r-nathan Kindly review your OTel Collector configuration to ensure that those fields are not included as dimensions.

[iblancasa]

@adithya-r-nathan can you check if those are resource attributes from your spans? Or directly attributes in your spans?