Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: prometheus_alerts.yml for jaeger 2.X #6820

Open
yogesh119905 opened this issue Mar 6, 2025 · 3 comments
Open

[Bug]: prometheus_alerts.yml for jaeger 2.X #6820

yogesh119905 opened this issue Mar 6, 2025 · 3 comments
Labels
area/otel bug good first issue Good for beginners help wanted Features that maintainers are willing to accept but do not have cycles to implement v2

Comments

@yogesh119905
Copy link

yogesh119905 commented Mar 6, 2025

What happened?

As I am going to implement prometheus rule for jaeger 2.x.x with reference of old prometheus.rule. here is attached link https://github.com/jaegertracing/jaeger/blob/main/monitoring/jaeger-mixin/prometheus_alerts.yml, but most of the metrics names are changes as per jaeger 2.x.x. Is there any prometheus alerts rules avaliable for jaeger version 2.x.x

Steps to reproduce

  1. Environment: Use Jaeger 2.3.0 with OpenTelemetry
  2. using curl http://127.0.0.1:8888/metrics
  3. on prometheus server, we have added in location /etc/prometheus/rules/jaeger.rules.yml but it is not working .
  4. root@virtplatform:~# cat /etc/prometheus/rules/jaeger.rules.yml
groups:
- name: jaeger_alerts
  rules:
    - alert: PromHttpMetricErrs
      annotations:
        message: |
           {{ $labels.job }} {{ $labels.instance }} is experiencing {{ printf "%.2f" $value }}% HTTP errors.
      expr: 100 * sum(rate(promhttp_metric_handler_errors_total[1m])) by (instance, job ) / sum(rate(http_server_duration_milliseconds_sum[1m])) by (instance, job)> 1
      for: 15m
      labels:
        severity: warning

    - alert: OtelReceiverRefusedSpans
      annotations:
        message: |
          service {{ $labels.job }} {{ $labels.instance }} is dropping {{ printf "%.2f" $value }}% spans.
      expr: 100 * sum(rate(otelcol_receiver_refused_spans_total[1m])) by (instance, job) / sum(rate(jaeger_reporter_spans[1m])) by (instance, job)> 1
      for: 15m
      labels:
        severity: warning

Expected behavior

It is should be expected like below sample.

Image

Relevant log output

Screenshot

No response

Additional context

No response

Jaeger backend version

v2.3.0

SDK

No response

Pipeline

No response

Stogage backend

No response

Operating system

No response

Deployment model

No response

Deployment configs

@yurishkuro
Copy link
Member

Yes, might be a good thing to fix.

@yurishkuro yurishkuro transferred this issue from jaegertracing/documentation Mar 6, 2025
@yurishkuro yurishkuro added help wanted Features that maintainers are willing to accept but do not have cycles to implement good first issue Good for beginners labels Mar 6, 2025
@amilbcahat
Copy link

I am taking this issue up.

@RohanMishra315
Copy link

Hey @yurishkuro I couldn't get the location of this file /etc/prometheus/rules/jaeger.rules.yml , do we have to create it ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/otel bug good first issue Good for beginners help wanted Features that maintainers are willing to accept but do not have cycles to implement v2
Projects
None yet
Development

No branches or pull requests

4 participants