[FEATURE] Documentation/Glue Example

[nick-at-UW]

Is there an existing issue for this?

• I have searched the existing issues

Feature description

The documentation states that Glue metrics are available to be pulled via discovery, however I've been unable to get metrics from the Glue jobs. I've attempted to configure this via discovery job as well as customNamespace. For reference, the glue metrics we see do appear to be in a custom namespace called 'Glue'

I've provided a snippet of our config for reference. Any guidance in this configuration would be appreciated.

What might the configuration look like?

    customNamespace:
      - name: Glue
        namespace: Glue
        regions:
          - us-west-2
        metrics:
          - name: glue.JobRunsSucceeded
            statistics: [Sum]
            period: 300
            length: 600
            delay: 300
            nilToZero: true
          - name: glue.JobRunsFailed
            statistics: [Sum]
            period: 300
            length: 600
            delay: 300
            nilToZero: true
    discovery:
      jobs:
        - type: Glue
          regions:
            - us-west-2
          metrics:
            - name: glue.JobRunsSucceeded
              statistics: [Sum]
              period: 300
              length: 600
              delay: 300
              nilToZero: true
            - name: glue.JobRunsFailed
              statistics: [Sum]
              period: 300
              length: 600
              delay: 300
              nilToZero: true

Anything else?

No response

[asaednu]

@nick-at-UW were you able to get Glue metrics working with YACE ?

I'm having the same issue where the only metric YACE has been able to export is aws_glue_info

[nick-at-UW]

I haven't had any luck with it. Still hopeful someone else has info and can give some suggestions.

…

On Fri, Jan 10, 2025 at 12:04 PM Akrem Saed ***@***.***> wrote: @nick-at-UW <https://github.com/nick-at-UW> were you able to get Glue metrics working with YACE ? I'm having the same issue where the only metric YACE has been able to export is aws_glue_info — Reply to this email directly, view it on GitHub <#1591 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4YVYKJFPBRYJB2RZKVEG2D2J74SVAVCNFSM6AAAAABT476QIWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKOBTGI3TOMJXGI> . You are receiving this because you were mentioned.Message ID: <prometheus-community/yet-another-cloudwatch-exporter/issues/1591/2583277172 @github.com>

[asaednu]

@nick-at-UW I was able to get this to work. The trick was to not use customNamespace. All you need is the jobs section.

Also the name of the metrics were glue.succeed.ALL and glue.error.ALL. I used Cloudwatch Metrics in AWS Console to figure out the name of the metrics.

So here is the snippet that works:

discovery:
  jobs:
    - type: Glue
      regions:
        - us-east-1
      addCloudwatchTimestamp: true
      period: 60
      length: 300
      delay: 60
      metrics:
        - name: glue.succeed.ALL
          statistics:
            - Sum
          nilToZero: true
        - name: glue.error.ALL
          statistics:
            - Sum
          nilToZero: true

[tristanburgess]

Thanks so much for responding here @asaednu. @nick-at-UW are you all set now with the above guidance? I'm not sure where the metric names glue.JobRunsSucceeded and glue.JobRunsFailed came from for you, but as far as I can tell from https://docs.aws.amazon.com/glue/latest/dg/monitor-observability.html, they don't appear for the Glue namespace, whereas glue.succeed.ALL and glue.error.ALL do.