Skip to content
This repository was archived by the owner on Jun 23, 2025. It is now read-only.

Added Prometheus Server to LPG #857

Merged
merged 4 commits into from
Oct 25, 2024
Merged

Added Prometheus Server to LPG #857

merged 4 commits into from
Oct 25, 2024

Conversation

Bslabe123
Copy link
Contributor

@Bslabe123 Bslabe123 commented Oct 24, 2024

  • Added a Prometheus server running on port 9090
  • Added the LatencyProfileGenerator:prompt_length, "LatencyProfileGenerator:response_length, and LatencyProfileGenerator:time_per_output_token metrics.
  • Added PodMonitoring resource in Terraform automation.

Example results in GMP:
Screenshot 2024-10-24 at 15 26 52
Screenshot 2024-10-24 at 15 27 36
Screenshot 2024-10-24 at 15 26 13

@Bslabe123 Bslabe123 enabled auto-merge (squash) October 24, 2024 22:33
@Bslabe123 Bslabe123 merged commit 9a0cb17 into main Oct 25, 2024
11 checks passed
leroyjb pushed a commit to leroyjb/ai-on-gke that referenced this pull request Jan 24, 2025
* first commit

* separated templates

* remove empty file

* fmt
@fcabrera23 fcabrera23 deleted the benchmarking_metrics branch May 5, 2025 20:22
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants