test: Add e2etests for checking metrics

[jonathan-innis]

Fixes #N/A

Description

Add e2etests for validating that a minimum number of metrics are returned back from Karpenter. This would have prevented the regression that was fixed in #7877.

The testing port-forwards the pods and directly hits their metrics endpoints, parsing the metrics, and ensuring the count of metrics is over a certain amount (which is estimated from the number of instance types/subnets that we support).

How was this change tested?

make presubmit
/karpenter snapshot

Does this change impact docs?

• Yes, PR includes docs updates
• Yes, issue opened: #
• No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[netlify]

✅ Deploy Preview for karpenter-docs-prod canceled.

Name	Link
🔨 Latest commit	8c399f4
🔍 Latest deploy log	https://app.netlify.com/sites/karpenter-docs-prod/deploys/67d889371b566000087ce38f

[netlify]

✅ Deploy Preview for karpenter-docs-prod canceled.

Name	Link
🔨 Latest commit	b37daac
🔍 Latest deploy log	https://app.netlify.com/sites/karpenter-docs-prod/deploys/67d9ed09b388e9000853ff41

[jonathan-innis]

/karpenter snapshot

[coveralls]

Pull Request Test Coverage Report for Build 13934307754

Details

• 0 of 68 (0.0%) changed or added relevant lines in 1 file are covered.
• 1 unchanged line in 1 file lost coverage.
• Overall coverage decreased (-0.5%) to 66.291%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
test/pkg/environment/common/expectations.go	0	68	0.0%

Files with Coverage Reduction	New Missed Lines	%
pkg/providers/instance/instance.go	1	91.97%

Totals
Change from base Build 13934189882:	-0.5%
Covered Lines:	6710
Relevant Lines:	10122

---

💛 - Coveralls

[github-actions]

Snapshot successfully published to oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter:0-4a2611c55c8b6e59bc33cca6e86d21b856038eee.
To install you must login to the ECR repo with an AWS account:

aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin 021119463062.dkr.ecr.us-east-1.amazonaws.com

helm upgrade --install karpenter oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter --version "0-4a2611c55c8b6e59bc33cca6e86d21b856038eee" --namespace "kube-system" --create-namespace \
  --set "settings.clusterName=${CLUSTER_NAME}" \
  --set "settings.interruptionQueue=${CLUSTER_NAME}" \
  --set controller.resources.requests.cpu=1 \
  --set controller.resources.requests.memory=1Gi \
  --set controller.resources.limits.cpu=1 \
  --set controller.resources.limits.memory=1Gi \
  --wait

[jonathan-innis]

/karpenter snapshot

[github-actions]

Snapshot successfully published to oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter:0-d7c9b15e66a55ad459b877aea6f3998cc09f8941.
To install you must login to the ECR repo with an AWS account:

aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin 021119463062.dkr.ecr.us-east-1.amazonaws.com

helm upgrade --install karpenter oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter --version "0-d7c9b15e66a55ad459b877aea6f3998cc09f8941" --namespace "kube-system" --create-namespace \
  --set "settings.clusterName=${CLUSTER_NAME}" \
  --set "settings.interruptionQueue=${CLUSTER_NAME}" \
  --set controller.resources.requests.cpu=1 \
  --set controller.resources.requests.memory=1Gi \
  --set controller.resources.limits.cpu=1 \
  --set controller.resources.limits.memory=1Gi \
  --wait

[jmdeal]

LGTM 🚀