EVM Metrics DOCS and Dashboard

[Ferparishuertas]

Context

At the end of Last year we ha introduced extended opentelemetry metrics into the consensus node. All the included metrics can be find here. Here is the PR and the original "Design spec" https://www.notion.so/swirldslabs/EVM-Metrics-we-want-to-visualize-17c7c9ab259180569e3bdccb414cf2c2

We need to inciude the throttle metrics, and alerts.

Actions

• Extract all the opentelemetry EVM related metrics

• We need to document on very detailled manner any metric and its meaning, usage

• We need to build an EVM Grafana Dashboard to be able to monitor all the relevant extracted metrics

• We need to create meaningful alerts to monitor and support the different networks

Steps

• First of all review all the metrics, document and get validation for the document
• Design a possible dashboard, with intended graphs and metrics that can enable us as a team to monitor and get relevant information from the node
• Implement the dashboard, and store the json file inside the consensus node for community usage purposes. Update de repo documentation to highlight the board to users.
• Define the key alerts we should have for operational, support purpose.
• Validate and implement the metrics