Questions tagged [monitoring]
For questions about observing, tracking, and recording activities or data to measure progress towards achieving objectives.
93 questions
0 votes
0 answers
9 views
Otel Collector: Filtering metrics by datapoint attribute lets some leak through
I am trying to filter unneeded metrics to reduce prometheus ingest costs. The metrics in question are sourced by dotnet's HttpClient. http.client.active_requests http.client.connection.duration http....
- 1
0 votes
1 answer
12 views
Regexp for amtool silencer
We use the amtool with the next cronjob in Kubernetes for silencing alerts: command: - /bin/sh - -c - | amtool --alertmanager.url="http://alertmanager-operated.monitoring....
- 583
0 votes
0 answers
47 views
More elegant way to find Datadog services missing from Service Catalog than API scraping?
I'm trying to identify services that exist in Datadog telemetry (metrics, logs, or APM traces) but aren't registered in the Service Catalog. Currently my approach involves hitting the Datadog API to ...
- 1,911
0 votes
0 answers
39 views
Promtail 3.4.4 parsing stages (regex, logfmt) not working with Docker service discovery - only static labels work
I'm experiencing an issue where Promtail 3.4.4 successfully ingests Docker container logs but all parsing stages (regex, logfmt, template) fail silently. Only basic pipeline stages like static_labels ...
- 101
0 votes
0 answers
22 views
Grafana - detecting incidents
Have Grafana on premise with prometheus. Some anomalies can be detected by viewing a set of charts (slow requests, retries, pending transactions, etc.). SRE operators need to have the opportunity to ...
- 101
0 votes
2 answers
197 views
How could I install KubeView to visualize my kubernetes cluster?
As a Kubernetes user I would like to install KubeView to visualize my Kubernetes cluster in a nice graph. I came across KubeView which is a free and open source tool for Kubernetes cluster ...
- 101
1 vote
0 answers
70 views
Kubernetes HPA not working with Datadog metric
I am trying to autoscale PODs based on custom metric from DatadogMetric. I have followed the documentation on Datadog to create a DatadogMetric and the use it in your HPA as External metric. My ...
- 11
0 votes
1 answer
217 views
Concat multiple meta labels on prometheus for relabling
How can I change the value of the label __param_target to resemble how I would interact with a Kubernetes service in-cluster, following the format: http://serviceName.namespace.svc:servicePort/path ? ...
- 61
0 votes
1 answer
147 views
How to aggregate logs and metrics from multiple modules accross different servers?
We are thinking about setting up a solution for aggregating logs and metrics from multiple modules accross different servers. The problem is that it needs to run in a hospital and the logs may contain ...
- 103
0 votes
1 answer
86 views
Virtual Machine Monitoring KQL yielding empty results
I have enabled Azure Monitoring in one of our virtual machine. Is been 4 days the virtual machine is on, below is the query: Perf | where ObjectName == "Memory" and (CounterName == "...
- 146
1 vote
1 answer
874 views
What are the good metrics to collect for frontend application?
Context: We have some features that rarely calls any backend service and the logic stays in the frontend. Most of the tools we have can calculate SLI/SLO status based on latency and error code return ...
- 113
1 vote
1 answer
3k views
Grafana NGINX reverse proxy not functioning correctly
I seem to be having trouble with Grafana behind an nginx proxy. I'm getting console errors and errors in Grafana, and the changes I try to make in Grafana are not working. Errors: From within Grafana ...
- 11
2 votes
2 answers
4k views
Monitoring Kubernetes CronJob & Job in Grafana for today day only
I'm trying to create a Dashboard in Grafana that will show the status of Cronjob & Job success & fail. Currently i'm using kube_job_status_succeeded to get a status job, but the issue here ...
- 21
1 vote
1 answer
2k views
What means "Reconciliation" from Argo CD
I m looking a metric in Grafana from a official Dashboard from Argo CD, the panel its named "Reconciliation Activity" and use the following metric: argocd_app_reconcile_count I look for a ...
1 vote
1 answer
1k views
How to monitor ELK using metricbeat on kubernetes (v8 compatible and simple solution)
For probably more than a year there's been a deprecation warning on xpack monitoring in elasticsearch, logstash, kibana etc. saying the built-in monitoring is going to disappear. Since I don't like ...
- 131