Inlined Refs

by confluentinc914d95eff7ffNo license58 starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated 2 days ago

Generate a Kafka consumer group lag dashboard. Use when the user asks to monitor lag, build a dashboard for consumer lag, or wire up Prometheus exporters for Kafka. Do NOT trigger for producer metrics, broker JMX, or Streams-specific monitoring.

Instructions onlyDevOps & Cloud
AI-generated overview

Guides selection of a Kafka consumer group lag exporter and sets up a Grafana dashboard and lag alerts.

What it does
This skill walks through building a Kafka consumer group lag monitoring setup. It compares two exporters, kafka-exporter and Confluent Control Center, with configuration snippets and guidance on which fits which cluster size. It then specifies a Grafana dashboard and a default lag alert threshold, producing a recommended monitoring configuration rather than files.
When to use it
Use it when the user wants to monitor Kafka consumer group lag, build a lag dashboard, or wire up Prometheus exporters for Kafka. It is not intended for producer metrics, broker JMX, or Kafka Streams-specific monitoring.
Requirements
No scripts are included; it is instructions only. Following it assumes a Kafka cluster, a chosen exporter such as kafka-exporter or Confluent Control Center, Prometheus, and Grafana, with network access to those services.

inlined-refs — consumer lag dashboarding

Step 1 — pick the exporter

We support two exporters. Read the comparison below before recommending.

Exporter comparison (from references/exporters.md)

kafka-exporter (Danielqsj)

Pros: lightweight, single binary, exposes per-group lag directly. Cons: stateful (consumes __consumer_offsets internally), can lag on large clusters.

Best for: clusters < 100 brokers, < 1000 consumer groups.

Config snippet:

kafka-exporter \  --kafka.server=localhost:9092 \  --kafka.version=3.5.0 \  --web.listen-address=:9308

Confluent Control Center

Pros: official, covers full Confluent Platform metrics. Cons: paid licensing, heavier footprint.

Best for: enterprise Confluent Platform users.

Step 2 — Grafana dashboard

Use Grafana dashboard 7589 for kafka-exporter. Filter by consumer group, plot kafka_consumergroup_lag over a 5-minute window.

Step 3 — alerts

Set lag > 10,000 messages for 5 minutes as the default alert. Adjust per topic SLA.

Source and attribution

Source:confluentinc/agent-skillsinskills/confluent-skill-reviewer/evals/mock-skills/inlined-refsat commit914d95e

License: No license

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal