Export Confluent Cloud Metrics to Datadog

After a bit of searching, I found a Prometheus exporter for extracting metrics from the Confluent Cloud Metrics API. All I needed to do was set up this exporter in combination with the Datadog agent, so I could send those metrics to Datadog. As we were running everything on k8s I also wanted to run this exporter on our clusters as well. On my github you can find the manifest which creates a deployment with a ReplicaSet of one and has two containers, namely the ccloud exporter and the datadog agent. Once deployed it will start fetching metrics and exporting it to Datadog.

In Datadog you go to “Dashboard > New Dashboard > New Timeboard“. On your new dashboard, you add a widget by clicking on “Add graph” and you drag the Timeseries widget to the board. By default system.cpu.user is selected as metric, but when you click on it and fill in ccloud then you will see the available metrics. A list of available metrics can also be found in the Confluent Cloud documentation.

If you need some help with creating dashboards you can check the Datadog documentation here. Once you have set up the widget with the metrics you like, you will get something like the dashboard below.

• 

If you have any questions then you can leave a comment or contact Bram via Github, Linkedin, or Twitter.