Add node_exporter template

[rvashishth]

Is your feature request related to a problem? Please describe.
The grafana dashboards should display metrics for nodes and containers. Use prometheus node_exporter to export kubernetes node metrics.

Describe the solution you'd like
Define node exporter template as defined at streamnative charts

Additional context
Although monitoring.node_exporter is enabled at values.yml file but it seems no template for node_exporters are defined yet.

[mkoertgen]

Probably removed because most clusters will typically already have a similar daemonset?

As a workaround can we just deploy a standard node-exporter?

• https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-node-exporter

[mkoertgen]

Added as mentioned above with podAnnotations.scrape: true.

This kind of works but lacks the kubelet_volume_stats_* metrics which were helpful in monitoring e.g. the ledger-usage of the bookies.

Some of the pular-provisioned grafana-dashboards rely on that, e.g. the "Bookie Metrics"-dashboard

As you can see the PVC metrics show no data because neither the kubelet_volume_stats_available_bytes nor kubelet_volume_stats_capacity_bytes is exported anymore. However bookie_ledger_dir__pulsar_data_bookkeeper_ledgers_usage is still there

It has been reported that this has changed since 1.12 of the exporter and there in ongoing discussion on pvc metrics, cf.:

• Monitoring Kubernetes PersistentVolumes  prometheus-operator/prometheus-operator#2359

It did not dig into the issue in detail but my understanding so far is that this neither solved yet nor is there a clear path how to go about this.

[lhotari]

Since 3.0.0 chart version, kube-prometheus-stack has been used for Prometheus and Grafana. Closing this issue.