This is a prometheus exporter for the workflow-orchestrator Dagster's internal system metrics, by querying the Dagit GraphQL API. The exporter reports instance-level metrics as well as metrics for the last seen runs of each pipeline (job/graph/asset auto-materialization). Only runs which have reached a terminal state are reported (success, failure, canceled).
The exporter isn't great at responding to changes in pipeline definitions after it initially begins exporting that pipeline's metrics. This can be amended by restarting the exporter, thus clearing its local state, but that's not a great solution. For example, if a pipeline is deleted/renamed or its steps/ops are deleted/renamed or expectation-result/asset-materialization labels are deleted/renamed, all existing metrics with their labels are still shown by the exporter. prometheus_client exposes methods to delete metrics for a specific fully-specified labels or for every label, but I need the middle-ground to delete metrics for a partially-specified label.