Skip to content

[V1][Metrics] Add per-request prompt/generation_tokens histograms#12516

Merged
robertgshaw2-redhat merged 1 commit intovllm-project:mainfrom markmc:metrics-v1-prometheus-logger-3Jan 28, 2025
+102-14

Commits

Commits on Jan 28, 2025