-
Notifications
You must be signed in to change notification settings - Fork 145
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Add histogram metric type #374
feat: Add histogram metric type #374
Conversation
I think we need general tests for this on python backend as well |
+1 on the test. Also I think would be great if we can add the documentation for the new type of metrics: https://github.com/triton-inference-server/python_backend/tree/main/examples/custom_metrics |
…hon_backend into yinggeh-DLIS-7113-support-histogram-metric-type
Updated. See commit |
Co-authored-by: Yingge He <[email protected]>
What does the PR do?
Support histogram metric type and its functions.
Checklist
<commit_type>: <Title>
Commit Type:
Check the conventional commit type
box here and add the label to the github PR.
Related PRs:
triton-inference-server/vllm_backend#56
triton-inference-server/core#386
triton-inference-server/server#7525
Where should the reviewer start?
n/a
Test plan:
n/a
17487728
Caveats:
n/a
Background
Customer requested histogram metrics from vLLM.
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)
n/a