Skip to content

Issues: triton-inference-server/triton_distributed

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 6 Closed
21 Open 6 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Proposal: Remove use tracing as log
#154 opened Feb 10, 2025 by grahamking
Add rust integration (ex: etcd/nats) tests good first issue Good for newcomers
#150 opened Feb 10, 2025 by rmccorm4
Install/test triton_distributed_rs wheel in container good first issue Good for newcomers
#148 opened Feb 10, 2025 by rmccorm4
@rmccorm4
Add soak/load test as a nightly job good first issue Good for newcomers
#147 opened Feb 10, 2025 by rmccorm4
@rmccorm4
Add environment variables for tokio runtime thread counts good first issue Good for newcomers
#146 opened Feb 10, 2025 by rmccorm4
Explore test/code coverage to identify test improvements good first issue Good for newcomers
#144 opened Feb 10, 2025 by rmccorm4
@tanmayv25
Add cargo/unit tests for Metrics good first issue Good for newcomers
#143 opened Feb 10, 2025 by rmccorm4
Consider removing /triton/alpha/list-models utility endpoint good first issue Good for newcomers
#142 opened Feb 10, 2025 by rmccorm4
Enable AnnotationsProvider when we merge in other LLM logic
#141 opened Feb 9, 2025 by ryanolson
Add http route which exposes the allowed api calls.
#140 opened Feb 9, 2025 by ryanolson
Proposal: Remove secondary runtime enhancement New feature or request
#139 opened Feb 9, 2025 by grahamking
@ryanolson
Enable tests for unicode injection detection
#138 opened Feb 9, 2025 by ryanolson
Refactor SSE codec good first issue Good for newcomers
#137 opened Feb 8, 2025 by ryanolson
vllm installation outside of venv in standard container can't detect CUDA good first issue Good for newcomers
#134 opened Feb 8, 2025 by rmccorm4
Does it support the deployment of deepseek-r1?
#133 opened Feb 8, 2025 by MouseSun846
Propagate TaskLocal Context to PythonAsyncEngine
#130 opened Feb 7, 2025 by ryanolson
Migrate to use an optional namespace from an ENV over the hardcoded value
#114 opened Feb 5, 2025 by ryanolson
Missing prerequisites with docker buildx
#42 opened Jan 21, 2025 by piotrm-nvidia
Deadlock in helo world example witch UCX error
#39 opened Jan 17, 2025 by piotrm-nvidia
3
Default execution for single_file.py`` fails when connecting to nats
#35 opened Jan 17, 2025 by piotrm-nvidia
3
pip install fails in main folder with error Multiple top-level packages discovered in a flat-layout
#31 opened Jan 17, 2025 by piotrm-nvidia
ProTip! Exclude everything labeled bug with -label:bug.