Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add environment variables for tokio runtime thread counts #146

Open
rmccorm4 opened this issue Feb 10, 2025 · 0 comments
Open

Add environment variables for tokio runtime thread counts #146

rmccorm4 opened this issue Feb 10, 2025 · 0 comments
Labels
good first issue Good for newcomers

Comments

@rmccorm4
Copy link
Contributor

See #129 (comment)

TLDR; Instead of hard-coded thread counts 16/16 for tokio worker/blocking threads - we can set the default values to 16 and expose env vars like these to configure them:

TRITON_RUNTIME_NUM_WORKER_THREADS=16
TRITON_RUNTIME_MAX_BLOCKING_THREADS=16

Done criteria:

  • Defaults are 16
  • Env vars are exposed with a simple test to validate them
  • Document env vars
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant