Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed benchmark example command to --gpus '"device=0"' #667

Closed
wants to merge 2 commits into from
Closed

Fixed benchmark example command to --gpus '"device=0"' #667

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
607e9c7
Fixed benchmark example command to --gpus '"device=0"'
Titan-Node Oct 5, 2024
79508b5
Update benchmarking.mdx
Titan-Node Oct 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions ai/orchestrators/benchmarking.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -47,12 +47,12 @@ Orchestrator node.
Example command:

```bash
docker run --gpus 0 -v ./models:/models livepeer/ai-runner:latest python bench.py --pipeline text-to-image --model_id stabilityai/sd-turbo --runs 3 --batch_size 3
docker run --gpus '"device=0"' -v ./models:/models livepeer/ai-runner:latest python bench.py --pipeline text-to-image --model_id stabilityai/sd-turbo --runs 3 --batch_size 3
```

In this command, the following parameters are used:

- `<GPU_IDs>`: Specify which GPU(s) to use. For example, `0` for GPU 0, `0,1` for GPU 0 and GPU 1, or `all` for all GPUs.
- `<GPU_IDs>`: Specify which GPU(s) to use. For example, `'"device=0"'` for GPU 0, `'"device=0,1"'` for GPU 0 and GPU 1, or `'"device=all"'` for all GPUs.
- `<PIPELINE>`: The pipeline to benchmark (e.g., `text-to-image`).
- `<MODEL_ID>`: The model ID to use for benchmarking (e.g., `stabilityai/sd-turbo`).
- `<RUNS>`: The number of benchmark runs to perform.
Expand Down
Loading