Benchmark Nightly #205
benchmark-nightly.yml
on: schedule
g5-12xl
/
create-runners
1m 2s
g5-2xl
/
create-runners
36s
g5-48xl
/
create-runners
1m 17s
create-runners
49s
Matrix: handler-performance-test
Matrix: g5-12xl / benchmark_run
Matrix: g5-2xl / benchmark_run
Matrix: g5-48xl / benchmark_run
stop-g6-runners
5s
g5-12xl
/
stop-runners
5s
g5-2xl
/
stop-runners
5s
g5-48xl
/
stop-runners
5s
Annotations
1 error
handler-performance-test (TestGPUHandlerPerformance, g6)
Process completed with exit code 1.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
llama2[ENGINE=lmi-dist]
|
7.39 MB |
|
llama2[ENGINE=vllm]
|
3.69 MB |
|
llama3[ENGINE=lmi-dist]
|
22.2 MB |
|
llama3[ENGINE=vllm]
|
44.4 MB |
|
mistral[ENGINE=lmi-dist]
|
3.69 MB |
|
mistral[ENGINE=vllm]
|
22.2 MB |
|
mixtral-8x7b[ENGINE=lmi-dist]
|
11.1 MB |
|
mixtral-8x7b[ENGINE=vllm]
|
3.7 MB |
|
template-g5.12xlarge
|
772 Bytes |
|
template-g5.2xlarge
|
830 Bytes |
|
template-g5.48xlarge
|
724 Bytes |
|
test-TestGPUHandlerPerformance-logs
|
270 KB |
|