Skip to content
Back to pull request #258

Refactor llm perf backend handling #121

Sign in to view logs

Refactor llm perf backend handling

Refactor llm perf backend handling #121

Run time

Learn about OS pricing on GitHub Actions
Job Run time
run_benchmarks (unquantized, 1xA10, aws-g5-4xlarge-plus)
6h 0m 9s
run_benchmarks (unquantized, 1xT4, aws-g4dn-2xlarge)
6h 0m 9s
run_benchmarks (bnb, 1xA10, aws-g5-4xlarge-plus)
6h 0m 9s
run_benchmarks (bnb, 1xT4, aws-g4dn-2xlarge)
6h 0m 8s
run_benchmarks (awq, 1xA10, aws-g5-4xlarge-plus)
6h 0m 9s
run_benchmarks (awq, 1xT4, aws-g4dn-2xlarge)
6h 0m 8s
run_benchmarks (gptq, 1xA10, aws-g5-4xlarge-plus)
6h 0m 9s
run_benchmarks (gptq, 1xT4, aws-g4dn-2xlarge)
2h 50m 1s
1d 20h 51m 2s