Skip to content

Update user docs for running llm server + upgrade gguf to 0.11.0 #463

Update user docs for running llm server + upgrade gguf to 0.11.0

Update user docs for running llm server + upgrade gguf to 0.11.0 #463

Triggered via pull request December 12, 2024 17:53
Status Cancelled
Total duration 19s
Artifacts

ci_eval_short.yaml

on: pull_request
Matrix: Llama3.1 8B FP16
Fit to window
Zoom out
Zoom in

Annotations

2 errors
Llama3.1 8B FP16 (3.11, llama-mi300x-3)
Canceling since a higher priority waiting request for 'CI - sharktank perplexity short-676' exists
Llama3.1 8B FP16 (3.11, llama-mi300x-3)
The operation was canceled.