Skip to content

[TESTS] Use FP32 inference precision, FP16 KV cache precision for pipelines #6388

[TESTS] Use FP32 inference precision, FP16 KV cache precision for pipelines

[TESTS] Use FP32 inference precision, FP16 KV cache precision for pipelines #6388

Triggered via pull request January 6, 2025 15:10
Status Cancelled
Total duration 21m 22s
Artifacts

causal_lm_cpp.yml

on: pull_request
Matrix: cpp-beam_search_causal_lm-ubuntu
cpp-multinomial-greedy_causal_lm-ubuntu
14m 37s
cpp-multinomial-greedy_causal_lm-ubuntu
cpp-greedy_causal_lm-windows
20m 43s
cpp-greedy_causal_lm-windows
cpp-greedy_causal_lm-Qwen-7B-Chat
12m 11s
cpp-greedy_causal_lm-Qwen-7B-Chat
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
21m 5s
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
cpp-beam_search_causal_lm-Phi-2
17m 15s
cpp-beam_search_causal_lm-Phi-2
cpp-beam_search_causal_lm-notus-7b-v1
15m 45s
cpp-beam_search_causal_lm-notus-7b-v1
cpp-speculative_decoding_lm-ubuntu
13m 14s
cpp-speculative_decoding_lm-ubuntu
cpp-prompt_lookup_decoding_lm-ubuntu
12m 33s
cpp-prompt_lookup_decoding_lm-ubuntu
cpp-Phi-1_5
8m 22s
cpp-Phi-1_5
cpp-greedy_causal_lm-redpajama-3b-chat
12m 8s
cpp-greedy_causal_lm-redpajama-3b-chat
cpp-chat_sample-ubuntu
15m 18s
cpp-chat_sample-ubuntu
visual_language_chat_sample-ubuntu-minicpm_v2_6
8m 44s
visual_language_chat_sample-ubuntu-minicpm_v2_6
visual_language_chat_sample-ubuntu-llava_1_5  /  visual_language_chat_sample-ubuntu-llava
16m 30s
visual_language_chat_sample-ubuntu-llava_1_5 / visual_language_chat_sample-ubuntu-llava
visual_language_chat_sample-ubuntu-llava_next  /  visual_language_chat_sample-ubuntu-llava
18m 28s
visual_language_chat_sample-ubuntu-llava_next / visual_language_chat_sample-ubuntu-llava
visual_language_chat_sample-ubuntu-internvl2
15m 14s
visual_language_chat_sample-ubuntu-internvl2
cpp-continuous-batching-ubuntu
14m 20s
cpp-continuous-batching-ubuntu
cpp-continuous-batching-windows
20m 36s
cpp-continuous-batching-windows
cpp-continuous-batching-macos
20m 54s
cpp-continuous-batching-macos
ci/gha_overall_status_causal_lm
0s
ci/gha_overall_status_causal_lm
Fit to window
Zoom out
Zoom in

Annotations

9 errors and 1 warning
cpp-continuous-batching-windows
Canceling since a higher priority waiting request for 'refs/pull/1485/merge-causal-lm-cpp' exists
cpp-continuous-batching-windows
The operation was canceled.
cpp-greedy_causal_lm-windows
Canceling since a higher priority waiting request for 'refs/pull/1485/merge-causal-lm-cpp' exists
cpp-greedy_causal_lm-windows
The operation was canceled.
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
Canceling since a higher priority waiting request for 'refs/pull/1485/merge-causal-lm-cpp' exists
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
The operation was canceled.
cpp-continuous-batching-macos
Canceling since a higher priority waiting request for 'refs/pull/1485/merge-causal-lm-cpp' exists
cpp-continuous-batching-macos
The operation was canceled.
ci/gha_overall_status_causal_lm
Process completed with exit code 1.
ci/gha_overall_status_causal_lm
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636