Skip to content

rework vllm_inference example to showcase openai-compatible mode #254

rework vllm_inference example to showcase openai-compatible mode

rework vllm_inference example to showcase openai-compatible mode #254

Triggered via pull request July 31, 2024 03:57
Status Failure
Total duration 1m 46s
Artifacts

run-examples.yml

on: pull_request
Generate matrix of changed examples
4s
Generate matrix of changed examples
Matrix: Run changed example
Fit to window
Zoom out
Zoom in

Annotations

1 error and 6 warnings
Run changed example (06_gpu_and_ml/llm-serving/vllm_inference.py)
Process completed with exit code 1.
Generate matrix of changed examples
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/client.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/vllm_inference.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/locustfile.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/load_test.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/download_llama.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/