Skip to content

rework vllm_inference example to showcase openai-compatible mode #256

rework vllm_inference example to showcase openai-compatible mode

rework vllm_inference example to showcase openai-compatible mode #256

Triggered via pull request July 31, 2024 04:11
Status Success
Total duration 1m 47s
Artifacts

run-examples.yml

on: pull_request
Generate matrix of changed examples
12s
Generate matrix of changed examples
Matrix: Run changed example
Fit to window
Zoom out
Zoom in

Annotations

7 warnings
Generate matrix of changed examples
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/locustfile.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (internal/examples_test.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/vllm_inference.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/load_test.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/client.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run changed example (06_gpu_and_ml/llm-serving/download_llama.py)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/