Skip to content
Run

rework vllm_inference example to showcase openai-compatible mode #256

Sign in to view logs

rework vllm_inference example to showcase openai-compatible mode

rework vllm_inference example to showcase openai-compatible mode #256

Run changed example (06_gpu_and_ml/llm-serving/download_llama.py)

Run changed example (06_gpu_and_ml/llm-serving/download_llama.py)
succeeded Jul 31, 2024 in 1m 14s