Skip to content
Run

rework vllm_inference example to showcase openai-compatible mode #252

Sign in to view logs

rework vllm_inference example to showcase openai-compatible mode

rework vllm_inference example to showcase openai-compatible mode #252

Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/load_test.py)

Run changed example (06_gpu_and_ml/llm-serving/openai_compatible/load_test.py)
succeeded Jul 31, 2024 in 21s