Skip to content

adds an example of openai-compatible serving #13

adds an example of openai-compatible serving

adds an example of openai-compatible serving #13

Run changed example (06_gpu_and_ml/llm-serving/vllm_oai_compatible/api.py)

succeeded May 10, 2024 in 15s