Skip to content

adds an example of openai-compatible serving (#739) #14

adds an example of openai-compatible serving (#739)

adds an example of openai-compatible serving (#739) #14

Run changed example (06_gpu_and_ml/llm-serving/vllm_oai_compatible/client.py)

succeeded May 10, 2024 in 14s