"from vllm import ServerArgs, LLMServer, SamplingParams" error

[AnaRhisT94]

Hi @cadedaniel

I'm having an error when importing when running launch_vllm.py
from vllm import ServerArgs, LLMServer

Where can I get the server_args.py and llm_server.py files to import their corresponding classes 'ServerArgs' and 'LLMServer'?

I tried the vLLM's June version (2023) and I can't see it there although you said that you used that version in another issue that was opened.
Reference June 2023 version: https://github.com/vllm-project/vllm/tree/67d96c29fba9b72cb4c4edbc26211c208a00ebdd/vllm

[cadedaniel]

I'm guessing this is the PR you're missing: vllm-project/vllm#152