[Feature][Frontend] Add KVTransferParams for disaggregated prefill feature #2351
Annotations
3 errors
Run pre-commit/action@2c7b3805fd2a0fd8c1884dcaebf91fc102a13ecd:
vllm/engine/async_llm_engine.py#L1109
vllm/engine/async_llm_engine.py:1109:40: F821 Undefined name `kv_transfer_params`
|
Run pre-commit/action@2c7b3805fd2a0fd8c1884dcaebf91fc102a13ecd:
vllm/engine/multiprocessing/client.py#L583
vllm/engine/multiprocessing/client.py:583:54: F821 Undefined name `kv_transfer_params`
|
Run pre-commit/action@2c7b3805fd2a0fd8c1884dcaebf91fc102a13ecd
Process completed with exit code 1.
|
Loading