Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
JenZhao committed Feb 27, 2025
1 parent 1f84fc7 commit eb21d44
Showing 1 changed file with 7 additions and 3 deletions.
10 changes: 7 additions & 3 deletions docs/source/getting_started/v1_user_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,22 +19,26 @@ Previous blog post [vLLM V1: A Major Upgrade to vLLM's Core Architecture](https:
more detailed list of the supported models. Encoder-decoder models support is not
happending soon.

## Unsupported features
### List of features that are deprecated in v1
- best_of
- logits_processors
- beam_search

## Unsupported features

### LoRA
- LoRA works for V1 on the main branch, but its performance is inferior to that of V0.
The team is actively working on improving the performance [PR](https://github.com/vllm-project/vllm/pull/13096).

### Spec decode other than ngram
### Spec Decode other than ngram
- Currently, only ngram spec decode is supported in V1 after this [PR](https://github.com/vllm-project/vllm/pull/12193).

### KV Cache Swapping & Offloading & FP8 KV Cache
- vLLM v1 does not support KV Cache swapping, offloading, and FP8 KV Cache yet. The
team is working actively on it.


## Unsupported models
## Unsupported Models


## FAQ

0 comments on commit eb21d44

Please sign in to comment.