Upstream merge 24 10 08 #226

gshtras · 2024-10-08T18:56:08Z

Upstream merge from 2024/10/08
Including the fix for weight loading introduced by upstream vllm-project#9090 that's pending in upstream vllm-project#9160

…ject#8814)

…ect#8818)

…oject#8872) Signed-off-by: kevin <[email protected]>

…vllm-project#8861)

…m-project#8820)

…rovided (vllm-project#8568)

…ect#8829)

…mpatibility (vllm-project#8764)

Signed-off-by: Max de Bayser <[email protected]>

Signed-off-by: Peter Pan <[email protected]>

…-project#8892)

…project#8875)

…od (vllm-project#7271)

Co-authored-by: mgoin <[email protected]>

vllm-project#8378) Co-authored-by: Varun Sundar Rabindranath <[email protected]>

Signed-off-by: tylertitsworth <[email protected]> Co-authored-by: youkaichao <[email protected]>

…t#8443)

Co-authored-by: Roger Wang <[email protected]>

…llm-project#9151) Signed-off-by: Alex-Brooks <[email protected]>

…age the templates*.jinja when serving models (vllm-project#8758) Signed-off-by: Peter Pan <[email protected]>

…rocessing (vllm-project#8537)

Co-authored-by: Cyrus Leung <[email protected]>

…ct#9132) Signed-off-by: Rafael Vasquez <[email protected]>

…0_08

tlrmchlsmth and others added 30 commits September 26, 2024 10:07

[Build/CI] Upgrade to gcc 10 in the base build Docker image (vllm-pro…

f70bcca

…ject#8814)

[Docs] Add README to the build docker image (vllm-project#8825)

520db4d

[CI/Build] Fix missing ci dependencies (vllm-project#8834)

68988d4

[misc][installation] build from source without compilation (vllm-proj…

70de39f

…ect#8818)

[ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (vllm-pr…

d9cfbc8

…oject#8872) Signed-off-by: kevin <[email protected]>

[Bugfix] Include encoder prompts len to non-stream api usage response (…

93d364d

…vllm-project#8861)

[Misc] Change dummy profiling and BOS fallback warns to log once (vll…

b28d210

…m-project#8820)

[Bugfix] Fix print_warning_once's line info (vllm-project#8867)

e2f6f26

fix validation: Only set tool_choice auto if at least one tool is p…

ee2da3e

…rovided (vllm-project#8568)

[Bugfix] Fixup advance_step.cu warning (vllm-project#8815)

71d21c7

[BugFix] Fix test breakages from transformers 4.45 upgrade (vllm-proj…

4b377d6

…ect#8829)

[Installation] Allow lower versions of FastAPI to maintain Ray 2.9 co…

1b49148

…mpatibility (vllm-project#8764)

[Feature] Add support for Llama 3.1 and 3.2 tool use (vllm-project#8343)

344cd2b

Signed-off-by: Max de Bayser <[email protected]>

[Core] renamePromptInputs and inputs (vllm-project#8876)

3b00b9c

[misc] fix collect env (vllm-project#8894)

dc4e3df

[MISC] Fix invalid escape sequence '\' (vllm-project#8830)

0e08875

Signed-off-by: Peter Pan <[email protected]>

[Bugfix][VLM] Fix Fuyu batching inference with max_num_seqs>1 (vllm…

6d792d2

…-project#8892)

[TPU] Update pallas.py to support trillium (vllm-project#8871)

8df2dc3

[torch.compile] use empty tensor instead of None for profiling (vllm-…

a9b15c6

…project#8875)

[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear meth…

172d1cd

…od (vllm-project#7271)

[Bugfix] fix for deepseek w4a16 (vllm-project#8906)

c5d5535

Co-authored-by: mgoin <[email protected]>

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (

c2ec430

vllm-project#8378) Co-authored-by: Varun Sundar Rabindranath <[email protected]>

[misc][distributed] add VLLM_SKIP_P2P_CHECK flag (vllm-project#8911)

18e60d7

[Core] Priority-based scheduling in async engine (vllm-project#8850)

bd429f2

[misc] fix wheel name (vllm-project#8919)

d86f6b2

[Bugfix][Intel] Fix XPU Dockerfile Build (vllm-project#7824)

260024a

Signed-off-by: tylertitsworth <[email protected]> Co-authored-by: youkaichao <[email protected]>

[Misc] Remove vLLM patch of BaichuanTokenizer (vllm-project#8921)

b0298aa

[Bugfix] Fix code for downloading models from modelscope (vllm-projec…

39d3f8d

…t#8443)

[Bugfix] Fix PP for Multi-Step (vllm-project#8887)

19d02ff

[CI/Build] Update models tests & examples (vllm-project#8874)

e1a3f5e

Co-authored-by: Roger Wang <[email protected]>

alex-jw-brooks and others added 27 commits October 8, 2024 14:31

[Frontend] Add Early Validation For Chat Template / Tool Call Parser (v…

069d3bd

…llm-project#9151) Signed-off-by: Alex-Brooks <[email protected]>

Improve efficiency

4ef043b

Rename

e723680

Update LLaVA-NeXT-Video

c60e921

[CI/Build] Add examples folder into Docker image so that we can lever…

cfba685

…age the templates*.jinja when serving models (vllm-project#8758) Signed-off-by: Peter Pan <[email protected]>

[Bugfix] fix OpenAI API server startup with --disable-frontend-multip…

9a94ca4

…rocessing (vllm-project#8537)

Automatic loading and save memory

9f12890

Rename

10b5b0e

Update docstring

ce08df5

Simplify

df687ac

Cleanup

98bf417

Fully enable recursive loading

decc7a4

Clarify

e59201a

[Doc] Update vlm.rst to include an example on videos (vllm-project#9155)

1874c6a

Co-authored-by: Cyrus Leung <[email protected]>

Fix incorrect semantics

f538ab9

Move function

f077865

Update error message

56e4a33

Fix Ultravox loading

85c63c8

spacing

42a3253

Merge remote-tracking branch 'upstream/main'

b21ccdf

Merge remote-tracking branch 'upstream/main' into main

e5a7def

Merge remote-tracking branch 'upstream/fix-weight-loading' into main

3e72cae

Merge remote-tracking branch 'origin/main' into upstream_merge_24_10_08

674b2a5

[Doc] Improve contributing and installation documentation (vllm-proje…

de24046

…ct#9132) Signed-off-by: Rafael Vasquez <[email protected]>

Fix server

390efcb

[Bugfix] Try to handle older versions of pytorch (vllm-project#9086)

bd37b9f

Merge remote-tracking branch 'upstream/main' into upstream_merge_24_1…

8fa419f

…0_08

shajrawi approved these changes Oct 9, 2024

View reviewed changes

shajrawi merged commit a466f09 into main Oct 9, 2024
17 of 18 checks passed

shajrawi deleted the upstream_merge_24_10_08 branch October 9, 2024 14:04

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upstream merge 24 10 08 #226

Upstream merge 24 10 08 #226

gshtras commented Oct 8, 2024

Upstream merge 24 10 08 #226

Upstream merge 24 10 08 #226

Conversation

gshtras commented Oct 8, 2024