Skip to content

lmdeploy的设计是和vllm一样先来先服务（FCFS），后来先抢占，gpu不够就先swap到cpu上吗？ #2088

Unanswered
sunzx8 asked this question in Q&A
lmdeploy的设计是和vllm一样先来先服务（FCFS），后来先抢占，gpu不够就先swap到cpu上吗？ #2088
@sunzx8 sunzx8
Jul 19, 2024 · 1 comment
Return to top
Discussion options

sunzx8
Jul 19, 2024

You must be logged in to vote

Replies: 1 comment

Comment options

sunzx8
Jul 22, 2024
Author

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant
@sunzx8
Converted from issue

This discussion was converted from issue #2087 on July 19, 2024 09:33.