Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

用独立进程做推理会把显存都耗完 #235

Open
lipku opened this issue Dec 8, 2024 · 0 comments
Open

用独立进程做推理会把显存都耗完 #235

lipku opened this issue Dec 8, 2024 · 0 comments

Comments

@lipku
Copy link
Contributor

lipku commented Dec 8, 2024

现在想用一个独立进程提供musetalk推理服务，会把显卡24G显存都耗完。
如果不用独立进程，只占用显存12G。
这里面是因为有流水线处理吗，怎么改减小显存占用。
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lipku