New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

大佬您好，关于显存释放问题 #25

Open

ganjunhong opened this issue Mar 1, 2024 · 1 comment

Labels

ganjunhong commented Mar 1, 2024

大佬您好，执行完m.predict(）推理以后，显存是不会立马释放掉，请问如何可以释放掉显存占用。

ganjunhong added the enhancement label

Owner

shibing624 commented Mar 2, 2024

批量执行多次predict后，使用 torch.cuda.empty_cache()

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment