Why is it taking so much RAM? #1336
Unanswered
fernandocamargoai
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm packing my model for inference and, if I have a GPU available, I transfer my model to it and hybridize it with the following code:
When my this code is finished, my model occupies 5GB of RAM and 600MB of VRAM. The VRAM is pretty normal, but I don't understand why this much RAM is needed, especially because my model is in GPU. If I don't transfer it to GPU (removing the first two lines of code), it takes only 550MB of RAM. If I only transfer it to GPU (lefting only the first two lines of code), it takes 1.8GB of RAM. So, this weird behavior only happens when using GPU. Am I doing something wrong?
Beta Was this translation helpful? Give feedback.
All reactions