Can faiss query vectors across multiple cuda streams #3745
Unanswered
guoxinghai
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
For faiss serving, can Cuda Stream be used to enable GPU to process multiple query requests in parallel, so as to improve GPU utilization?
Beta Was this translation helpful? Give feedback.
All reactions