You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm not planning to include this in the core marker (I don't want to bloat the library), but it would be easy to write an external utility that does this
It would be great to add an option to select batch size automatically using accelerate
find_executable_batch_size
function:https://huggingface.co/docs/accelerate/main/en/package_reference/utilities#accelerate.find_executable_batch_size
The text was updated successfully, but these errors were encountered: