Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

When translating a sequence of text files using Huggingface, the model is loaded multiple times #535

Open
benjaminking opened this issue Sep 26, 2024 · 0 comments
Open

When translating a sequence of text files using Huggingface, the model is loaded multiple times #535

benjaminking opened this issue Sep 26, 2024 · 0 comments
Labels
bug Something isn't working pipeline 6: infer Issue related to using a trained model to translate.

Comments

@benjaminking
Copy link
Collaborator

If you translate a sequence of text files using translate.py and "--start-seq", the model is loaded into memory multiple times. If you translate 10 files, the model will be loaded 10 times, which is inefficient.
@benjaminking benjaminking added bug Something isn't working pipeline 6: infer Issue related to using a trained model to translate. labels Sep 26, 2024
@ddaspit ddaspit moved this from 🆕 New to 📋 Backlog in SIL-NLP Research Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working pipeline 6: infer Issue related to using a trained model to translate.
Projects
SIL-NLP Research
Status: 📋 Backlog
Milestone
No milestone
Development

No branches or pull requests
1 participant
@benjaminking