Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load models automatically on server startup? #2

Open
reynoldsnlp opened this issue Jan 29, 2019 · 2 comments
Open

Load models automatically on server startup? #2

reynoldsnlp opened this issue Jan 29, 2019 · 2 comments
Assignees

Comments

@reynoldsnlp
Copy link
Owner

reynoldsnlp commented Jan 29, 2019

What will it take to daemonize this?

One approach to this sort of thing is Apache UIMA, but this would take a huge refactor.

@reynoldsnlp
Copy link
Owner Author

reynoldsnlp commented Apr 18, 2019

We don't need to daemonize this. The only performance hit comes the first time that a query is made. Thereafter, everything is loaded and it works fine.

The only possible optimization might be to automatically load the model before any requests are made (on server startup), but I'm not convinced that this is necessary or helpful.

Instead, perhaps on the front end we could have a different indicator for "model loading" vs "performing query".

@reynoldsnlp reynoldsnlp changed the title Fix performance with loading Russian model Load models automatically on server startup? Apr 19, 2019
@mjbriggs
Copy link
Collaborator

I have not done any work on this issue. I am somewhat sure that we talked about loading the servers on startup not being incredibly useful since a user could attempt to make a request while a server is loading and the model loading would take precedence over the search request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants