Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MemoryError issues during deploy #86

Open
virtuald opened this issue Jan 8, 2024 · 2 comments
Open

MemoryError issues during deploy #86

virtuald opened this issue Jan 8, 2024 · 2 comments

Comments

@virtuald
Copy link
Member

virtuald commented Jan 8, 2024

The working theory is that pip writes the wheels to a temporary directory, which fills RAM, which causes MemoryErrors to occur. We haven't definitively measured this, but some ideas to address this involve:

  • Kill the NI webserver during deploy
  • Kill any user program during deploy
  • Use NFS instead of a webserver to provide pip the artifacts? https://pypi.org/project/ShenanigaNFS/
  • Use a FUSE filesystem to provide pip the artifacts
@virtuald
Copy link
Member Author

We kill the NI webserver and the user program now, maybe things are better now?

@virtuald virtuald changed the title Temp disk issues during deploy MemoryError issues during deploy Jan 15, 2024
@virtuald
Copy link
Member Author

Nobody has complained about this recently, so it's probably fine for now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant