Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Number of files in the work folder #53

Open
esud1 opened this issue Jan 22, 2025 · 2 comments
Open

Number of files in the work folder #53

esud1 opened this issue Jan 22, 2025 · 2 comments

Comments

@esud1
Copy link

esud1 commented Jan 22, 2025

Hello,

Thank you for your previous help!
I can now run the analysis, but kind of hindered by the huge number of files in the work folder.
Since I am running on the university cluster, I am limited to the number of files allowed on the server.
Are there any ways to reduce this huge file numbers in the work folder?

Thanks!
Edi

@sinamajidian
Copy link
Collaborator

Hi Edi
you're welcome. I'm not sure we have a solution for this right now.
How many species are you working on?
Is the limitation on the total number of stored files or
the number of files that are open at a time?
For the latter, one idea is to increase the limit with ulimit -n 271072 if the system allows.
(There will be many more files if --write_msas --write_genetrees are activated, which is not by default).
Best,
Sina

@alpae
Copy link
Member

alpae commented Jan 23, 2025

note that you can specify a different folder for the work directory. often there is a scratch space that allows more files per user. you can set this with the -work-dir command line option.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants