Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pangolin Error #258

Closed
whottel opened this issue Nov 22, 2023 · 9 comments
Closed

Pangolin Error #258

whottel opened this issue Nov 22, 2023 · 9 comments
Labels
bug Something isn't working

Comments

@whottel
Copy link

whottel commented Nov 22, 2023

Hello,

Must be having bad luck today...
I am running Cecret version 3.10.20231121, and the pipleline is failing on the Pangolin process, with the following in .command.err:

INFO:    Environment variable SINGULARITYENV_TMPDIR is set, but APPTAINERENV_TMPDIR is preferred
INFO:    Environment variable SINGULARITYENV_NXF_DEBUG is set, but APPTAINERENV_NXF_DEBUG is preferred
Traceback (most recent call last):
  File "/opt/conda/envs/pangolin/lib/python3.8/site-packages/snakemake/__init__.py", line 587, in snakemake
    workflow = Workflow(
  File "/opt/conda/envs/pangolin/lib/python3.8/site-packages/snakemake/workflow.py", line 242, in __init__
    self.sourcecache = SourceCache()
  File "/opt/conda/envs/pangolin/lib/python3.8/site-packages/snakemake/sourcecache.py", line 358, in __init__
    os.makedirs(self.cache, exist_ok=True)
  File "/opt/conda/envs/pangolin/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/opt/conda/envs/pangolin/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/opt/conda/envs/pangolin/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/opt/conda/envs/pangolin/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
OSError: [Errno 30] Read-only file system: '/Users/hottel/.cache'
@erinyoung
Copy link
Member

What version of singularity are you using? I've also observed this with the 4.3.1-pdata-1.23.1 tag.

Can you switch over to using docker?

@whottel
Copy link
Author

whottel commented Nov 22, 2023

Currently we are using apptainer version 1.2.4-1.el7. Unfortunately, docker is not an option for us as we do not have root access, as our hpc is directly managed by our affiliate university.

@erinyoung
Copy link
Member

I can't resolve your issue, but I asked pangolin about it and hopefully it will be resolved soon.

Temporary workarounds:

  • sent pangolin to false (add --pangolin false to your command line) to skip it and then upload the combined fasta file from nextclade on the pangolin website (https://pangolin.cog-uk.io/)
  • in a config file, set the pangolin container back to a prior version 4.3.1-pdata-1.23

It'd look something like this:

	withName:pangolin{
		container = "staphb/pangolin:4.3.1-pdata-1.23"
	}
  • change your home directory to be writable by anything/anyone - which I don't actually recommend.

@whottel
Copy link
Author

whottel commented Nov 22, 2023

Thanks I will look into those options!

@whottel
Copy link
Author

whottel commented Nov 28, 2023

Hi Erin,

I was able to try a couple different combinations of Cecret and Pango/pdata versions:
Cecret_tests_summary.xlsx

It looks like the issue on my end is a change that was was implemented starting with Cecret version 3.10.20231115

@erinyoung
Copy link
Member

That's awesome! I am not sure why it suddenly started to fail in that version. If it helps any, 3.8.20231031 and forward use the same version of pangolin - so going back to an older workflow will still give you current lineages.

@erinyoung
Copy link
Member

I think I have some good news. I was working with Curtis (StaPH-B/docker-builds#802) and we think we've resolved the pangolin issue.

The version of Cecret associated with this latest PR (#264) should include the improved docker containers and should resolved your problem.

@erinyoung erinyoung added the bug Something isn't working label Dec 5, 2023
@whottel
Copy link
Author

whottel commented Dec 8, 2023

Thanks to you and Curtis for working on this. I just tried version 3.10.20231205 and everything seem to working fine.

@erinyoung
Copy link
Member

VICTORY! Let me know if you run into any issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants