Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add iris-grib to dev dependencies #980

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Add iris-grib to dev dependencies #980

wants to merge 2 commits into from

Conversation

jfrost-mo
Copy link
Member

@jfrost-mo jfrost-mo commented Dec 10, 2024

It seems that the eccodes download issues were just temporary, so we can now re-add it.

Fixes #959

Contribution checklist

Aim to have all relevant checks ticked off before merging. See the developer's guide for more detail.

  • Documentation has been updated to reflect change.
  • New code has tests, and affected old tests have been updated.
  • All tests and CI checks pass.
  • Ensured the pull request title is descriptive.
  • Conda lock files have been updated if dependencies have changed.
  • Attributed any Generative AI, such as GitHub Copilot, used in this PR.
  • Marked the PR as ready to review.

@jfrost-mo jfrost-mo added the dependencies Pull requests that update a dependency file label Dec 10, 2024
@jfrost-mo jfrost-mo self-assigned this Dec 10, 2024
Copy link
Contributor

github-actions bot commented Dec 10, 2024

Coverage

@jfrost-mo
Copy link
Member Author

jfrost-mo commented Dec 10, 2024

Okay, maybe not. But it worked when I tried it manually?

The difference here is that when resolving manually it went via artifactory, while building from the lock files goes to anaconda.org.

But then how did it work from Firefox.

It works on GitHub Actions resolving from the same lockfiles, so unless GitHub have overwritten the DNS location of anaconda.org, we should be trying the same request.

Other .conda files can be downloaded from anaconda.org, including eccodes releases. Eccodes does seem particularity slow however. I suspect it is exceeding the 60 second timeout.

Theory

Something is funky about the eccodes package on anaconda.org, causing the anaconda.org server to have to do a bunch of work to retrieve it. This work takes longer than 60 seconds, so the HTTP timeout on conda times out, and the package fails to download. Artificatory is not affected as it will have its own backing store.

Actions

  • Try installing with increased timeout (how?)
  • Investigate what is different with eccodes. The CSET package is much faster to start downloading.
  • If we discover something, report upstream to conda-forge.

@jfrost-mo
Copy link
Member Author

Installing with increased timeout

As best as I can tell the timeout is hardcoded. I guess we could hack our conda install just to test? Or see if mamba or pixi give more options.
https://github.com/conda/conda/blob/main/conda/base/context.py#L353

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GRIB support
2 participants