Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Datasets whose temporal coverage differs between nodes are not fully ingested #53

Open
Timh37 opened this issue Sep 21, 2023 · 2 comments
Open

Datasets whose temporal coverage differs between nodes are not fully ingested #53

Timh37 opened this issue Sep 21, 2023 · 2 comments

Comments

@Timh37
Copy link

Timh37 commented Sep 21, 2023 •
edited
Loading

@jbusecke For some iid's, different parts of simulations are available on different nodes. See screenshot for iid CMIP6.ScenarioMIP.CSIRO.ACCESS-ESM1-5.ssp585.r9i1p1f1.day.psl.gn below, for example. Currently included in https://storage.googleapis.com/leap-persistent-ro/data-library/catalogs/cmip6-test/leap-pangeo-cmip6-test.json is the dataset from esgf-data1.llnl.gov for 2200-2300, instead of the data from esgf.nci.org.auz for 2015-2300.

image
@Timh37 Timh37 changed the title Datasets whose temporal coverage differs between nodes not fully included Datasets whose temporal coverage differs between nodes are not fully included Sep 21, 2023
@Timh37 Timh37 changed the title Datasets whose temporal coverage differs between nodes are not fully included Datasets whose temporal coverage differs between nodes are not fully ingested Sep 21, 2023
@jbusecke
Copy link
Collaborator

Thanks for reporting this @Timh37. I will have to dig deeper into the ESGF api to see what is going on here. Quite frustrating, apologies.

@Timh37 Timh37 mentioned this issue Sep 28, 2023
Closed
@jbusecke
Copy link
Collaborator

jbusecke commented May 8, 2024

See jbusecke/pangeo-forge-esgf#46

This was referenced May 8, 2024
Open
Open
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jbusecke @Timh37