Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[REQUEST]: Sea-Ice Variables (sifb and siitdthick) #41

Open
cjcardinale opened this issue Sep 5, 2023 · 28 comments
Open

[REQUEST]: Sea-Ice Variables (sifb and siitdthick) #41

cjcardinale opened this issue Sep 5, 2023 · 28 comments
Labels
in progress request Requests for new data to be ingested to the cloud

Comments

@cjcardinale
Copy link

List of requested idds

'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r1i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r4i1p1f1.SImon.sifb.gn.v20210607',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r5i1p1f1.SImon.sifb.gn.v20210607',
 'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.SImon.sifb.gn.v20190227',
 'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.SImon.sifb.gn.v20190313',
 'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.SImon.sifb.gn.v20190514',
 'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.SImon.sifb.gn.v20190308',
 'CMIP6.CMIP.THU.CIESM.historical.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.CMIP.CMCC.CMCC-CM2-SR5.historical.r1i1p1f1.SImon.sifb.gn.v20200616',
 'CMIP6.CMIP.CMCC.CMCC-ESM2.historical.r1i1p1f1.SImon.sifb.gn.v20210114',
 'CMIP6.CMIP.CNRM-CERFACS.CNRM-CM6-1-HR.historical.r1i1p1f2.SImon.sifb.gn.v20191021',
 'CMIP6.CMIP.CNRM-CERFACS.CNRM-CM6-1.historical.r1i1p1f2.SImon.sifb.gn.v20180917',
 'CMIP6.CMIP.MOHC.HadGEM3-GC31-LL.historical.r1i1p1f3.SImon.sifb.gn.v20200330',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r14i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r1i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r2i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r3i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r4i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r6i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-HR.historical.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-HR.historical.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.SImon.sifb.gn.v20190815',
 'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r1i1p1f2.SImon.sifb.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r2i1p1f2.SImon.sifb.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r3i1p1f2.SImon.sifb.gn.v20200319',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r4i1p1f2.SImon.sifb.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r8i1p1f2.SImon.sifb.gn.v20200310',

'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r1i1p1f1.SImon.sifb.gn.v20210317',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r4i1p1f1.SImon.sifb.gn.v20210712',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r5i1p1f1.SImon.sifb.gn.v20210802',
 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp126.r1i1p1f1.SImon.sifb.gn.v20210211',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r10i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r11i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r4i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.THU.CIESM.ssp126.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.CMCC.CMCC-CM2-SR5.ssp126.r1i1p1f1.SImon.sifb.gn.v20200717',
 'CMIP6.ScenarioMIP.CMCC.CMCC-ESM2.ssp126.r1i1p1f1.SImon.sifb.gn.v20210126',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1-HR.ssp126.r1i1p1f2.SImon.sifb.gn.v20200127',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1.ssp126.r1i1p1f2.SImon.sifb.gn.v20190219',
 'CMIP6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp126.r1i1p1f3.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r14i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r1i1p1f1.SImon.sifb.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r2i1p1f1.SImon.sifb.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r3i1p1f1.SImon.sifb.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r4i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r6i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp126.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp126.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp126.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp126.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.DWD.MPI-ESM1-2-HR.ssp126.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r1i1p1f1.SImon.sifb.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r2i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r3i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r4i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r5i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp126.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp126.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r1i1p1f2.SImon.sifb.gn.v20200729',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r2i1p1f2.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r3i1p1f2.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r4i1p1f2.SImon.sifb.gn.v20211202',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r8i1p1f2.SImon.sifb.gn.v20200415',

'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r1i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r4i1p1f1.SImon.sifb.gn.v20210712',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r5i1p1f1.SImon.sifb.gn.v20210802',
 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp245.r1i1p1f1.SImon.sifb.gn.v20190815',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r10i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r11i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r4i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.THU.CIESM.ssp245.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.CMCC.CMCC-CM2-SR5.ssp245.r1i1p1f1.SImon.sifb.gn.v20200617',
 'CMIP6.ScenarioMIP.CMCC.CMCC-ESM2.ssp245.r1i1p1f1.SImon.sifb.gn.v20210129',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1-HR.ssp245.r1i1p1f2.SImon.sifb.gn.v20191202',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1.ssp245.r1i1p1f2.SImon.sifb.gn.v20190219',
 'CMIP6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp245.r1i1p1f3.SImon.sifb.gn.v20200330',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r14i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r1i1p1f1.SImon.sifb.gn.v20190119',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r2i1p1f1.SImon.sifb.gn.v20190516',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r3i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r4i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r6i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp245.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp245.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r1i1p1f1.SImon.sifb.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r2i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r3i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r4i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r5i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp245.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp245.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r1i1p1f2.SImon.sifb.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r2i1p1f2.SImon.sifb.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r3i1p1f2.SImon.sifb.gn.v20190507',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r4i1p1f2.SImon.sifb.gn.v20190507',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r8i1p1f2.SImon.sifb.gn.v20190510',

'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r1i1p1f1.SImon.sifb.gn.v20210317',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r4i1p1f1.SImon.sifb.gn.v20210712',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r5i1p1f1.SImon.sifb.gn.v20210802',
 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp585.r1i1p1f1.SImon.sifb.gn.v20200702',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r10i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r11i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r4i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.THU.CIESM.ssp585.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.CMCC.CMCC-CM2-SR5.ssp585.r1i1p1f1.SImon.sifb.gn.v20200622',
 'CMIP6.ScenarioMIP.CMCC.CMCC-ESM2.ssp585.r1i1p1f1.SImon.sifb.gn.v20210126',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1-HR.ssp585.r1i1p1f2.SImon.sifb.gn.v20191202',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1.ssp585.r1i1p1f2.SImon.sifb.gn.v20190219',
 'CMIP6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp585.r1i1p1f3.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r14i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r1i1p1f1.SImon.sifb.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r2i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r3i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r4i1p1f1.SImon.sifb.gn.v20191122',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r6i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp585.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp585.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp585.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp585.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.DWD.MPI-ESM1-2-HR.ssp585.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r1i1p1f1.SImon.sifb.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r2i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r3i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r4i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r5i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp585.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r1i1p1f2.SImon.sifb.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r2i1p1f2.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r3i1p1f2.SImon.sifb.gn.v20190507',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r4i1p1f2.SImon.sifb.gn.v20211201',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r8i1p1f2.SImon.sifb.gn.v20190510',

'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.SImon.siitdthick.gn.v20190514',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r14i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r1i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r2i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r3i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r4i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r6i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.NUIST.NESM3.historical.r1i1p1f1.SImon.siitdthick.gn.v20190713',
 'CMIP6.CMIP.NUIST.NESM3.historical.r2i1p1f1.SImon.siitdthick.gn.v20190713',
 'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r1i1p1f2.SImon.siitdthick.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r2i1p1f2.SImon.siitdthick.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r3i1p1f2.SImon.siitdthick.gn.v20200319',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r4i1p1f2.SImon.siitdthick.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r8i1p1f2.SImon.siitdthick.gn.v20200310',

'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r11i1p1f1.SImon.siitdthick.gn.v20200528',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r14i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r2i1p1f1.SImon.siitdthick.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r3i1p1f1.SImon.siitdthick.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r4i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r6i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r2i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r3i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r4i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r5i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20190730',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp126.r2i1p1f1.SImon.siitdthick.gn.v20190805',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r1i1p1f2.SImon.siitdthick.gn.v20200602',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r2i1p1f2.SImon.siitdthick.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r3i1p1f2.SImon.siitdthick.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r4i1p1f2.SImon.siitdthick.gn.v20211202',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r8i1p1f2.SImon.siitdthick.gn.v20200415',

'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r11i1p1f1.SImon.siitdthick.gn.v20200528',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r14i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20190119',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r2i1p1f1.SImon.siitdthick.gn.v20190516',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r3i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r4i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r6i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r2i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r3i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r4i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r5i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20190804',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp245.r2i1p1f1.SImon.siitdthick.gn.v20190805',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r1i1p1f2.SImon.siitdthick.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r2i1p1f2.SImon.siitdthick.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r3i1p1f2.SImon.siitdthick.gn.v20200721',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r4i1p1f2.SImon.siitdthick.gn.v20200721',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r8i1p1f2.SImon.siitdthick.gn.v20200721',

'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r11i1p1f1.SImon.siitdthick.gn.v20200528',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r14i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r2i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r3i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r4i1p1f1.SImon.siitdthick.gn.v20191122',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r6i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r2i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r3i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r4i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r5i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20190803',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp585.r2i1p1f1.SImon.siitdthick.gn.v20190805',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r1i1p1f2.SImon.siitdthick.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r2i1p1f2.SImon.siitdthick.gn.v20200420',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r3i1p1f2.SImon.siitdthick.gn.v20200721',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r4i1p1f2.SImon.siitdthick.gn.v20211201',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r8i1p1f2.SImon.siitdthick.gn.v20200721',

Description

Hi, I request the addition of two missing sea-ice variables to the cloud.
Thanks!

I request "Sea-Ice Freeboard" (sifb) in the following experiments: historical, ssp126, ssp245, and ssp585. I have reduced the iids to include only the models/members that each experiment shares; however, this is still a pretty long list (68 iids for each experiment). This is the same request from the now archived feedstock repo (pangeo-forge/cmip6-feedstock#24 (comment)); I provided the iids there in expandable lists due to the length, but it appears that a complete list is preferred here. The entire list is copyable, with each experiment and variable separated by a blank line for readability. This data will be used for a NASA-ROSES funded project.

Although lower in priority, I also request "Sea-Ice Thickness in Thickness Categories" (siitdthick) for the same experiments. There are fewer iids per experiment (21), but they are likely larger files. The iids for this variable are found in the last 4 sections of the requested iids list.
@cjcardinale cjcardinale added the request Requests for new data to be ingested to the cloud label Sep 5, 2023
@jbusecke
Copy link
Collaborator

jbusecke commented Sep 6, 2023

Hey @cjcardinale thanks for moving the request. I have actually already added some of the datasets to our pipeline, and you might be able to find some of them in the new catalog. Adding these to the overnight batch now.

@jbusecke
Copy link
Collaborator

jbusecke commented Sep 6, 2023

I am going to run this every 9 hours automatically now, since I see a few more datasets make it each time. This is, I guess, just part of dealing with a large distributed network of HPC centers around the world, which are not always available 😁.
But the automation will hopefully over time take care of most of the ones that are available.

Thanks for the patience here @cjcardinale.

@cjcardinale
Copy link
Author

Thanks so much @jbusecke!

While I am able to search and verify that some datasets are now added to the catalog, I did have some trouble loading into Xarray datasets (I tried the code below on Pangeo's and CryoCloud's JupyterHub). My assumption is that the data could be used as if it were in the main CMIP6 catalog, but I'm getting this permission/Http error. Is the data not public at the moment or is it only available through the LEAP JupyterHub? Or, will it be eventually added to the main catalog? Thanks again!

import intake
col = intake.open_esm_datastore(
    "https://storage.googleapis.com/leap-persistent-ro/data-library/catalogs/cmip6-test/leap-pangeo-cmip6-test.json"
)
cat = col.search(variable_id='sifb', experiment_id='historical',source_id='CESM2')
cat.to_dataset_dict(storage_options={"anon": True})
_request non-retriable exception: Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object. Permission 'storage.objects.get' denied on resource (or it may not exist)., 401
Traceback (most recent call last):
  File "/srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/retry.py", line 122, in retry_request
    return await func(*args, **kwargs)
  File "/srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/core.py", line 430, in _request
    validate_response(status, contents, path, args)
  File "/srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/retry.py", line 111, in validate_response
    raise HttpError({"code": status, "message": msg})  # text-like
gcsfs.retry.HttpError: Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object. Permission 'storage.objects.get' denied on resource (or it may not exist)., 401
Click for full error message 
---------------------------------------------------------------------------
HttpError                                 Traceback (most recent call last)
File /srv/conda/envs/notebook/lib/python3.10/site-packages/intake_esm/source.py:244, in ESMDataSource._open_dataset(self)
    223 datasets = [
    224     _open_dataset(
    225         record[self.path_column_name],
   (...)
    241     for _, record in self.df.iterrows()
    242 ]
--> 244 datasets = dask.compute(*datasets)
    245 if len(datasets) == 1:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/base.py:600, in compute(traverse, optimize_graph, scheduler, get, *args, **kwargs)
    598     postcomputes.append(x.__dask_postcompute__())
--> 600 results = schedule(dsk, keys, **kwargs)
    601 return repack([f(r, *a) for r, (f, a) in zip(results, postcomputes)])

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/threaded.py:89, in get(dsk, keys, cache, num_workers, pool, **kwargs)
     87         pool = MultiprocessingPoolExecutor(pool)
---> 89 results = get_async(
     90     pool.submit,
     91     pool._max_workers,
     92     dsk,
     93     keys,
     94     cache=cache,
     95     get_id=_thread_get_id,
     96     pack_exception=pack_exception,
     97     **kwargs,
     98 )
    100 # Cleanup pools associated to dead threads

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/local.py:511, in get_async(submit, num_workers, dsk, result, cache, get_id, rerun_exceptions_locally, pack_exception, raise_exception, callbacks, dumps, loads, chunksize, **kwargs)
    510     else:
--> 511         raise_exception(exc, tb)
    512 res, worker_id = loads(res_info)

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/local.py:319, in reraise(exc, tb)
    318     raise exc.with_traceback(tb)
--> 319 raise exc

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/local.py:224, in execute_task(key, task_info, dumps, loads, get_id, pack_exception)
    223 task, data = loads(task_info)
--> 224 result = _execute_task(task, data)
    225 id = get_id()

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/core.py:119, in _execute_task(arg, cache, dsk)
    116     # Note: Don't assign the subtask results to a variable. numpy detects
    117     # temporaries by their reference count and can execute certain
    118     # operations in-place.
--> 119     return func(*(_execute_task(a, cache) for a in args))
    120 elif not ishashable(arg):

File /srv/conda/envs/notebook/lib/python3.10/site-packages/dask/utils.py:71, in apply(func, args, kwargs)
     70 if kwargs:
---> 71     return func(*args, **kwargs)
     72 else:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/intake_esm/source.py:77, in _open_dataset(urlpath, varname, xarray_open_kwargs, preprocess, requested_variables, additional_attrs, expand_dims, data_format, storage_options)
     76 else:
---> 77     ds = xr.open_dataset(url, **xarray_open_kwargs)
     78     if preprocess is not None:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/xarray/backends/api.py:570, in open_dataset(filename_or_obj, engine, chunks, cache, decode_cf, mask_and_scale, decode_times, decode_timedelta, use_cftime, concat_characters, decode_coords, drop_variables, inline_array, chunked_array_type, from_array_kwargs, backend_kwargs, **kwargs)
    569 overwrite_encoded_chunks = kwargs.pop("overwrite_encoded_chunks", None)
--> 570 backend_ds = backend.open_dataset(
    571     filename_or_obj,
    572     drop_variables=drop_variables,
    573     **decoders,
    574     **kwargs,
    575 )
    576 ds = _dataset_from_backend_dataset(
    577     backend_ds,
    578     filename_or_obj,
   (...)
    588     **kwargs,
    589 )

File /srv/conda/envs/notebook/lib/python3.10/site-packages/xarray/backends/zarr.py:934, in ZarrBackendEntrypoint.open_dataset(self, filename_or_obj, mask_and_scale, decode_times, concat_characters, decode_coords, drop_variables, use_cftime, decode_timedelta, group, mode, synchronizer, consolidated, chunk_store, storage_options, stacklevel, zarr_version)
    933 filename_or_obj = _normalize_path(filename_or_obj)
--> 934 store = ZarrStore.open_group(
    935     filename_or_obj,
    936     group=group,
    937     mode=mode,
    938     synchronizer=synchronizer,
    939     consolidated=consolidated,
    940     consolidate_on_close=False,
    941     chunk_store=chunk_store,
    942     storage_options=storage_options,
    943     stacklevel=stacklevel + 1,
    944     zarr_version=zarr_version,
    945 )
    947 store_entrypoint = StoreBackendEntrypoint()

File /srv/conda/envs/notebook/lib/python3.10/site-packages/xarray/backends/zarr.py:427, in ZarrStore.open_group(cls, store, mode, synchronizer, group, consolidated, consolidate_on_close, chunk_store, storage_options, append_dim, write_region, safe_chunks, stacklevel, zarr_version)
    426 try:
--> 427     zarr_group = zarr.open_consolidated(store, **open_kwargs)
    428 except KeyError:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/zarr/convenience.py:1299, in open_consolidated(store, metadata_key, mode, **kwargs)
   1298 # setup metadata store
-> 1299 meta_store = ConsolidatedStoreClass(store, metadata_key=metadata_key)
   1301 # pass through

File /srv/conda/envs/notebook/lib/python3.10/site-packages/zarr/storage.py:2890, in ConsolidatedMetadataStore.__init__(self, store, metadata_key)
   2889 # retrieve consolidated metadata
-> 2890 meta = json_loads(self.store[metadata_key])
   2892 # check format of consolidated metadata

File /srv/conda/envs/notebook/lib/python3.10/site-packages/zarr/storage.py:1397, in FSStore.__getitem__(self, key)
   1396 try:
-> 1397     return self.map[key]
   1398 except self.exceptions as e:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/fsspec/mapping.py:143, in __getitem__(self, key, default)
    141     return f"{self._root_key_to_str}{key}"
--> 143 def _str_to_key(self, s):
    144     """Strip path of to leave key name"""

File /srv/conda/envs/notebook/lib/python3.10/site-packages/fsspec/asyn.py:118, in sync_wrapper.<locals>.wrapper(*args, **kwargs)
    117 self = obj or args[0]
--> 118 return sync(self.loop, func, *args, **kwargs)

File /srv/conda/envs/notebook/lib/python3.10/site-packages/fsspec/asyn.py:103, in sync(loop, func, timeout, *args, **kwargs)
    102 elif isinstance(return_result, BaseException):
--> 103     raise return_result
    104 else:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/fsspec/asyn.py:56, in _runner(event, coro, result, timeout)
     55 try:
---> 56     result[0] = await coro
     57 except Exception as ex:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/fsspec/asyn.py:446, in AsyncFileSystem._cat(self, path, recursive, on_error, batch_size, **kwargs)
    445     if ex:
--> 446         raise ex
    447 if (
    448     len(paths) > 1
    449     or isinstance(path, list)
    450     or paths[0] != self._strip_protocol(path)
    451 ):

File /srv/conda/envs/notebook/lib/python3.10/asyncio/tasks.py:408, in wait_for(fut, timeout)
    407 if timeout is None:
--> 408     return await fut
    410 if timeout <= 0:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/core.py:1036, in GCSFileSystem._cat_file(self, path, start, end, **kwargs)
   1035     head = {}
-> 1036 headers, out = await self._call("GET", u2, headers=head)
   1037 return out

File /srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/core.py:437, in GCSFileSystem._call(self, method, path, json_out, info_out, *args, **kwargs)
    436 logger.debug(f"{method.upper()}: {path}, {args}, {kwargs.get('headers')}")
--> 437 status, headers, info, contents = await self._request(
    438     method, path, *args, **kwargs
    439 )
    440 if json_out:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/decorator.py:221, in decorate.<locals>.fun(*args, **kw)
    220     args, kw = fix(args, kw, sig)
--> 221 return await caller(func, *(extras + args), **kw)

File /srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/retry.py:157, in retry_request(func, retries, *args, **kwargs)
    156 logger.exception(f"{func.__name__} non-retriable exception: {e}")
--> 157 raise e

File /srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/retry.py:122, in retry_request(func, retries, *args, **kwargs)
    121         await asyncio.sleep(min(random.random() + 2 ** (retry - 1), 32))
--> 122     return await func(*args, **kwargs)
    123 except (
    124     HttpError,
    125     requests.exceptions.RequestException,
   (...)
    128     aiohttp.client_exceptions.ClientError,
    129 ) as e:

File /srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/core.py:430, in GCSFileSystem._request(self, method, path, headers, json, data, *args, **kwargs)
    428 contents = await r.read()
--> 430 validate_response(status, contents, path, args)
    431 return status, headers, info, contents

File /srv/conda/envs/notebook/lib/python3.10/site-packages/gcsfs/retry.py:111, in validate_response(status, content, path, args)
    110 elif status:
--> 111     raise HttpError({"code": status, "message": msg})  # text-like
    112 else:

HttpError: Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object. Permission &#39;storage.objects.get&#39; denied on resource (or it may not exist)., 401

@jbusecke
Copy link
Collaborator

jbusecke commented Sep 7, 2023

Oh shoot. I did not actually fully test this before. Thanks for reporting. I will take a closer look now.

@cisaacstern
Copy link
Contributor

My guess is that this is because publicly accessible data on GCS sometimes (always?) requires that some user is logged in via the gcloud CLI or GOOGLE_APPLICATION_CREDENTIALS env var. This user will not have to pay for data (if it's public) but needs to be identified. I'm not sure if there's a way to setup the bucket so that's not required.

@jbusecke
Copy link
Collaborator

jbusecke commented Sep 7, 2023

@cjcardinale this is definitely not what we intend to provide and I have escalated this to 2i2c. Will update you on the progress. Sorry for the roadblock here.

@jbusecke
Copy link
Collaborator

jbusecke commented Oct 6, 2023

@cjcardinale could you test this again? I think this should work now.

@cjcardinale
Copy link
Author

@jbusecke I am still getting the same error message:
Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object

@yuvipanda
Copy link
Contributor

@cjcardinale can you try now?

@cjcardinale
Copy link
Author

@yuvipanda @jbusecke It is working now! No more error messages when using to_dataset_dict. Thanks!

@yuvipanda
Copy link
Contributor

Thanks for confirming, @cjcardinale

@jbusecke
Copy link
Collaborator

A warning here @cjcardinale . We had to shut down the public bucket over at LEAP temporarily, so you will probably run into the same issue here. I am on a 1 week sprint right now, and hopefully at the end of the week we will be able to move the newly ingested data to the 'official' public bucket where all the data is accessible via anonymous calls. Thanks for your patience here.

@jbusecke
Copy link
Collaborator

Dear @cjcardinale, at long last we have now moved everything entirely to a public bucket! If you would be willing to check the data as part of our beta test I would be very grateful. Thank you for hanging in here with us while we ironed out the kinks.

@cjcardinale
Copy link
Author

Thanks, @jbusecke!!! I am happy to be a part of the beta test. Also happy to report that I can access and load the data from the public bucket(!)—with or without storage_options={"anon": True} when using intake's to_dataset_dict function.

A couple of minor notes (in case they are of interest to you):

  • The catalog includes both 'variant_label' and 'member_id' indexes, and 'variant_label' is the default dimension when data is loaded into xarray datasets ('member_id' is the default when using the legacy catalog. The dimension can be easily renamed after loading, but I thought I'd mention it.
  • Although I can access the data without issue, I do get some warning messages the first time I use .to_dataset_dict() in a notebook:
WARNING:google.auth._default:Authentication failed using Compute Engine authentication due to unavailable metadata server.

WARNING:google.auth.compute_engine._metadata:Compute Engine Metadata server unavailable on attempt 1 of 5. 
Reason: HTTPConnectionPool(host='metadata.google.internal', port=80): Max retries exceeded with url: /computeMetadata/v1/instance/service-accounts/default/?recursive=true 
(Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f36cf7c3520>: Failed to establish a new connection: [Errno -2] Name or service not known'))

@jbusecke
Copy link
Collaborator

Thanks for providing feedback here. That is very valuable. The changing of member_id/variant_label was actually deliberate to follow the ESGF conventions more strictly, but it is not docuemented yet. I will do that right now.

Although I can access the data without issue, I do get some warning messages the first time I use .to_dataset_dict() in a notebook:

Now this one is new to me. Ill open a separate issue and see if this persists or is just a temporary issue.

@jbusecke
Copy link
Collaborator

Do you have the exact code to reproduce the warnign? Then I can test it on my end too.

@jbusecke
Copy link
Collaborator

Added documentation in #92. Is that explanation clear enough in your opinion?

@jbusecke
Copy link
Collaborator

Thanks, @jbusecke!!! I am happy to be a part of the beta test. Also happy to report that I can access and load the data from the public bucket(!)—with or without storage_options={"anon": True} when using intake's to_dataset_dict function.

Also this makes me soooo happy right now! 🚀🎉

@cjcardinale
Copy link
Author

Added documentation in #92. Is that explanation clear enough in your opinion?

Yes, I think this is a very helpful and clear explanation.

@cjcardinale
Copy link
Author

Do you have the exact code to reproduce the warnign? Then I can test it on my end too.

After checking again today, the warnings have stopped appearing. Maybe it was fixed by some updates on the hub I'm working on. Yesterday, I was getting those warning messages the first time I accessed data with the following code:

cat_url = "https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog.json"
col = intake.open_esm_datastore(cat_url)
cat = col.search(variable_id='sifb',source_id='ACCESS-CM2',experiment_id='historical')
ddict = cat.to_dataset_dict()
list(ddict.values())[0]

@jbusecke
Copy link
Collaborator

It had the smell of something temporary. Let me know if that appears again and I will test it over here.

@jbusecke
Copy link
Collaborator

Just checking in here. I just added some instructions on how to check progress. Running those I am getting:

Found in catalog='qc': iids=['CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.SImon.siitdthick.gn.v20191108', 'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.SImon.siitdthick.gn.v20191108']

Found in catalog='non-qc': iids=['CMIP6.ScenarioMIP.THU.CIESM.ssp585.r1i1p1f1.SImon.sifb.gn.v20200420', 'CMIP6.ScenarioMIP.THU.CIESM.ssp126.r1i1p1f1.SImon.sifb.gn.v20200420', 'CMIP6.ScenarioMIP.THU.CIESM.ssp245.r1i1p1f1.SImon.sifb.gn.v20200420', 'CMIP6.CMIP.THU.CIESM.historical.r1i1p1f1.SImon.sifb.gn.v20200420']

Found in catalog='retracted': iids=[]



Still missing 350 of 356:
...

After hunting down some bugs I have reenabled ingestion for these, and we should keep an eye out if things improve in the next days. If not Ill spend some time to identify what is broken here. Thanks for the patience.

@jbusecke
Copy link
Collaborator

jbusecke commented Apr 3, 2024

Hi @cjcardinale just a headsup that I have broadened the ingestion criteria beyond the specific iids that you posted above (see here I am basically asking for any model/member that was run for the experiments you are interested in and has the variables you specified).

I have seen some datasets successfully ingested (for example: CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r8i1p1f1.SImon.sifb.gn.v20231017). Just in case that member is useful, wanted to let you know.

@cjcardinale
Copy link
Author

Thanks @jbusecke! Very cool to have that progress check and I appreciate you broadening the ingestion criteria and making sure that all datasets get ingested!

I noticed that the progress check code does not work correctly for most zstores that start with gs://cmip6/CMIP6_LEAP_legacy/. For example, the correct iid will be extracted from 'gs://cmip6/CMIP6_LEAP_legacy/CMIP6...', but not for 'gs://cmip6/CMIP6_LEAP_legacy/a618127503-6108923902-1/CMIP6...'. For my case, I adapted the zstore_to_iid function to:

import intake
def zstore_to_iid(zstore: str):
    # this is a bit whacky to account for the different way of storing old/new stores
    iid =  '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-11:-1])
    if not iid.startswith('CMIP6'):
        iid =  '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-10:])
    return iid

This gives me: Still missing 127 of 356:

@jbusecke
Copy link
Collaborator

Oh nice catch! Ill update the README accordingly! And thats nice progress!

jbusecke added a commit that referenced this issue Apr 10, 2024
@jbusecke
Fix progress check code snippet
80eaeeb 
Thanks to @cjcardinale for [catching a bug](#41 (comment)) in this logic.
@jbusecke jbusecke mentioned this issue Apr 10, 2024
Merged
jbusecke added a commit that referenced this issue Apr 10, 2024
@jbusecke
Fix progress check code snippet (#125)
c4d4978 
* Fix progress check code snippet

Thanks to @cjcardinale for [catching a bug](#41 (comment)) in this logic.

* Update README.md
@jbusecke
Copy link
Collaborator

jbusecke commented May 8, 2024

Down to 54 last I checked!

@jbusecke
Copy link
Collaborator

Down to 8!


Still missing 8 of 356: 
missing_iids=['CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r2i1p1f1.SImon.sifb.gr.v20200130', 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r3i1p1f1.SImon.sifb.gr.v20200130', 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.sifb.gn.v20191108', 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp126.r1i1p1f1.SImon.sifb.gn.v20210211', 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r1i1p1f1.SImon.sifb.gr.v20200130', 'CMIP6.CMIP.CNRM-CERFACS.CNRM-CM6-1-HR.historical.r1i1p1f2.SImon.sifb.gn.v20191021', 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20191108', 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r2i1p1f1.SImon.sifb.gr.v20200130']

There are a bunch of ones that landed in the retracted catalog over time (check the below snippet to reproduce the exact iids).

@cjcardinale it might be worth checking two things:

import intake

def zstore_to_iid(zstore: str):
    # this is a bit whacky to account for the different way of storing old/new stores
    iid =  '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-11:-1])
    if not iid.startswith('CMIP6'):
        iid =  '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-10:])
    return iid

def search_iids(col_url:str):
    col = intake.open_esm_datastore(col_url)
    iids_all= [zstore_to_iid(z) for z in col.df['zstore'].tolist()]
    return [iid for iid in iids_all if iid in iids_requested]


iids_requested = [
'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r1i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r4i1p1f1.SImon.sifb.gn.v20210607',
 'CMIP6.CMIP.CSIRO-ARCCSS.ACCESS-CM2.historical.r5i1p1f1.SImon.sifb.gn.v20210607',
 'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.SImon.sifb.gn.v20190227',
 'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.SImon.sifb.gn.v20190313',
 'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.SImon.sifb.gn.v20190514',
 'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.SImon.sifb.gn.v20190308',
 'CMIP6.CMIP.THU.CIESM.historical.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.CMIP.CMCC.CMCC-CM2-SR5.historical.r1i1p1f1.SImon.sifb.gn.v20200616',
 'CMIP6.CMIP.CMCC.CMCC-ESM2.historical.r1i1p1f1.SImon.sifb.gn.v20210114',
 'CMIP6.CMIP.CNRM-CERFACS.CNRM-CM6-1-HR.historical.r1i1p1f2.SImon.sifb.gn.v20191021',
 'CMIP6.CMIP.CNRM-CERFACS.CNRM-CM6-1.historical.r1i1p1f2.SImon.sifb.gn.v20180917',
 'CMIP6.CMIP.MOHC.HadGEM3-GC31-LL.historical.r1i1p1f3.SImon.sifb.gn.v20200330',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r14i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r1i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r2i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r3i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r4i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r6i1p1f1.SImon.sifb.gn.v20180803',
 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-HR.historical.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-HR.historical.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MPI-M.MPI-ESM1-2-LR.historical.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.SImon.sifb.gn.v20210311',
 'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.SImon.sifb.gn.v20190815',
 'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r1i1p1f2.SImon.sifb.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r2i1p1f2.SImon.sifb.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r3i1p1f2.SImon.sifb.gn.v20200319',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r4i1p1f2.SImon.sifb.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r8i1p1f2.SImon.sifb.gn.v20200310',

'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r1i1p1f1.SImon.sifb.gn.v20210317',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r4i1p1f1.SImon.sifb.gn.v20210712',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp126.r5i1p1f1.SImon.sifb.gn.v20210802',
 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp126.r1i1p1f1.SImon.sifb.gn.v20210211',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r10i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r11i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r4i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.THU.CIESM.ssp126.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.CMCC.CMCC-CM2-SR5.ssp126.r1i1p1f1.SImon.sifb.gn.v20200717',
 'CMIP6.ScenarioMIP.CMCC.CMCC-ESM2.ssp126.r1i1p1f1.SImon.sifb.gn.v20210126',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1-HR.ssp126.r1i1p1f2.SImon.sifb.gn.v20200127',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1.ssp126.r1i1p1f2.SImon.sifb.gn.v20190219',
 'CMIP6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp126.r1i1p1f3.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r14i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r1i1p1f1.SImon.sifb.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r2i1p1f1.SImon.sifb.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r3i1p1f1.SImon.sifb.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r4i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r6i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp126.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp126.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp126.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp126.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.DWD.MPI-ESM1-2-HR.ssp126.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp126.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r1i1p1f1.SImon.sifb.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r2i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r3i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r4i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r5i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp126.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp126.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r1i1p1f2.SImon.sifb.gn.v20200729',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r2i1p1f2.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r3i1p1f2.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r4i1p1f2.SImon.sifb.gn.v20211202',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r8i1p1f2.SImon.sifb.gn.v20200415',

'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r1i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r4i1p1f1.SImon.sifb.gn.v20210712',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp245.r5i1p1f1.SImon.sifb.gn.v20210802',
 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp245.r1i1p1f1.SImon.sifb.gn.v20190815',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r10i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r11i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r4i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.THU.CIESM.ssp245.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.CMCC.CMCC-CM2-SR5.ssp245.r1i1p1f1.SImon.sifb.gn.v20200617',
 'CMIP6.ScenarioMIP.CMCC.CMCC-ESM2.ssp245.r1i1p1f1.SImon.sifb.gn.v20210129',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1-HR.ssp245.r1i1p1f2.SImon.sifb.gn.v20191202',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1.ssp245.r1i1p1f2.SImon.sifb.gn.v20190219',
 'CMIP6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp245.r1i1p1f3.SImon.sifb.gn.v20200330',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r14i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r1i1p1f1.SImon.sifb.gn.v20190119',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r2i1p1f1.SImon.sifb.gn.v20190516',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r3i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r4i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r6i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp245.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp245.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp245.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp245.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r1i1p1f1.SImon.sifb.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r2i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r3i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r4i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r5i1p1f1.SImon.sifb.gn.v20210830',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp245.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp245.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r1i1p1f2.SImon.sifb.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r2i1p1f2.SImon.sifb.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r3i1p1f2.SImon.sifb.gn.v20190507',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r4i1p1f2.SImon.sifb.gn.v20190507',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r8i1p1f2.SImon.sifb.gn.v20190510',

'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r1i1p1f1.SImon.sifb.gn.v20210317',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r2i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r3i1p1f1.SImon.sifb.gn.v20200817',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r4i1p1f1.SImon.sifb.gn.v20210712',
 'CMIP6.ScenarioMIP.CSIRO-ARCCSS.ACCESS-CM2.ssp585.r5i1p1f1.SImon.sifb.gn.v20210802',
 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp585.r1i1p1f1.SImon.sifb.gn.v20200702',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r10i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r11i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r4i1p1f1.SImon.sifb.gn.v20200528',
 'CMIP6.ScenarioMIP.THU.CIESM.ssp585.r1i1p1f1.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.CMCC.CMCC-CM2-SR5.ssp585.r1i1p1f1.SImon.sifb.gn.v20200622',
 'CMIP6.ScenarioMIP.CMCC.CMCC-ESM2.ssp585.r1i1p1f1.SImon.sifb.gn.v20210126',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1-HR.ssp585.r1i1p1f2.SImon.sifb.gn.v20191202',
 'CMIP6.ScenarioMIP.CNRM-CERFACS.CNRM-CM6-1.ssp585.r1i1p1f2.SImon.sifb.gn.v20190219',
 'CMIP6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp585.r1i1p1f3.SImon.sifb.gn.v20200310',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r14i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r1i1p1f1.SImon.sifb.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r2i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r3i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r4i1p1f1.SImon.sifb.gn.v20191122',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r6i1p1f1.SImon.sifb.gn.v20191121',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp585.r1i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp585.r2i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.NIMS-KMA.KACE-1-0-G.ssp585.r3i1p1f1.SImon.sifb.gr.v20200130',
 'CMIP6.ScenarioMIP.DKRZ.MPI-ESM1-2-HR.ssp585.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.DWD.MPI-ESM1-2-HR.ssp585.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r10i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r11i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r12i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r13i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r14i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r15i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r16i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r17i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r18i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r19i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r1i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r20i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r21i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r22i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r23i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r24i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r25i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r26i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r27i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r28i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r29i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r2i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r30i1p1f1.SImon.sifb.gn.v20210901',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r3i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r4i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r5i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r6i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r7i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r8i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MPI-M.MPI-ESM1-2-LR.ssp585.r9i1p1f1.SImon.sifb.gn.v20190710',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r1i1p1f1.SImon.sifb.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r2i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r3i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r4i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r5i1p1f1.SImon.sifb.gn.v20210910',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp585.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.sifb.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r1i1p1f2.SImon.sifb.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r2i1p1f2.SImon.sifb.gn.v20200420',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r3i1p1f2.SImon.sifb.gn.v20190507',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r4i1p1f2.SImon.sifb.gn.v20211201',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r8i1p1f2.SImon.sifb.gn.v20190510',

'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.SImon.siitdthick.gn.v20190514',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r14i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r1i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r2i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r3i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r4i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.IPSL.IPSL-CM6A-LR.historical.r6i1p1f1.SImon.siitdthick.gn.v20180803',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.SImon.siitdthick.gn.v20210311',
 'CMIP6.CMIP.NUIST.NESM3.historical.r1i1p1f1.SImon.siitdthick.gn.v20190713',
 'CMIP6.CMIP.NUIST.NESM3.historical.r2i1p1f1.SImon.siitdthick.gn.v20190713',
 'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r1i1p1f2.SImon.siitdthick.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r2i1p1f2.SImon.siitdthick.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r3i1p1f2.SImon.siitdthick.gn.v20200319',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r4i1p1f2.SImon.siitdthick.gn.v20200309',
 'CMIP6.CMIP.MOHC.UKESM1-0-LL.historical.r8i1p1f2.SImon.siitdthick.gn.v20200310',

'CMIP6.ScenarioMIP.NCAR.CESM2.ssp126.r11i1p1f1.SImon.siitdthick.gn.v20200528',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r14i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r2i1p1f1.SImon.siitdthick.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r3i1p1f1.SImon.siitdthick.gn.v20190410',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r4i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp126.r6i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r2i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r3i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r4i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp126.r5i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20190730',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp126.r2i1p1f1.SImon.siitdthick.gn.v20190805',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp126.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r1i1p1f2.SImon.siitdthick.gn.v20200602',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r2i1p1f2.SImon.siitdthick.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r3i1p1f2.SImon.siitdthick.gn.v20200310',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r4i1p1f2.SImon.siitdthick.gn.v20211202',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp126.r8i1p1f2.SImon.siitdthick.gn.v20200415',

'CMIP6.ScenarioMIP.NCAR.CESM2.ssp245.r11i1p1f1.SImon.siitdthick.gn.v20200528',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r14i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20190119',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r2i1p1f1.SImon.siitdthick.gn.v20190516',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r3i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r4i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp245.r6i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r2i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r3i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r4i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp245.r5i1p1f1.SImon.siitdthick.gn.v20210830',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20190804',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp245.r2i1p1f1.SImon.siitdthick.gn.v20190805',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp245.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r1i1p1f2.SImon.siitdthick.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r2i1p1f2.SImon.siitdthick.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r3i1p1f2.SImon.siitdthick.gn.v20200721',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r4i1p1f2.SImon.siitdthick.gn.v20200721',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp245.r8i1p1f2.SImon.siitdthick.gn.v20200721',

'CMIP6.ScenarioMIP.NCAR.CESM2.ssp585.r11i1p1f1.SImon.siitdthick.gn.v20200528',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r14i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20190903',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r2i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r3i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r4i1p1f1.SImon.siitdthick.gn.v20191122',
 'CMIP6.ScenarioMIP.IPSL.IPSL-CM6A-LR.ssp585.r6i1p1f1.SImon.siitdthick.gn.v20191121',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20210329',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r2i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r3i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r4i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.MRI.MRI-ESM2-0.ssp585.r5i1p1f1.SImon.siitdthick.gn.v20210910',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20190803',
 'CMIP6.ScenarioMIP.NUIST.NESM3.ssp585.r2i1p1f1.SImon.siitdthick.gn.v20190805',
 'CMIP6.ScenarioMIP.NCC.NorESM2-LM.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20191108',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r1i1p1f2.SImon.siitdthick.gn.v20200415',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r2i1p1f2.SImon.siitdthick.gn.v20200420',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r3i1p1f2.SImon.siitdthick.gn.v20200721',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r4i1p1f2.SImon.siitdthick.gn.v20211201',
 'CMIP6.ScenarioMIP.MOHC.UKESM1-0-LL.ssp585.r8i1p1f2.SImon.siitdthick.gn.v20200721',
]

url_dict = {
    'qc':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog.json",
    'non-qc':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog_noqc.json",
    'retracted':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog_retracted.json"
}

iids_found = []
for catalog,url in url_dict.items():
    iids = search_iids(url)
    iids_found.extend(iids)
    print(f"Found in {catalog=}: {iids=}\n")

missing_iids = list(set(iids_requested) - set(iids_found))
print(f"\n\nStill missing {len(missing_iids)} of {len(iids_requested)}: \n{missing_iids=}")

@jbusecke
Copy link
Collaborator

Down to 6:

Still missing 6 of 356: 
missing_iids=['CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r2i1p1f1.SImon.sifb.gr.v20200130', 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.sifb.gn.v20191108', 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r3i1p1f1.SImon.sifb.gr.v20200130', 'CMIP6.CMIP.NIMS-KMA.KACE-1-0-G.historical.r1i1p1f1.SImon.sifb.gr.v20200130', 'CMIP6.ScenarioMIP.NCAR.CESM2-WACCM.ssp126.r1i1p1f1.SImon.sifb.gn.v20210211', 'CMIP6.ScenarioMIP.NCC.NorESM2-MM.ssp585.r1i1p1f1.SImon.siitdthick.gn.v20191108']

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
in progress request Requests for new data to be ingested to the cloud
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@yuvipanda @jbusecke @cjcardinale @cisaacstern