Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update requirements #5

Open
wants to merge 11 commits into
base: main
Choose a base branch
from

Conversation

jroettenbacher
Copy link
Contributor

@jroettenbacher jroettenbacher commented Dec 12, 2024

Hi all,
while doing some work on the project I noticed that the requirements are rather old. They are not compatible with python 3.12 anymore and so I started to update them bit by bit and resolved errors along the way.

Due to the update of jupyter-book I needed to update some cross references.

We could also think about moving from sphinx as a built engine to MyST as jupyter book will be moving to MyST with version 2 of jupyter book. See: https://executablebooks.org/en/latest/blog/2024-05-20-jupyter-book-myst/
The biggest downside I can see is that the nice sphinx theme of the book is not available as of now.

ToDos:

  • alabama.ipynb: TypeError: read_csv() got an unexpected keyword argument 'csv_kwargs'
  • co_co2_h2o.ipynb: TypeError: read_csv() got an unexpected keyword argument 'csv_kwargs'
  • cvi.ipynb: TypeError: read_csv() got an unexpected keyword argument 'csv_kwargs'
  • polar/dropsondes.ipynb: ClientResponseError: 503, message='Service Unavailable', url='https://hs.pangaea.de/Projects/AC3/ACLOUD_dropsondes/DS_ACLOUD_Flight_21_20170620_V2.nc'
  • eagle.ipynb: FSTimeoutError: -> probably caused by the large file size (28GB) -> maybe use a smaller file for the example
  • fish_eye_camera.ipynb: FSTimeoutError: -> probably a file size problem
  • haw.ipynb: FSTimeoutError: -> probably a file size problem
  • nose_boom.ipynb: TypeError: read_csv() got an unexpected keyword argument 'csv_kwargs'
  • opc.ipynb: TypeError: read_csv() got an unexpected keyword argument 'csv_kwargs'
  • amsr2_seaice.ipynb: FileNotFoundError: https://atmos.meteo.uni-koeln.de/ac3/HALO-AC3/auxiliary/amsr2_seaice/daily_grid/asi-AMSR2-n6250-20220208-v5.4.nc
  • polarstern_overflights.ipynb: TypeError: read_csv() got an unexpected keyword argument 'csv_kwargs'

Best Johannes

The HAMP dataset is now available as a unified dataset. The notebooks have been adapted already. However, the table of contents does not reflect this change.
This commit fixes this.
- Matplotlib causes errors on install with the pinned version. Allowing a higher version than needs numpy at a higher version as well.
- simplification causes errors in the current pinned version. A newer version doesn't.
- jupyter-book and jupyter-text also cause errors with the pinned versions
ac3airborne and dotenv added to the requirements
include dask[dataframe]
… fixes

Removed the AC3 cloud credentials from each notebook and some grammar fixes

- updated simplification package requirement
- simplification requires numpy 1.24.4
@jroettenbacher jroettenbacher changed the title Update Halo HAMP dataset and update requirements Update requirements Dec 16, 2024
@jroettenbacher
Copy link
Contributor Author

This PR is work in progress and not ready to be merged

Johannes Röttenbacher and others added 4 commits December 16, 2024 09:59
There is currently an error when trying to set the intake local cache via an environment variable (see [Github Issue](intake/intake#855)).
This block ensures that there is a valid local storage set, even when not environment variable is set.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant