-
Notifications
You must be signed in to change notification settings - Fork 3
Home
Christian Lessig edited this page Feb 10, 2025
·
2 revisions
The WeatherGenerator project aims to develop a machine learning-based Earth system model. More information about the project can be found at https://weathergenerator.eu. The project is funded by a European Union HORIZON grant but open to outside contributions. See the contributing guide for more information.
This wiki will be used to document the model development (in particular conceptual aspects that span multiple issues) and document project progress.
# Make sure you have a recent version of gcc in your environment
# Make sure your python includes cpython
install uv
[What I do:
Download: wget [https://github.com/astral-sh/uv/releases/download/0.5.28/uv-x86_64-unknown-linux-gnu.tar.gz](https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fastral-sh%2Fuv%2Freleases%2Fdownload%2F0.5.28%2Fuv-x86_64-unknown-linux-gnu.tar.gz&data=05%7C02%7Cchristian.lessig%40ecmwf.int%7Cb0af5294966c4057c87608dd478d2336%7C21b711c6aab74d369ffbac0357bc20ba%7C1%7C0%7C638745393968398524%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=ZEWi7gDAY4ivJ46vDcIbLOUTyfIWlrzT%2BGaM30PtuBg%3D&reserved=0) ~/.uv
%~/.uv>tar xvzf [uv-x86_64-unknown-linux-gnu.tar.gz](https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fastral-sh%2Fuv%2Freleases%2Fdownload%2F0.5.28%2Fuv-x86_64-unknown-linux-gnu.tar.gz&data=05%7C02%7Cchristian.lessig%40ecmwf.int%7Cb0af5294966c4057c87608dd478d2336%7C21b711c6aab74d369ffbac0357bc20ba%7C1%7C0%7C638745393968419803%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=LEvUvPCIdUDs26H%2FhPFgQP7AWbZnn15vEKczKyzxGO0%3D&reserved=0)
%~/.uv>ln -s uv-x86_64-unknown-linux-gnu/uv uv
%~/.uv>ln -s uv-x86_64-unknown-linux-gnu/uvx uvx
#Add to ~/.bashrc
export PATH=~/.uv:$PATH
]
# git clone / fork WeatherGenerator repo
%>cd WeatherGenerator
%>uv sync
# install flash_attn which is not uv compatible
%>uv pip install torch
%>uv pip install flash_attn --no-build-isolation
%>uv run train