From 4f8930981564a57f38d69cd21069cad579182439 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E2=80=9Cgspetro-NOAA=E2=80=9D?= Date: Wed, 6 Dec 2023 14:43:10 -0500 Subject: [PATCH] update container ch, RSK changes, other misc --- .../BackgroundInfo/TechnicalOverview.rst | 2 ++ .../BuildingRunningTesting/Container.rst | 34 +++++++------------ .../BuildingRunningTesting/TestingLandDA.rst | 4 +-- docs/source/CustomizingTheWorkflow/Model.rst | 2 +- 4 files changed, 17 insertions(+), 25 deletions(-) diff --git a/docs/source/BackgroundInfo/TechnicalOverview.rst b/docs/source/BackgroundInfo/TechnicalOverview.rst index 1751c86f..ca1b9a3b 100644 --- a/docs/source/BackgroundInfo/TechnicalOverview.rst +++ b/docs/source/BackgroundInfo/TechnicalOverview.rst @@ -141,6 +141,8 @@ the UFS Land DA System. | | Community Physics Package (CCPP) | | | | | | +--------------------------+-----------------------------------------+------------------------------------------------------+ + | land-vector2tile | Contains code to map between the vector | https://github.com/NOAA-PSL/land-vector2tile | + +--------------------------+-----------------------------------------+------------------------------------------------------+ The UFS Land Component ========================= diff --git a/docs/source/BuildingRunningTesting/Container.rst b/docs/source/BuildingRunningTesting/Container.rst index 83448731..5875719b 100644 --- a/docs/source/BuildingRunningTesting/Container.rst +++ b/docs/source/BuildingRunningTesting/Container.rst @@ -36,7 +36,7 @@ Install Singularity/Apptainer To build and run Land DA using a Singularity/Apptainer container, first install the software according to the `Apptainer Installation Guide `__. This will include the installation of all dependencies. -.. note:: +.. attention:: Docker containers can only be run with root privileges, and users generally do not have root privileges on :term:`HPCs `. However, a Singularity image may be built directly from a Docker image for use on the system. .. _DownloadContainer: @@ -85,20 +85,16 @@ Set a top-level directory location for Land DA work, and navigate to it. For exa cd /path/to/landda export LANDDAROOT=`pwd` -where ``/path/to/landda`` is the path to this top-level directory (e.g., ``/Users/Joe.Schmoe/landda``). The second line will create the directory if it does not exist yet. +where ``/path/to/landda`` is the path to this top-level directory (e.g., ``/Users/Joe.Schmoe/landda``). .. hint:: - If a ``singularity: command not found`` error message appears in any of the following steps, try running: ``module load singularity``. + If a ``singularity: command not found`` error message appears in any of the following steps, try running: ``module load singularity`` or (on Derecho) ``module load apptainer``. NOAA RDHPCS Systems ---------------------- On many NOAA :term:`RDHPCS` systems, a container named ``ubuntu20.04-intel-landda-release-public-v1.2.0.img`` has already been built, and users may access the container at the locations in :numref:`Table %s `. -.. note:: - - The |latestr| release container is named - .. _PreBuiltContainers: .. table:: Locations of Pre-Built Containers @@ -106,19 +102,17 @@ On many NOAA :term:`RDHPCS` systems, a container named ``ubuntu20.04-intel-landd +--------------+--------------------------------------------------------+ | Machine | File location | +==============+========================================================+ - | Derecho | /glade/scratch/epicufsrt/containers | + | Derecho | /glade/work/epicufsrt/contrib/containers | +--------------+--------------------------------------------------------+ - | Gaea | | + | Gaea | /lustre/f2/dev/role.epic/contrib/containers | +--------------+--------------------------------------------------------+ | Hera | /scratch1/NCEPDEV/nems/role.epic/containers | +--------------+--------------------------------------------------------+ | Jet | /mnt/lfs4/HFIP/hfv3gfs/role.epic/containers | +--------------+--------------------------------------------------------+ - | Orion | /work/noaa/epic/role-epic-ps/containers | + | Orion | /work/noaa/epic/role-epic/contrib/containers | +--------------+--------------------------------------------------------+ -.. COMMENT: Update! - Users can simply set an environment variable to point to the container: .. code-block:: console @@ -131,8 +125,6 @@ If users prefer, they may copy the container to their local working directory. F cp /mnt/lfs4/HFIP/hfv3gfs/role.epic/containers/ubuntu20.04-intel-landda-release-public-v1.2.0.img . -.. COMMENT: Check that dev container will be on Jet... - Other Systems ---------------- @@ -144,15 +136,11 @@ To download from the data bucket, users can run: wget https://noaa-ufs-land-da-pds.s3.amazonaws.com/current_land_da_release_data/v1.2.0/ubuntu20.04-intel-landda-release-public-v1.2.0.img -.. COMMENT: Update path! - To build the container from a Docker image, users can run: .. code-block:: console - singularity build --force ubuntu20.04-intel-landda-release-public-v1.2.0.img docker://noaaepic/ubuntu20.04-intel-landda:develop - -.. COMMENT: Check/fix pull command to reflect v1.2.0 instead of develop! + singularity build --force ubuntu20.04-intel-landda-release-public-v1.2.0.img docker://noaaepic/ubuntu20.04-intel-landda:release-public-v1.2.0 This process may take several hours depending on the system. @@ -165,7 +153,7 @@ This process may take several hours depending on the system. Get Data *********** -In order to run the Land DA System, users will need input data in the form of fix files, model forcing files, restart files, and observations for data assimilation. These files are already present on NOAA RDHPCS systems (see :numref:`Section %s ` for details). +In order to run the Land DA System, users will need input data in the form of fix files, model forcing files, restart files, and observations for data assimilation. These files are already present on Level 1 systems (see :numref:`Section %s ` for details). Users on any system may download and untar the data from the `Land DA Data Bucket `__ into their ``$LANDDAROOT`` directory. @@ -178,7 +166,9 @@ If users choose to add data in a location other than ``$LANDDAROOT``, they can l .. code-block:: console - ln -fs /path/to/inputs + ln -fs /path/to/input/data + +where ``/path/to/input/data`` is replaced by the absolute path to the location of their Land DA input data. .. _RunContainer: @@ -210,7 +200,7 @@ Set the ``USE_SINGULARITY`` environment variable to "yes". This variable tells the workflow to use the containerized version of all the executables (including python) when running a cycle. -Users may convert a container ``.img`` file to a writable sandbox. This step is required when running on Cheyenne but is optional on most other systems: +Users may convert a container ``.img`` file to a writable sandbox. This step is optional on most systems: .. code-block:: console diff --git a/docs/source/BuildingRunningTesting/TestingLandDA.rst b/docs/source/BuildingRunningTesting/TestingLandDA.rst index b4031d50..a4fa8a23 100644 --- a/docs/source/BuildingRunningTesting/TestingLandDA.rst +++ b/docs/source/BuildingRunningTesting/TestingLandDA.rst @@ -8,7 +8,7 @@ This chapter provides instructions for using the Land DA CTest suite. These step .. attention:: - This chapter assumes that the user has already built the Land DA System according to the instructions in :numref:`Section %s ` and has access to the data provided in the most recent release. (See :numref:`Table %s ` for the locations of pre-staged data on NOAA :term:`RDHPCS` (i.e., Hera and Orion).) + This chapter assumes that the user has already built the Land DA System according to the instructions in :numref:`Section %s ` and has access to the data provided in the most recent release. (See :numref:`Table %s ` for the locations of pre-staged data on NOAA :term:`RDHPCS` [i.e., Hera and Orion].) Process ********* @@ -28,7 +28,7 @@ This will allocate a compute node, load the appropriate modulefiles, and run the Tests ******* -The ERA5 CTests test the operability of seven major components of Land DA: ``vector2tile``, ``create_ens``, ``letkfoi_snowda``, ``apply_jediincr``, ``tile2vector``, ``land_driver``, and ``ufs_datm_land``. The tests and their dependencies are listed in the ``land-DA_workflow/test/CMakeLists.txt`` file. Currently, the CTests are only run on Hera. +The ERA5 CTests test the operability of seven major components of Land DA: ``vector2tile``, ``create_ens``, ``letkfoi_snowda``, ``apply_jediincr``, ``tile2vector``, ``land_driver``, and ``ufs_datm_land``. The tests and their dependencies are listed in the ``land-DA_workflow/test/CMakeLists.txt`` file. Currently, the CTests are only run on Hera and Orion; they cannot yet be run via container. .. list-table:: *Land DA CTests* :widths: 20 50 diff --git a/docs/source/CustomizingTheWorkflow/Model.rst b/docs/source/CustomizingTheWorkflow/Model.rst index 98b16a48..582e7892 100644 --- a/docs/source/CustomizingTheWorkflow/Model.rst +++ b/docs/source/CustomizingTheWorkflow/Model.rst @@ -51,7 +51,7 @@ Users can view file information and notes for NetCDF files using the ``ncdump`` .. code-block:: console - module load intel/2022.2.0 impi/2022.2.0 netcdf/4.7.0 + module load intel/2022.1.2 impi/2022.1.2 netcdf/4.7.4 To view information on the variables contained in a :term:`netCDF` file, users can run ``ncdump -h filename.nc``. Users will need to replace ``filename.nc`` with the actual name of the file they want to view. For example: