Update config.resources for bufr sounding job postsnd #2917

BoCui-NOAA · 2024-09-13T14:16:25Z

Description

This PR updates the parm/config/gfs/config.resources and env/WCOSS2.env files for the BUFR sounding job "postsnd." It includes adjustments to resource settings such as tasks per node and memory allocations for various GFS resolutions, including C768, C1152, and others.

Here are the proposed changes:

C768: 7 nodes, 21 tasks per node
C1152: 16 nodes, 9 tasks per node

Type of change

New feature (adds functionality)

Change characteristics

Is this a breaking change (a change in existing functionality)? NO
Does this change require a documentation update? NO
Does this change require an update to any of the following submodules? NO

How has this been tested?

Cycled test on WCOSS2

Checklist

Any dependent changes have been merged and published
My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code, particularly in hard-to-understand areas
My changes generate no new warnings
New and existing tests pass with my changes
I have made corresponding changes to the documentation if necessary

Co-authored-by: Walter Kolczynski - NOAA <[email protected]>

WalterKolczynski-NOAA · 2024-09-13T19:42:52Z

env/WCOSS2.env

    export NTHREADS_POSTSNDCFP=${threads_per_task_postsndcfp:-1}
    [[ ${NTHREADS_POSTSNDCFP} -gt ${max_threads_per_task} ]] && export NTHREADS_POSTSNDCFP=${max_threads_per_task}
    export APRUN_POSTSNDCFP="${launcher} -np ${ntasks_postsndcfp} ${mpmd_opt}"

+    export mpmd_opt="-ppn 21 ${mpmd_opt}"


Should this be set to ${tasks_per_node} instead of 21?

Fixed it, thanks!

emcbot · 2024-09-13T21:16:14Z

CI Update on Wcoss2 at 09/13/24 09:16:14 PM
============================================
Cloning and Building global-workflow PR: 2917
with PID: 174859 on host: dlogin03

emcbot · 2024-09-13T21:58:10Z

Automated global-workflow Testing Results:

Machine: Wcoss2
Start: Fri Sep 13 21:19:18 UTC 2024 on dlogin03
---------------------------------------------------
Build: Completed at 09/13/24 09:57:47 PM
Case setup: Completed for experiment C48_ATM_7378427d
Case setup: Skipped for experiment C48mx500_3DVarAOWCDA_7378427d
Case setup: Skipped for experiment C48_S2SWA_gefs_7378427d
Case setup: Completed for experiment C48_S2SW_7378427d
Case setup: Completed for experiment C96_atm3DVar_extended_7378427d
Case setup: Skipped for experiment C96_atm3DVar_7378427d
Case setup: Completed for experiment C96C48_hybatmaerosnowDA_7378427d
Case setup: Completed for experiment C96C48_hybatmDA_7378427d
Case setup: Completed for experiment C96C48_ufs_hybatmDA_7378427d

emcbot · 2024-09-14T11:24:13Z

All CI Test Cases Passed on Wcoss2:

Experiment C48_ATM_7378427d *** SUCCESS *** at 09/13/24 11:30:15 PM
Experiment C48_S2SW_7378427d *** SUCCESS *** at 09/13/24 11:42:08 PM
Experiment C96C48_hybatmDA_7378427d *** SUCCESS *** at 09/14/24 12:36:27 AM
Experiment C96C48_hybatmaerosnowDA_7378427d *** SUCCESS *** at 09/14/24 01:27:16 AM
Experiment C96C48_ufs_hybatmDA_7378427d *** SUCCESS *** at 09/14/24 02:36:28 AM
Experiment C96_atm3DVar_extended_7378427d *** SUCCESS *** at 09/14/24 11:21:37 AM

* origin/develop: Update config.resources for bufr sounding job postsnd (NOAA-EMC#2917) Cleanup job for GEFS (NOAA-EMC#2919) Build GDASApp and unset memory in Gaea-C5 xml files (NOAA-EMC#2912) add 1 deg ocean/ice info to parm/config/gfs/config.resources (NOAA-EMC#2922) Support gefs C48 on Azure (NOAA-EMC#2881) Disable native grid writes for non-JEDI experiments; update C384 compression options (NOAA-EMC#2914)

* emc/develop: Update config.resources for bufr sounding job postsnd (NOAA-EMC#2917) Cleanup job for GEFS (NOAA-EMC#2919) Build GDASApp and unset memory in Gaea-C5 xml files (NOAA-EMC#2912) add 1 deg ocean/ice info to parm/config/gfs/config.resources (NOAA-EMC#2922) Support gefs C48 on Azure (NOAA-EMC#2881) Disable native grid writes for non-JEDI experiments; update C384 compression options (NOAA-EMC#2914) Add new UPP links to .gitignore (NOAA-EMC#2904)

…al_obs_path * origin/develop: Update global atmos upp job to use COMIN/COMOUT (NOAA-EMC#2867) Update config.resources for bufr sounding job postsnd (NOAA-EMC#2917) Cleanup job for GEFS (NOAA-EMC#2919) Build GDASApp and unset memory in Gaea-C5 xml files (NOAA-EMC#2912) add 1 deg ocean/ice info to parm/config/gfs/config.resources (NOAA-EMC#2922) Support gefs C48 on Azure (NOAA-EMC#2881) Disable native grid writes for non-JEDI experiments; update C384 compression options (NOAA-EMC#2914)

This PR updates the parm/config/gfs/config.resources and env/WCOSS2.env files for the BUFR sounding job "postsnd." It includes adjustments to resource settings such as tasks per node and memory allocations for various GFS resolutions, including C768, C1152, and others. Here are the proposed changes: C768: 7 nodes, 21 tasks per node C1152: 16 nodes, 9 tasks per node

BoCui-NOAA and others added 15 commits June 20, 2024 14:34

Add restart capability to job JGFS_ATMOS_POSTSND

c734f41

Merge branch 'NOAA-EMC:develop' into develop

bb89562

Merge branch 'NOAA-EMC:develop' into develop

8e42d49

Convert bufr to handle one forecast at a time

b0637b7

update to fix shellcheck warning

c4f0399

fix shellcheck issue

f711c3f

Updated gfs_utils hash

202c449

20240903 gfsv17 bufr package update

133755a

Update env/WCOSS2.env

e293370

Co-authored-by: Walter Kolczynski - NOAA <[email protected]>

Update scripts/exgfs_atmos_postsnd.sh

0e94d92

Co-authored-by: Walter Kolczynski - NOAA <[email protected]>

Add new bufr table for GFS C96 output

5f5e542

Merge branch 'NOAA-EMC:develop' into develop

ccea7d1

Merge branch 'NOAA-EMC:develop' into develop

303f792

Uppdate config.resources for bufr sounding job

2ed6a53

Merge branch 'NOAA-EMC:develop' into develop

581673d

WalterKolczynski-NOAA requested changes Sep 13, 2024

View reviewed changes

BoCui-NOAA added 2 commits September 13, 2024 16:08

Update WCOSS2.env

2f6d494

Merge branch 'NOAA-EMC:develop' into develop

7378427

WalterKolczynski-NOAA approved these changes Sep 13, 2024

View reviewed changes

WalterKolczynski-NOAA added the CI-Wcoss2-Ready **CM use only** PR is ready for CI testing on WCOSS label Sep 13, 2024

emcbot added CI-Wcoss2-Building **Bot use only** CI testing is cloning/building on WCOSS and removed CI-Wcoss2-Ready **CM use only** PR is ready for CI testing on WCOSS labels Sep 13, 2024

emcbot added CI-Wcoss2-Running **Bot use only** CI testing on WCOSS for this PR is in-progress and removed CI-Wcoss2-Building **Bot use only** CI testing is cloning/building on WCOSS labels Sep 13, 2024

emcbot added CI-Wcoss2-Passed **Bot use only** CI testing on WCOSS for this PR has completed successfully and removed CI-Wcoss2-Running **Bot use only** CI testing on WCOSS for this PR is in-progress labels Sep 14, 2024

Merge branch 'NOAA-EMC:develop' into develop

d4fa91e

WalterKolczynski-NOAA merged commit 03ee9f8 into NOAA-EMC:develop Sep 16, 2024
5 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update config.resources for bufr sounding job postsnd #2917

Update config.resources for bufr sounding job postsnd #2917

BoCui-NOAA commented Sep 13, 2024 •

edited

Loading

WalterKolczynski-NOAA Sep 13, 2024

BoCui-NOAA Sep 13, 2024

emcbot commented Sep 13, 2024

emcbot commented Sep 13, 2024

emcbot commented Sep 14, 2024

Update config.resources for bufr sounding job postsnd #2917

Update config.resources for bufr sounding job postsnd #2917

Conversation

BoCui-NOAA commented Sep 13, 2024 • edited Loading

Description

Type of change

Change characteristics

How has this been tested?

Checklist

WalterKolczynski-NOAA Sep 13, 2024

Choose a reason for hiding this comment

BoCui-NOAA Sep 13, 2024

Choose a reason for hiding this comment

emcbot commented Sep 13, 2024

emcbot commented Sep 13, 2024

emcbot commented Sep 14, 2024

BoCui-NOAA commented Sep 13, 2024 •

edited

Loading