Make aerosol output frequency variable #2982

WalterKolczynski-NOAA · 2024-10-04T04:58:47Z

Description

The AERO_HISTORY.rc file that controls the GOCART output is turned into a template usint @[ ] syntax to allow for variable output times. A new "parsing" script is created for GOCART that handles parsing the AERO_HISTORY.rc file through atparse. Other manip- ulation of these files is also moved to the new parsing script to be consistent with other components.

A new variable, FHOUT_AERO is introduced to control the output frequency of the GOCART output. This is initially set to 3 to match other components (this is a change from the current value of 6). Since some aerosol fields are also included as part of the atmos output, it may be desirable to meld this back into FHOUT later. However, the atmos output has two frequencies (FHOUT_HF and FHOUT), a feature not supported by other components.

The RUN lists for aero fcst, aero analysis, and waves is simplified to avoid confusion, since there is no need for them to only be set if the components are on.

Resolves #2072

Type of change

Bug fix (fixes something broken)
New feature (adds functionality)
Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

Is this a breaking change (a change in existing functionality)? NO
Does this change require a documentation update? NO
Does this change require an update to any of the following submodules? NO

How has this been tested?

S2SWA forecast-only on Hercules (manually modifying AERO_FCST_RUN)

Checklist

Any dependent changes have been merged and published
My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code, particularly in hard-to-understand areas
I have documented my code, including function, input, and output descriptions
My changes generate no new warnings
New and existing tests pass with my changes
This change is covered by an existing CI test or a new one has been added
I have made corresponding changes to the system documentation if necessary

ush/parsing_namelists_GOCART.sh

parm/config/gfs/config.base

ush/parsing_namelists_GOCART.sh

CoryMartin-NOAA

I didn't test but this looks good to me

parm/config/gfs/config.base

aerorahul

Looks good.
Question:
Not for this PR to address -- how diffferent is the parm/ufs/gocart/AERO_HISTORY.rc file in the global-workflow from the one in ufs-weather-model?

WalterKolczynski-NOAA · 2024-10-04T16:20:52Z

Looks good. Question: Not for this PR to address -- how diffferent is the parm/ufs/gocart/AERO_HISTORY.rc file in the global-workflow from the one in ufs-weather-model?

@aerorahul Looks like they have already templated the one frequency we use, but not the others. A couple other small changes (also whitespace changes not shown):

diff parm/ufs/gocart/AERO_HISTORY.rc sorc/ufs_model.fd/tests/parm/gocart/AERO_HISTORY.rc.IN -b
384c384
<   inst_aod.frequency:  060000,
---
>   inst_aod.frequency:  @[AOD_FRQ],
390a391
>                        'NIEXTTAU'      , 'NI'       , 'AOD_NI',
405,406c406,407
<   tavg_2d_rad.fields:     'CA.bcEXTTAU' , 'CA.bc' ,
< 			  'CA.ocEXTTAU' , 'CA.oc' ,
---
>   tavg_2d_rad.fields:     'CAEXTTAUCA.bc' , 'CA.bc' ,
>                           'CAEXTTAUCA.oc' , 'CA.oc' ,

(This is against our develop, not the changes in this PR.)

emcbot · 2024-10-08T01:07:56Z

Experiment C48_ATM FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C48_ATM_8a18d626

emcbot · 2024-10-08T01:07:56Z

Experiment C48mx500_3DVarAOWCDA FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_8a18d626

emcbot · 2024-10-08T01:07:58Z

Experiment C48_S2SWA_gefs FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C48_S2SWA_gefs_8a18d626

emcbot · 2024-10-08T01:07:58Z

Experiment C96_atm3DVar FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C96_atm3DVar_8a18d626

emcbot · 2024-10-08T01:07:59Z

Experiment C48_S2SW FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C48_S2SW_8a18d626

emcbot · 2024-10-08T01:08:00Z

Experiment C96C48_hybatmaerosnowDA FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C96C48_hybatmaerosnowDA_8a18d626

emcbot · 2024-10-08T01:08:00Z

Experiment C96C48_hybatmDA FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C96C48_hybatmDA_8a18d626

emcbot · 2024-10-08T01:08:01Z

Experiment C96C48_ufs_hybatmDA FAILED on Hera in Build# 2 in
/scratch1/NCEPDEV/global/CI/2982/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_8a18d626

emcbot · 2024-11-08T12:19:58Z

Experiment C96_S2SWA_gefs_replay_ics FAILED on Hercules in Build# 7 with error logs:

/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_376faebe/logs/2020110100/gefs_fcst_mem000_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_376faebe/logs/2020110100/gefs_fcst_mem001_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_376faebe/logs/2020110100/gefs_fcst_mem002_seg0.log

Follow link here to view the contents of the above file(s): (link)

emcbot · 2024-11-08T12:20:10Z

Experiment C96_S2SWA_gefs_replay_ics FAILED on Hercules in Build# 7 in
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/EXPDIR/C96_S2SWA_gefs_replay_ics_376faebe

emcbot · 2024-11-08T14:33:52Z

CI Failed on Hercules in Build# 7
Built and ran in directory /work2/noaa/global/CI/HERCULES/2982


Experiment C48_ATM_376faebe Completed 2 Cycles: *SUCCESS* at Fri Nov  8 06:19:20 CST 2024
Experiment C96_S2SWA_gefs_replay_ics_376faebe Terminated with 0
FAIL
FAIL tasks failed and 3 dead at Fri Nov  8 06:19:37 CST 2024
Experiment C96_S2SWA_gefs_replay_ics_376faebe Terminated: *FAIL*
Error logs:
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_376faebe/logs/2020110100/gefs_fcst_mem000_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_376faebe/logs/2020110100/gefs_fcst_mem001_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_376faebe/logs/2020110100/gefs_fcst_mem002_seg0.log
Experiment C96_atm3DVar_376faebe Completed 3 Cycles: *SUCCESS* at Fri Nov  8 07:38:18 CST 2024
Experiment C96C48_hybatmDA_376faebe Completed 3 Cycles: *SUCCESS* at Fri Nov  8 08:02:42 CST 2024
Experiment C48_S2SW_376faebe Completed 2 Cycles: *SUCCESS* at Fri Nov  8 08:14:53 CST 2024
Experiment C48_S2SWA_gefs_376faebe Completed 1 Cycles: *SUCCESS* at Fri Nov  8 08:33:44 CST 2024

GOCART needs to use the bigger of FHMIN and FHROT when determining the first output time.

emcbot · 2024-11-12T17:51:14Z

Experiment C96_S2SWA_gefs_replay_ics FAILED on Hercules in Build# 1 with error logs:

/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_4d85e36f/logs/2020110100/gefs_fcst_mem000_seg0.log

Follow link here to view the contents of the above file(s): (link)

emcbot · 2024-11-12T17:51:23Z

Experiment C96_S2SWA_gefs_replay_ics FAILED on Hercules in Build# 1 in
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/EXPDIR/C96_S2SWA_gefs_replay_ics_4d85e36f

emcbot · 2024-11-12T17:57:31Z

Experiment C48_S2SWA_gefs FAILED on Hercules in Build# 1 with error logs:

/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C48_S2SWA_gefs_4d85e36f/logs/2021032312/gefs_fcst_mem000_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C48_S2SWA_gefs_4d85e36f/logs/2021032312/gefs_fcst_mem001_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C48_S2SWA_gefs_4d85e36f/logs/2021032312/gefs_fcst_mem002_seg0.log

Follow link here to view the contents of the above file(s): (link)

emcbot · 2024-11-12T17:57:43Z

Experiment C48_S2SWA_gefs FAILED on Hercules in Build# 1 in
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/EXPDIR/C48_S2SWA_gefs_4d85e36f

emcbot · 2024-11-12T21:47:04Z

CI Failed on Hercules in Build# 1
Built and ran in directory /work2/noaa/global/CI/HERCULES/2982


Experiment C96_S2SWA_gefs_replay_ics_4d85e36f Terminated with 0
FAIL
FAIL tasks failed and 1 dead at Tue Nov 12 11:50:52 CST 2024
Experiment C96_S2SWA_gefs_replay_ics_4d85e36f Terminated: *FAIL*
Error logs:
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C96_S2SWA_gefs_replay_ics_4d85e36f/logs/2020110100/gefs_fcst_mem000_seg0.log
Experiment C48_S2SWA_gefs_4d85e36f Terminated with 0
FAIL
FAIL tasks failed and 3 dead at Tue Nov 12 11:57:14 CST 2024
Experiment C48_S2SWA_gefs_4d85e36f Terminated: *FAIL*
Error logs:
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C48_S2SWA_gefs_4d85e36f/logs/2021032312/gefs_fcst_mem000_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C48_S2SWA_gefs_4d85e36f/logs/2021032312/gefs_fcst_mem001_seg0.log
/work2/noaa/global/CI/HERCULES/2982/RUNTESTS/COMROOT/C48_S2SWA_gefs_4d85e36f/logs/2021032312/gefs_fcst_mem002_seg0.log
Experiment C48_ATM_4d85e36f Completed 2 Cycles: *SUCCESS* at Tue Nov 12 12:39:18 CST 2024
Experiment C48_S2SW_4d85e36f Completed 2 Cycles: *SUCCESS* at Tue Nov 12 14:16:03 CST 2024
Experiment C96_atm3DVar_4d85e36f Completed 3 Cycles: *SUCCESS* at Tue Nov 12 14:52:21 CST 2024
Experiment C96C48_hybatmDA_4d85e36f Completed 3 Cycles: *SUCCESS* at Tue Nov 12 15:46:56 CST 2024

WalterKolczynski-NOAA requested review from CoryMartin-NOAA, aerorahul and DavidHuber-NOAA October 4, 2024 04:58

github-advanced-security bot found potential problems Oct 4, 2024

View reviewed changes

ush/parsing_namelists_GOCART.sh Fixed Show fixed Hide fixed

DavidHuber-NOAA previously approved these changes Oct 4, 2024

View reviewed changes

parm/config/gfs/config.base Show resolved Hide resolved

DavidHuber-NOAA reviewed Oct 4, 2024

View reviewed changes

ush/parsing_namelists_GOCART.sh Show resolved Hide resolved

CoryMartin-NOAA previously approved these changes Oct 4, 2024

View reviewed changes

parm/config/gfs/config.base Show resolved Hide resolved

aerorahul previously approved these changes Oct 4, 2024

View reviewed changes

WalterKolczynski-NOAA added the CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera label Oct 7, 2024

emcbot added CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera and removed CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera labels Oct 7, 2024

TerrenceMcGuinness-NOAA removed the CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera label Oct 7, 2024

WalterKolczynski-NOAA added the CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera label Oct 7, 2024

emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed labels Oct 8, 2024

WalterKolczynski-NOAA added the CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules label Nov 8, 2024

WalterKolczynski-NOAA requested a review from aerorahul November 8, 2024 09:59

emcbot added CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress labels Nov 8, 2024

emcbot added CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed labels Nov 8, 2024

Correct first output time of GOCART

376af38

GOCART needs to use the bigger of FHMIN and FHROT when determining the first output time.

WalterKolczynski-NOAA removed the CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed label Nov 12, 2024

Merge branch 'develop' into feature/gocart_variable_fh

4d85e36

WalterKolczynski-NOAA added the CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules label Nov 12, 2024

emcbot added CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress labels Nov 12, 2024

emcbot added CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed labels Nov 12, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Make aerosol output frequency variable #2982

Make aerosol output frequency variable #2982

WalterKolczynski-NOAA commented Oct 4, 2024 •

edited

Loading

CoryMartin-NOAA left a comment

aerorahul left a comment

WalterKolczynski-NOAA commented Oct 4, 2024 •

edited

Loading

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Nov 8, 2024

emcbot commented Nov 8, 2024

emcbot commented Nov 8, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

Make aerosol output frequency variable #2982

Are you sure you want to change the base?

Make aerosol output frequency variable #2982

Conversation

WalterKolczynski-NOAA commented Oct 4, 2024 • edited Loading

Description

Type of change

Change characteristics

How has this been tested?

Checklist

CoryMartin-NOAA left a comment

Choose a reason for hiding this comment

aerorahul left a comment

Choose a reason for hiding this comment

WalterKolczynski-NOAA commented Oct 4, 2024 • edited Loading

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Oct 8, 2024

emcbot commented Nov 8, 2024

emcbot commented Nov 8, 2024

emcbot commented Nov 8, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

emcbot commented Nov 12, 2024

WalterKolczynski-NOAA commented Oct 4, 2024 •

edited

Loading

WalterKolczynski-NOAA commented Oct 4, 2024 •

edited

Loading