Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more ocean variables for post-processing in GEFS #2995

Merged

Conversation

EricSinsky-NOAA
Copy link
Contributor

@EricSinsky-NOAA EricSinsky-NOAA commented Oct 9, 2024

Description

This PR adds an ocean variable tob (Sea Water Potential Temperature at Sea Floor) for post-processing in GEFS, which is a variable that has been requested for GEFSv13 and the reforecast.

Also, this PR moves the atmos variable PEVPR from the "b" group to the "a" group of pgrb products in GEFS. This was requested by a reforecast stakeholder.

Resolves #2993

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? YES

How has this been tested?

These changes have been tested on WCOSS2. This PR will be left as a draft until the necessary gfs-utils PR is merged.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • I have made corresponding changes to the system documentation if necessary

@EricSinsky-NOAA
Copy link
Contributor Author

After testing this branch with the latest gfs_utils hash, the new ocean variable tob is successfully being post-processed in the ocean_prod task. Also, PEVPR is being successfully written to the "a" atmos pgrb file group. Marking this PR as ready for review.

@EricSinsky-NOAA EricSinsky-NOAA marked this pull request as ready for review October 10, 2024 19:46
@WalterKolczynski-NOAA WalterKolczynski-NOAA added the CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules label Oct 10, 2024
@emcbot emcbot added CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress labels Oct 10, 2024
@emcbot
Copy link

emcbot commented Oct 10, 2024

Experiment C96_S2SWA_gefs_replay_ics FAILED on Hercules in Build# 1 in
/work2/noaa/stmp/CI/HERCULES/2995/RUNTESTS/EXPDIR/C96_S2SWA_gefs_replay_ics_172223cd

@EricSinsky-NOAA
Copy link
Contributor Author

A change needed to be made to the name of one of the extractvars dependencies due to the changes made in PR #2981. This change has been committed in d7a10a9.

@emcbot emcbot added CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed labels Oct 11, 2024
@emcbot
Copy link

emcbot commented Oct 11, 2024

CI Failed on Hercules in Build# 1
Built and ran in directory /work2/noaa/stmp/CI/HERCULES/2995


Experiment C48_ATM_172223cd Completed 1 Cycles: *SUCCESS* at Thu Oct 10 17:10:58 CDT 2024
Experiment C96_S2SWA_gefs_replay_ics_172223cd Terminated with 0 tasks failed and 0 dead at Thu Oct 10 17:17:06 CDT 2024
Experiment C96_S2SWA_gefs_replay_ics_172223cd Terminated: *STALLED*
Experiment C96_atm3DVar_172223cd Completed 3 Cycles: *SUCCESS* at Thu Oct 10 18:11:56 CDT 2024
Experiment C96C48_hybatmDA_172223cd Completed 3 Cycles: *SUCCESS* at Thu Oct 10 18:30:24 CDT 2024
Experiment C48_S2SW_172223cd Completed 1 Cycles: *SUCCESS* at Thu Oct 10 19:24:18 CDT 2024
Experiment C48_S2SWA_gefs_172223cd Completed 1 Cycles: *SUCCESS* at Thu Oct 10 19:31:16 CDT 2024

@WalterKolczynski-NOAA WalterKolczynski-NOAA added CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules and removed CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed labels Oct 15, 2024
@emcbot emcbot added CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules and removed CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules labels Oct 15, 2024
@TerrenceMcGuinness-NOAA
Copy link
Collaborator

TerrenceMcGuinness-NOAA commented Oct 15, 2024

@WalterKolczynski-NOAA Build fail with gfs_utils, seems to cause a Jenkins failure, not sure how the two are related:

guild_gfs_utils.log

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed and removed CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules labels Oct 15, 2024
@WalterKolczynski-NOAA
Copy link
Contributor

@TerrenceMcGuinness-NOAA Did the build cause a Jenkins failure, or vice versa? The build log looks successful.

EricSinsky-NOAA added a commit that referenced this pull request Oct 28, 2024
<!--
  *** PLEASE READ ***

  Any PRs not following this template will be closed.

  Please delete all these comments before submitting the PR.

Please use a short (<60 char), descriptive title for the PR title above.
It should complete the sentence "If merged, this PR will _____".
Capitalize the first word and do not end with a period.

  No content should appear above the "Description" header.

If this PR is not merge-ready (e.g. it depends on other PRs not yet
merged), please mark it as draft until it is ready.

  PRs should meet these guidelines:
  - Each PR should address ONE topic and have an associated issue.
  - No hard-coded paths or personal directories.
  - No temporary or backup files should be committed (including logs).
- Any code that you disabled by being commented out should be removed or
reenabled.
-->
# Description
<!-- This description will become the commit message for the PR. -->
<!--
  Solely pointing to an issue is not an adequate description!

  Please use this format for your description:

Describe your changes. Focus on the *what* and *why*. The *how* will be
evident from the changes. In particular, be sure to note any interface
changes, such as command line syntax, that will need to be communicated
to users.

At the end of your description, please be sure to add the issue this PR
solves using the word "Resolves". If there are any issues that are
related but not yet resolved (including in other repos), you may use
"Refs".

  Resolves #1234
  Refs #4321
  Refs NOAA-EMC/repo#5678
-->

This PR brings recent changes from the develop branch to the GEFS
reforecast branch. This PR updates the GEFS reforecast branch to develop
hash ac3cde5 (10/11/2024). This version
of global-workflow uses the ufs-weather-model hash
[6a4e09e](https://github.com/ufs-community/ufs-weather-model/tree/6a4e09e94773ffa39ce7ab6a54a885efada91f21)
(9/9/2024).

Furthermore, this PR ensures the following adjustments for the
reforecast:

- [x] Speed up rocoto by grouping post job
- [x] Optimize PE configuration
- [x]  Remove duplicate OCNSPPT and EPBL settings
- [x] Set restart_interval to fhmax
- [x] Turn off SHUM in config.efcs
- [x] Set FHMIN_WAV to 3 in config.base 
- [x] Turn off ATM history file output
- [x] Change  HMS=${cyc}0000 to HMS=030000 in Wavepostpnt script (#2788)
- [x] Include YYYYMMDDHH (PDY) in job name
- [x] Change CA seed based on case and cyc for control member and
perturbed members
- [x] Fix post ensemble info
- [x] Add tob to ocean products (#2995 )
- [x] Move PEVPR from b group to a group for atmos products (#2995)
- [x] Add option to download initial condition from HPSS
- [x] Add ability to download and stage replay analysis from AWS, which
is needed for the repair_replay task
- [x] Add capability to run forecasts in 7-day intervals  (#2928)
- [x] Update defaults.yaml so that many of the reforecast-specific
settings can be used by default

<!-- For more on writing good commit messages, see
https://cbea.ms/git-commit/ -->

# Type of change
- [ ] Bug fix (fixes something broken)
- [ ] New feature (adds functionality)
- [x] Maintenance (code refactor, clean-up, new CI test, etc.)

# Change characteristics
<!-- Choose YES or NO from each of the following and delete the other
-->
- Is this a breaking change (a change in existing functionality)? NO
- Does this change require a documentation update? NO
- Does this change require an update to any of the following submodules?
NO
  - [ ] EMC verif-global <!-- NOAA-EMC/EMC_verif-global#1234 -->
  - [ ] GDAS <!-- NOAA-EMC/GDASApp#1234 -->
  - [ ] GFS-utils <!-- NOAA-EMC/gfs-utils#1234 -->
  - [ ] GSI <!-- NOAA-EMC/GSI#1234 -->
  - [ ] GSI-monitor <!-- NOAA-EMC/GSI-Monitor#1234 -->
  - [ ] GSI-utils <!-- NOAA-EMC/GSI-Utils#1234 -->
  - [ ] UFS-utils <!-- ufs-community/UFS_UTILS#1234 -->
  - [ ] UFS-weather-model <!-- ufs-community/ufs-weather-model#1234 -->
  - [ ] wxflow <!-- NOAA-EMC/wxflow#1234 -->

# How has this been tested?
<!-- Please list any test you conducted, including the machine.

Example:
- Clone and build on WCOSS
- Cycled test on Orion
- Forecast-only on Hera
-->

This branch is being tested on WCOSS2. When testing has succeeded, this
PR will be marked as ready for review.

# Checklist
- [ ] Any dependent changes have been merged and published
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have documented my code, including function, input, and output
descriptions
- [ ] My changes generate no new warnings
- [ ] New and existing tests pass with my changes
- [ ] This change is covered by an existing CI test or a new one has
been added
- [ ] I have made corresponding changes to the system documentation if
necessary

---------

Co-authored-by: Wei Huang <[email protected]>
Co-authored-by: Kate Friedman <[email protected]>
Co-authored-by: Cory Martin <[email protected]>
Co-authored-by: Andrew.Tangborn <[email protected]>
Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Co-authored-by: AndrewEichmann-NOAA <[email protected]>
Co-authored-by: DavidBurrows-NCO <[email protected]>
Co-authored-by: AnningCheng-NOAA <[email protected]>
Co-authored-by: David Huber <[email protected]>
Co-authored-by: Rahul Mahajan <[email protected]>
Co-authored-by: AntonMFernando-NOAA <[email protected]>
Co-authored-by: BoCui-NOAA <[email protected]>
Co-authored-by: DavidNew-NOAA <[email protected]>
Co-authored-by: Jeffrey Whitaker <[email protected]>
Co-authored-by: mingshichen-noaa <[email protected]>
Co-authored-by: Jiarui Dong <[email protected]>
Co-authored-by: David Huber <[email protected]>
Co-authored-by: Guillaume Vernieres <[email protected]>
Co-authored-by: RussTreadon-NOAA <[email protected]>
Co-authored-by: Innocent Souopgui <[email protected]>
Co-authored-by: Neil Barton <[email protected]>
@WalterKolczynski-NOAA WalterKolczynski-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules and removed CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules labels Oct 30, 2024
@emcbot emcbot added CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully and removed CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress labels Oct 31, 2024
@emcbot
Copy link

emcbot commented Oct 31, 2024

CI Passed on Hercules in Build# 1
Built and ran in directory /work2/noaa/global/CI/HERCULES/2995


Experiment C48_ATM_3d331677 Completed 2 Cycles: *SUCCESS* at Thu Oct 31 13:01:20 CDT 2024
Experiment C96_S2SWA_gefs_replay_ics_3d331677 Completed 1 Cycles: *SUCCESS* at Thu Oct 31 13:31:37 CDT 2024
Experiment C96_atm3DVar_3d331677 Completed 3 Cycles: *SUCCESS* at Thu Oct 31 14:26:47 CDT 2024
Experiment C96C48_hybatmDA_3d331677 Completed 3 Cycles: *SUCCESS* at Thu Oct 31 14:44:52 CDT 2024
Experiment C48_S2SW_3d331677 Completed 2 Cycles: *SUCCESS* at Thu Oct 31 14:56:57 CDT 2024
Experiment C48_S2SWA_gefs_3d331677 Completed 1 Cycles: *SUCCESS* at Thu Oct 31 15:33:33 CDT 2024

@emcbot emcbot added CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Nov 1, 2024
@emcbot
Copy link

emcbot commented Nov 1, 2024

CI Passed on Hera in Build# 2
Built and ran in directory /scratch1/NCEPDEV/global/CI/2995


Experiment C96_S2SWA_gefs_replay_ics_3d331677 Completed 1 Cycles: *SUCCESS* at Thu Oct 31 19:53:04 UTC 2024
Experiment C48_ATM_3d331677 Completed 2 Cycles: *SUCCESS* at Thu Oct 31 19:59:01 UTC 2024
Experiment C48mx500_3DVarAOWCDA_3d331677 Completed 2 Cycles: *SUCCESS* at Thu Oct 31 20:35:59 UTC 2024
Experiment C48_S2SWA_gefs_3d331677 Completed 1 Cycles: *SUCCESS* at Thu Oct 31 23:12:49 UTC 2024
Experiment C48_S2SW_3d331677 Completed 2 Cycles: *SUCCESS* at Thu Oct 31 23:40:03 UTC 2024
Experiment C96_atm3DVar_3d331677 Completed 3 Cycles: *SUCCESS* at Thu Oct 31 23:58:27 UTC 2024
Experiment C96C48_hybatmaerosnowDA_3d331677 Completed 3 Cycles: *SUCCESS* at Fri Nov  1 00:04:58 UTC 2024
Experiment C96C48_hybatmDA_3d331677 Completed 3 Cycles: *SUCCESS* at Fri Nov  1 03:26:58 UTC 2024
Experiment C96C48_ufs_hybatmDA_3d331677 Completed 3 Cycles: *SUCCESS* at Fri Nov  1 05:05:00 UTC 2024

@WalterKolczynski-NOAA WalterKolczynski-NOAA merged commit d95630a into NOAA-EMC:develop Nov 1, 2024
10 of 11 checks passed
@EricSinsky-NOAA EricSinsky-NOAA deleted the feature/addmoreprods branch November 8, 2024 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add more ocean variables for ocean post-processing in GEFS
4 participants