Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug fix for blowing snow effect on visibility #915

Merged
merged 8 commits into from
Apr 12, 2024

Conversation

EricJames-NOAA
Copy link
Contributor

NOAA AWC noted a pronounced low bias in visibility in RRFS-A during the beta evaluation. We confirmed it is due to the blowing snow effect.

This PR restricts the blowing snow effect on visibility to roughness length (z0) < 0.7 (non-forested areas). With this new code, there will be no blowing snow effect in forested areas.

The bug fix also corrects the BLSN formulation (there was a missing factor of ustar_t in the equation for Q_s).

The code was tested for a number of blowing snow cases in RRFS_NA_3km and RRFS_CONUS_3km.

@WenMeng-NOAA
Copy link
Collaborator

@EricJames-NOAA Do you have an UPP issue to link this PR?

@EricJames-NOAA
Copy link
Contributor Author

@EricJames-NOAA Do you have an UPP issue to link this PR?

@WenMeng-NOAA I had one but it got closed with my recent PR. I can open a new one if you like.

@WenMeng-NOAA
Copy link
Collaborator

@EricJames-NOAA Do you have an UPP issue to link this PR?

@WenMeng-NOAA I had one but it got closed with my recent PR. I can open a new one if you like.

@EricJames-NOAA Please open a new issue for the inventory of UPP updates. Thanks!

@WenMeng-NOAA
Copy link
Collaborator

@EricJames-NOAA Can you sync your branch with the latest UPP develop?

@WenMeng-NOAA WenMeng-NOAA added Ready for Review This PR is ready for code review. RRFS labels Apr 10, 2024
@WenMeng-NOAA WenMeng-NOAA linked an issue Apr 11, 2024 that may be closed by this pull request
@WenMeng-NOAA
Copy link
Collaborator

@EricJames-NOAA Is your PR ready for reviewing and testing? If yes, please sync your branch with the latest UPP develop.

@EricJames-NOAA
Copy link
Contributor Author

@WenMeng-NOAA yes, this PR is ready for review! Thanks. I have just synced with the latest UPP develop branch.

@WenMeng-NOAA WenMeng-NOAA added the Baseline Change The baselines of the UPP regression tests are changed. label Apr 11, 2024
@WenMeng-NOAA
Copy link
Collaborator

@FernandoAndrade-NOAA You may start the UPP RTs on Hera and Orion. Please refer to my tests on Hera at /home/Wen.Meng/stmp2:

Wen.Meng@hfe09 stmp2$ ls -ltr */*diff
-rw-r--r-- 1 Wen.Meng stmp   132 Apr 11 18:45 rap_2020072316/WRFPRS.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp   132 Apr 11 18:45 rap_2020072316_pe_test/WRFPRS.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp    61 Apr 11 18:45 rap_2020072316/WRFNAT.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp    60 Apr 11 18:45 post_nmmb_meso_2014120818_Grib2/BGDAWP03.tm00.Grib2.diff
-rw-r--r-- 1 Wen.Meng stmp    61 Apr 11 18:45 rap_2020072316_pe_test/WRFNAT.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp    60 Apr 11 18:45 post_nmmb_meso_2014120818_Grib2_pe_test/BGDAWP03.tm00.Grib2.diff
-rw-r--r-- 1 Wen.Meng stmp    56 Apr 11 18:45 hrrr_2020060118_pe_test/WRFTWO.GrbF04.diff
-rw-r--r-- 1 Wen.Meng stmp    56 Apr 11 18:46 hrrr_2020060118/WRFTWO.GrbF04.diff
-rw-r--r-- 1 Wen.Meng stmp   370 Apr 11 18:46 fv3r_2023062800/PRSLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp   370 Apr 11 18:46 fv3r_2023062800_pe_test/PRSLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 14010 Apr 11 18:47 rtma_2023040400_pe_test/NATLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 14010 Apr 11 18:47 rtma_2023040400/NATLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 13798 Apr 11 18:49 fv3r_2023062800/NATLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 13798 Apr 11 18:49 fv3r_2023062800_pe_test/NATLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp  1063 Apr 11 18:49 rtma_2023040400_pe_test/PRSLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp  1063 Apr 11 18:49 rtma_2023040400/PRSLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp  3444 Apr 11 18:53 gfs.20190830/gfs.t00z.master.grb2f006.diff
-rw-r--r-- 1 Wen.Meng stmp  3444 Apr 11 18:53 gfs.20190830_pe_test/gfs.t00z.master.grb2f006.diff

The actual values changes should be in variable "VIS".

@WenMeng-NOAA
Copy link
Collaborator

The UPP RTs have been completed on WCOSS2 with baseline changes in gfs, rap, hrrr, fv3r, nmmb, 3drtma tests.

@FernandoAndrade-NOAA
Copy link
Collaborator

FernandoAndrade-NOAA commented Apr 12, 2024

@FernandoAndrade-NOAA You may start the UPP RTs on Hera and Orion. Please refer to my tests on Hera at /home/Wen.Meng/stmp2:

Wen.Meng@hfe09 stmp2$ ls -ltr */*diff
-rw-r--r-- 1 Wen.Meng stmp   132 Apr 11 18:45 rap_2020072316/WRFPRS.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp   132 Apr 11 18:45 rap_2020072316_pe_test/WRFPRS.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp    61 Apr 11 18:45 rap_2020072316/WRFNAT.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp    60 Apr 11 18:45 post_nmmb_meso_2014120818_Grib2/BGDAWP03.tm00.Grib2.diff
-rw-r--r-- 1 Wen.Meng stmp    61 Apr 11 18:45 rap_2020072316_pe_test/WRFNAT.GrbF16.diff
-rw-r--r-- 1 Wen.Meng stmp    60 Apr 11 18:45 post_nmmb_meso_2014120818_Grib2_pe_test/BGDAWP03.tm00.Grib2.diff
-rw-r--r-- 1 Wen.Meng stmp    56 Apr 11 18:45 hrrr_2020060118_pe_test/WRFTWO.GrbF04.diff
-rw-r--r-- 1 Wen.Meng stmp    56 Apr 11 18:46 hrrr_2020060118/WRFTWO.GrbF04.diff
-rw-r--r-- 1 Wen.Meng stmp   370 Apr 11 18:46 fv3r_2023062800/PRSLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp   370 Apr 11 18:46 fv3r_2023062800_pe_test/PRSLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 14010 Apr 11 18:47 rtma_2023040400_pe_test/NATLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 14010 Apr 11 18:47 rtma_2023040400/NATLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 13798 Apr 11 18:49 fv3r_2023062800/NATLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp 13798 Apr 11 18:49 fv3r_2023062800_pe_test/NATLEV10.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp  1063 Apr 11 18:49 rtma_2023040400_pe_test/PRSLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp  1063 Apr 11 18:49 rtma_2023040400/PRSLEV00.tm00.diff
-rw-r--r-- 1 Wen.Meng stmp  3444 Apr 11 18:53 gfs.20190830/gfs.t00z.master.grb2f006.diff
-rw-r--r-- 1 Wen.Meng stmp  3444 Apr 11 18:53 gfs.20190830_pe_test/gfs.t00z.master.grb2f006.diff

The actual values changes should be in variable "VIS".

Hera and Hercules match your results, Orion however is running into segmentation faults within the hrrr_pe test
/work2/noaa/epic/nandoam/regression-testing/upp/orion/915/UPP/ci/work-upp-ORION/out.post.hrrr_pe_test

+ srun /work2/noaa/epic/nandoam/regression-testing/upp/orion/915/UPP/ci/..//exec/upp.x
[Orion-25-40:392413:0:392413] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x2b6dc7214004)
[Orion-25-40:392415:0:392415] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x2ad77ee55004)
[Orion-25-40:392417:0:392417] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x2b380ca03004)
==== backtrace (tid: 392413) ====
 0 0x0000000000033135 ucp_tag_offload_start_rndv()  ???:0
 1 0x0000000000033cd1 ucp_address_unpack()  ???:0
 2 0x0000000000015474 ucp_ep_create()  ???:0
 3 0x00000000000078db mlx_av_insert()  mlx_av.c:0
 4 0x00000000006c2b75 MPIDI_OFI_mpi_init_hook()  /build/impi/_buildspace/release/../../src/mpid/ch4/netmod/ofi/ofi_init.c:1970
 5 0x00000000002109dd MPID_Init()  /build/impi/_buildspace/release/../../src/mpid/ch4/src/ch4_init.c:1307
 6 0x000000000052a1a3 MPIR_Init_thread()  /build/impi/_buildspace/release/../../src/mpi/init/initthread.c:142
 7 0x000000000052971b PMPI_Init()  /build/impi/_buildspace/release/../../src/mpi/init/init.c:140
 8 0x00000000000ec85b pmpi_init_()  /build/impi/_buildspace/release/../../src/binding/fortran/mpif_h/initf.c:275
 9 0x00000000005ec8f0 setup_servers_()  /work2/noaa/epic/nandoam/regression-testing/upp/orion/915/UPP/sorc/ncep_post.fd/SETUP_SERVERS.f:46
10 0x00000000004bc28a MAIN__()  /work2/noaa/epic/nandoam/regression-testing/upp/orion/915/UPP/sorc/ncep_post.fd/WRFPOST.F:177
11 0x0000000000413ed2 main()  ???:0
12 0x0000000000022495 __libc_start_main()  ???:0
13 0x0000000000413de9 _start()  ???:0

@WenMeng-NOAA
Copy link
Collaborator

@FernandoAndrade-NOAA My tests have been successfully completed on Orion at /home/wmeng/stmp2. I am not sure if there was a system issue during your testing. Or you can look into my test configurations /home/wmeng/ovp/ncep_post/post_regression_test_new/jobs and compare with your configurations.

@WenMeng-NOAA
Copy link
Collaborator

@FernandoAndrade-NOAA Since my UPP RTs on Orion are consistent with these on Hera and WCOSS2, we could merge this PR first, and you may debug the test failing later. Please let me know if this approach works for you.

@FernandoAndrade-NOAA
Copy link
Collaborator

@FernandoAndrade-NOAA Since my UPP RTs on Orion are consistent with these on Hera and WCOSS2, we could merge this PR first, and you may debug the test failing later. Please let me know if this approach works for you.

Sure thing, I'll compare our output and run scripts for the hrrr pe test case, I'll create an issue if the failure persists. Please expand read permissions for /home/wmeng/ovp/ncep_post/post_regression_test_new/jobs

Copy link
Collaborator

@FernandoAndrade-NOAA FernandoAndrade-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Temporarily skipping the hrrr_pe_test case, segmentation faults occurred only on Orion. The base hrrr test case did not run into these issues on Orion. Other test case changes are as expected.

@WenMeng-NOAA
Copy link
Collaborator

Temporarily skipping the hrrr_pe_test case, segmentation faults occurred only on Orion. The base hrrr test case did not run into these issues on Orion. Other test case changes are as expected.

@FernandoAndrade-NOAA modified permission of /home/wmeng/ovp/ncep_post/post_regression_test_new. Please try again.

@WenMeng-NOAA
Copy link
Collaborator

This PR is ready for merging. There will be baseline updates in gfs, nmmb, rap, hrrr, fv3r and 3drtma with this PR.

@WenMeng-NOAA WenMeng-NOAA merged commit 8bc3fc9 into NOAA-EMC:develop Apr 12, 2024
5 checks passed
zhanglikate added a commit to zhanglikate/UPP that referenced this pull request Apr 30, 2024
commit 13d5b6d
Author: EricJames-NOAA <[email protected]>
Date:   Mon Apr 29 15:28:47 2024 -0600

    RRFS updates (NOAA-EMC#938)

    * Initial commit to rename RRFS fix files, update EBB to be vertically integrated from 3D ebu_smoke, and switch to use 1-h average HWP.

    * Getting rid of vertically integrated hydrometeor fields.

    * Updating postxconfig-NT-rrfs.txt

commit 88493f3
Author: Wei Huang <[email protected]>
Date:   Fri Apr 26 21:29:51 2024 -0600

    add module for AWS (NOAA-EMC#934)

    * add module for AWS

    * comment that this is for NOAA Cloud

commit be0410e
Author: hsinmulin-NOAA <[email protected]>
Date:   Tue Apr 23 15:46:47 2024 -0400

    Add files via upload (NOAA-EMC#937)

    add
    1. 80 m for SPFH_ON_SPEC_HGT_LVL_ABOVE_GRND_FDHGT
    2. 80 m for PRES_ON_SPEC_HGT_LVL_ABOVE_GRND_FDHGT

commit 79d74d9
Author: Edward Hartnett <[email protected]>
Date:   Mon Apr 22 13:34:39 2024 -0600

    turn on doxygen build in CI (NOAA-EMC#932)

    * turn on doxygen build in CI

    * turn on doxygen build in CI

    * turn on doxygen build in CI

    * turn on doxygen build in CI

    * fixed cmake file

    * fixed doc directory

commit 5d6d179
Author: Dusan Jovic <[email protected]>
Date:   Fri Apr 19 14:17:10 2024 -0400

    Remove dependency on sfcio and use sigio only when nemsio is enabled (NOAA-EMC#930)

    * Remove sfcio and use sigio only when numsio is enabled

    * Remove sfcio from modulefiles/wcoss2.lua

    * Compile GFSPOSTSIG.F only if nemsio is enabled

commit 91921f4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date:   Mon Apr 15 21:04:39 2024 -0400

    Bump idna from 3.6 to 3.7 in /doc/UserGuide (NOAA-EMC#928)

    Bumps [idna](https://github.com/kjd/idna) from 3.6 to 3.7.
    - [Release notes](https://github.com/kjd/idna/releases)
    - [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst)
    - [Commits](kjd/idna@v3.6...v3.7)

    ---
    updated-dependencies:
    - dependency-name: idna
      dependency-type: indirect
    ...

    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Co-authored-by: Wen Meng <[email protected]>

commit 8bc3fc9
Author: EricJames-NOAA <[email protected]>
Date:   Fri Apr 12 16:06:36 2024 -0600

    Bug fix for blowing snow effect on visibility (NOAA-EMC#915)

    * Correcting bug in CALVIS_GSD.f

    * Introducing roughness length impact on BLSN (no BLSN effect at z0>0.7).

    * Removing some gridpoint print statements for testing.

    * Checking change to compile_upp.sh

    * Reverting change.

commit fd93933
Author: YaliMao-NOAA <[email protected]>
Date:   Thu Apr 11 17:14:24 2024 +0000

    For RRFS, change the mnemonics of column max of EDPARM from EDPARM on 0m level to MXEDPRM of the entire atmosphere. (NOAA-EMC#926)

    For this purpose, MXEDPRM is added to both post_avblflds.xml and control file fv3lam_rrfs.xml

commit 5faac75
Author: WenMeng-NOAA <[email protected]>
Date:   Tue Apr 9 18:25:18 2024 -0400

    Correct total soil moisture from SOIMOI to CISOIM (NOAA-EMC#922)

    * Correct total soil moisture from SOIMOI to CISOIM

    * Update shortname of UPP ID 36

    * update CMake debug mode

commit 83e83a9
Author: Innocent Souopgui <[email protected]>
Date:   Fri Apr 5 15:10:14 2024 -0500

    Remove the detection of Jet/Centos7 nodes (NOAA-EMC#920)

    * Remove the detection of Jet/Centos7 nodes and removes the associated module file jet_c.lua

    * Update detect_machine.sh remove hera 12

    ---------

    Co-authored-by: Fernando Andrade - NOAA <[email protected]>

commit 1d1e58a
Author: Dusan Jovic <[email protected]>
Date:   Fri Apr 5 13:10:20 2024 -0400

    Add BUILD_WITH_NEMSIO build option to allow building UPP without nemsio (NOAA-EMC#911)

    * Add BUILD_WITH_NEMSIO build option to allow building UPP without nemsio

    * Specify w3emc and bacio as dependencies of nemsio library

    * Add compile_upp.sh option to build without nemsio (-n)

commit 7d39b5c
Author: WenMeng-NOAA <[email protected]>
Date:   Thu Apr 4 17:07:14 2024 -0400

    Add LTNG in PRSLEV dataset of RRFS (NOAA-EMC#918)

commit 62ecf8a
Author: AndrewBenjamin-NOAA <[email protected]>
Date:   Thu Apr 4 14:50:08 2024 -0400

    RRFSv1.0 Product cleanup: removal of retired products from fv3lam_rrfs.xml (NOAA-EMC#909)

    * removed  <table_info>NCEP</table_info> for ULWRF to use the official WMO ID rather than the dupilcate NCEP local use ID

    * removed <table_info>NCEP</table_info> from REFZR, REFZI, BMIXL, and CNWAT to use WMO grib2 ids

    * removed <table_info>NCEP</table_info> from SNOWC, SFEXC, SSRUN, BGRUN, FRICV, CD, SNOHF, PEVAP, TCOLI in order to use WMO id over NCEP local use ID.

    * removed <table_info>NCEP<table_info> from SNFALB, CDLYR, USWRF, DSWRF, DLWRF, VWSH, TCOLR, TCOLS, UPHL

    * removed <table_info>NCEP<table_info> from MSTAV in post_avblflds.xml to use WMO grib2 id for RRFS

    * removed duplicate CNWAT NATLEV entry in fv3lam_rrfs.xml.

    * updated fv3lam_rrfs.xml and parm/postxconfig-NT-fv3lam_rrfs.txt to remove products no longer needed in the RRFS.

    * changed precision in SSRUN

    * fixed SSRUN precision in flat file

    * removed LSPA and SNOWC from NATLEV

commit df9b16b
Author: EricJames-NOAA <[email protected]>
Date:   Mon Apr 1 15:51:56 2024 -0600

    Add surface albedo, accumulated snow melt, and total soil moisture output in RRFS (NOAA-EMC#908)

    * Updating CLDRAD and INITPOST_NETCDF

    * Reverting change in CLDRAD.f

    * Changes to output CISOILM and SNOM.

    * Cleaning up syntax.

    * Adding change logs.

    * Small updates.

    * Removing extcof55 from visibility calculation (it's all zeroes).

    * Reverting change in INITPOST_NETCDF.f setting smstot to spval

    * Using a single level "0 m underground" for CISOILM

commit 92b080d
Author: KarinaAsmar-NOAA <[email protected]>
Date:   Sat Mar 30 20:03:49 2024 -0400

    Add additional SFS variables and isobaric levels (NOAA-EMC#903)

    * added additional isobaric levels

    * adding HLCY, SSRUN, VBDSF

    * added HLCY, SSRUN, VBDSF

    * replacing id 772 with 401 and 403 (vbdsf and nbdsf)

    * vbdsf and nbdsf with info from avblflds

    * removed id 772 and added 401 and 403 (vbdsf and nbdsf)

    * vbdsf and nbdsf copied from gfs flux

    * vbdsf and nbdsf copied from gfs flux
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Baseline Change The baselines of the UPP regression tests are changed. Ready for Review This PR is ready for code review. RRFS
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bug fix for BLSN visibility impact
3 participants