Jenkins RT Improvements #837
Conversation
Exit code 1 if results changed and text file for Jenkins to output changes.
…l/UPP into feature/jenkins-comment
|
The parm/ changes were for testing purposes, it will be reverted to sync up with develop. |
|
@FernandoAndrade-NOAA Do you have an UPP issue linking to this PR? Please sync parm/fv3lam_rrf in your branch with the UPP develop branch. |
Issue created and linked, I've also reverted the rrfs dummy changes used in testing, they should match develop now. |
|
@FernandoAndrade-NOAA Can you sync your branch with the latest UPP develop branch? |
WenMeng-NOAA
added
Ready for Review
|
PR was synced and taken out of draft |
|
@FernandoAndrade-NOAA You may start the UPP RT on Hera and Orion. Thanks! |
|
Jenkins as of this morning is having issues connecting to the Tier1 systems and the platform team is working with system admins to get that resolved, I'll be running manually. From a meeting discussion earlier, the degradation in performance on my side for Hera may potentially be caused by a significantly lower allocation this month for Hera specifically. Orion seems to be running fine and Hercules I'm still trying to get to fully complete RT runs. It seems at this time I will only be able to run tests for Orion while issues for the other two are resolved. |
|
No changes in Orion UPP RTs available here: |
|
@WenMeng-NOAA if you could confirm your RTs were successful for Hera, could you provide a run directory? I can update the epic baselines on Hera with your files if you aren't running into any issues with your RT runs. |
@FernandoAndrade-NOAA Please see my baselines of the UPP RT at /scratch2/NCEPDEV/ovp/Wen.Meng/ncep_post/post_regression_test_new/data_out. The run directories of this PR testing are at /scratch1/NCEPDEV/stmp2/Wen.Meng |
|
The UPP RTs were completed on WCOSS2 and Hera without changed results. This PR is ready for merging. |
This PR introduces additional functionality to clearly display UPP regression test results on the relevant PR once initial review has been completed and the appropriate label has been added to the PR. Jenkins will now leave comments summarizing RT results on head machine. Jenkins currently runs on Hera, Orion, and with this PR, Hercules as well. Failures will be accompanied with the run directory in order to verify changes in results or diagnose issues.