Releases: dtcenter/METplus
METplus-3.0.2
METplus 3.0.2 Bugfix Release Notes:
Bugfixes
- Unset LOG_*_VERBOSITY (i.e. LOG_GRID_STAT_VERBOSITY) in use case files to prevent these values from taking precedence over user setting LOG_MET_VERBOSITY.
- Added input data needed to run online tutorial content.
Sample Input Data
The following data is used to run the use cases in the repository.
MET Tool Wrapper (parm/use_cases/met_tool_wrapper)
- All Use Cases: https://github.com/NCAR/METplus/releases/download/v3.0.2/sample_data-met_tool_wrapper-3.0.2.tgz
Model Applications (parm/use_cases/model_applications)
- Convection Allowing Models: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-convection_allowing_models-3.0.tgz
- Cryosphere: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-cryosphere-3.0.tgz
- Medium Range: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-medium_range-3.0.tgz
- Precipitation: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-precipitation-3.0.tgz
- Seasonal to Subseasonal: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-s2s-3.0.tgz
- Space Weather: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-space_weather-3.0.tgz
- TC and Extra TC: https://github.com/NCAR/METplus/releases/download/v3.0/sample_data-tc_and_extra_tc-3.0.tgz
METplus-3.0.1
METplus 3.0.1 Bugfix Release Notes:
Bugfixes
- Fixed {now} functionality in [INIT/VALID]_[BEG/END]
- Fixed formatting for field level in StatAnalysis wrapper
- Updated MODE Time Domain use cases to produce better results
METplus-3.0
METplus 3.0 Release Notes
General
- Moved to using Python 3.6.3 or higher.
- Reorganization of use case directory structure - see https://dtcenter.github.io/METplus/Users_Guide/usecases.html
- Support for Python Embedding:
- For supplying gridded input data to MET tools: PCPCombine, RegridDataPlane, PointStat, etc.
- For MET tools that accept multiple input files: SeriesAnalysis, EnsembleStat,and MTD
- For reading point observations via ASCII2NC
- Documentation moved online using GitHub Pages: https://dtcenter.github.io/METplus
- Addition of Contributor's Guide
- Logging:
Wrapper Specific
- ASCII2NC (#263)
- New wrapper
- SeriesAnalysis (#381)
- New wrapper
- PyEmbedIngester (#281)
- New wrapper
- Added to allow python embedding for multiple data sources
- PcpCombine
- PB2NC
- New configuration variables PB2NC_VALID_[BEG/END] to set -valid_beg and -valid_end command line args (#338)
- PointStat
- New configuration variables POINT_STAT_OBS_VALID_[BEG/END] to set -obs_valid_beg and -obs_valid_end command line arguments.
- RegridDataPlane
- Support gaussian command line arguments via METplus (#367)
Configuration
- User environment variables ([user_env_vars]) and [FCST/OBS]_VAR_[NAME/LEVEL/OPTIONS] now support filename template syntax, i.e. {valid?fmt=%Y%m%d%H} (#267)
- Added support for month, year, and sub-hourly intervals for [INIT/VALID]_INCREMENT and LEAD_SEQ (#292, #298)
- Configuration Name Changes:
- Many configuration variable names have changed to conform to naming conventions (#306, #312, etc).
- Added utilities and instructions to assist with transitioning old configuration files to run using METplus 3.0: https://dtcenter.github.io/METplus/Users_Guide/installation.html#updating-configuration-files-handling-deprecated-configuration-variables
- New General configuration options:
- _REGRID_TO_GRID options for GridStat, EnsembleStat, MODE, MTD, SeriesAnalysis (#339)
- _OUTPUT_PREFIX for GridStat, PointStat, EnsembleStat, MODE, and MTD (#351).
- Support wrapper specific field info lists - [FCST/OBS]_VAR[NAME/LEVELS/OPTIONS/THRESH] supported to allow different lists for each wrapper. Applies to GridStat, PointStat, EnsembleStat, MODE, and MTD (#378).
- Support for custom string list for each wrapper to allow tool to be called multiple times per run time (#383). See https://dtcenter.github.io/METplus/Users_Guide/systemconfiguration.html#custom-looping
Bugfixes
- ExtractTiles wrapper now checks for empty file list rather than an empty directory, (#277)
- PCPCombine subtract mode will call add method with 1 file if processing accumulation data and the lead time is equal to the desired accumulation
- PCPCombine add mode forecast GRIB input
- PCPCombine sum mode no longer fails when input level is not explicitly specified
- PCPCombine now sets additional field options in -add mode using [FCST/OBS]_PCP_COMBINE_INPUT_OPTIONS (#390)
- Feature relative config files no longer defines variable names and levels via VAR_LIST. Now employ the same syntax as other wrappers: BOTH_VAR1_NAME, BOTH_VAR1_LEVELS, BOTH_VAR2_NAME, BOTH_VAR2_LEVELS, etc. (#143)
- SeriesAnalysis wrappers, use the STAGING_DIR rather than the TMP dir for storing intermediate files and remove these files before exiting the wrapper. (#341)
- SeriesByLead wrapper no longer creates temporary subdirectories based on the current process id, as this prevented the wrapper from being run stand-alone using pre-existing data (#332)
- SeriesByInit wrapper no longer creates temporary subdirectories based on the current process id, as this prevented the wrapper from being run stand-alone using pre-existing data (#333)
METplus-2.2
METplus Wrappers v2.2 Release Notes:
Configuration:
Configuration variables that previously had to be specified in seconds (such
as OBS_WINDOW_END) can now be specified in minutes or hours by adding M
or H respectively to the number, i.e.
3600 = 60M = 1H
Non-MET executables (such as rm) no longer need to be specified with a full
path in the configuration files. Default values are now the name of the executable.
If the executable is found in the user environment path, the scripts will automatically find it.
Wrapper Specific:
TcPairs wrapper has been updated to be more flexible and handle more use
cases.
METplus-2.1.1
See release 2.1 for sample data tarballs.
METplus Wrappers v2.1.1 Release Notes:
General:
-
Fixed bug in filename templates where a file with the same number of characters in between tags are considered a valid file even if the characters differ, i.e. template = {valid?fmt=%Y}_dog_{valid?fmt%m} would treat both 2017_dog_02 and 2017_cat_02 as valid files when it should only consider 2017_dog_02 to be a valid file. This only applies when using file windows to determine which files are vaild (See “Using Windows to Find Valid Files” in section 4.3.3).
-
Removed requirement for non-MET executables to exist on the system for wrappers that don't need to use them. For example, if a use case doesn't use wgrib2, setting the path to the executable correctly is not required.
METplus-2.1
METplus v2.1 Release Notes:
Configuration:
-
Added gather_by_date.conf for grid-to-grid and grid-to-obs use cases
-
Created specific directory for plotting use case config files
-
Added error checking so it is more clear what config items need to be added or changed to run
-
Renamed many config variables for clarity
-
Variables specific to a wrapper will contain the app name in the variable name
-
Error message at startup listing all deprecated config items and the suggested new item to use
-
-
MET configuration files updated to contain new default values that were recently added
-
Current time environment variables set to be used in MET or METplus config files if needed (See section describing Timing Control).
-
Added INIT_SEQ for looping by valid time to calculate forecast lead list (instead of specifying with LEAD_SEQ)
-
Adding window begin and end variables for individual wrappers instead of having the same window for every wrapper (See OBS_WINDOW_BEGIN and OBS_WINDOW_END in section describing A-Z Config Glossary)
-
Added option to skip processing of a file in some wrappers (i.e. pb2nc or regrid_data_plane) if the output file already exists (See PB2NC_SKIP_IF_OUTPUT_EXISTS in section describing A-Z Config Glossary)
Wrapper specific:
-
MakePlots
- Reworked following the changes to the work done on stat_analysis_wrapper.py
-
StatAnalysis
- Reworked to give users greater use of the MET stat_analysis tool
-
PcpCombine
-
Added support for -derive mode
-
Fixed bugs in -subtract mode and -sum mode
-
-
PB2NC
- Refactored to allow looping by valid time and utilize filename templates instead of regex
-
PointStat
-
Refactored to allow looping by valid time and utilize filename templates instead of regex
-
Added verification mask and neighborhood width/shape configurations
-
-
EnsembleStat
- Refactored to allow looping by valid time
-
GridStat
- Added verification mask and neighborhood width/shape configurations
-
SeriesByLead
- Changed configuration names for forecast hour to more closely match other wrappers (See LEAD_SEQ_[N], LEAD_SEQ_[N]_LABEL, SERIES_BY_LEAD_GROUP_FCSTS, and LEAD_SEQ in section describing A-Z Config Glossary)
General:
- Improved string template substitution and extraction functionality to be more flexible and to allow time shifting/truncating (See section describing Directory and Filename Template Info)
• Improve timed handling so filename templates can be more flexible
• Added 'now' time item to allow start and end time of run to be defined relative to the current time at execution (See section describing Timing Control)
• Logfiles now contains METplus version number and start/end logs to easily discern multiple runs within a single log file
• Various bug fixes
METplus-2.0.4
METplus v2.0.4 Release Notes:
Configuration:
- Updated config files to match sample data directory structure
General:
- Moved large mask files from repository to sample data tarballs
- Improved logging message clarity
- List METplus version number in final configuration file and logging output
METplus-2.0.3
NOTE: To use wget from a linux server, mouse over the file to be downloaded and enter that URL after the wget command. Example:
wget https://github.com/NCAR/METplus/archive/v2.0.3.tar.gz
wget https://github.com/NCAR/METplus/releases/download/v2.0.3/sample_data-qpf.tgz
METplus v2.0.3 Release Notes:
Configuration:
• Added DO_NOT_RUN_EXE config variable to prevent applications from actually running
• Added LOG_TIMESTAMP_USE_RUNTIME config variable to use data time in log file names instead of run time
• METPLUS_BASE config variable is automatically set to the location METplus is being run
• Added automatically generated CLOCK_TIME config variable to keep track of time METplus was run
Wrapper specific:
• mode_wrapper
– new python wrapper for MET tool mode
• mtd_wrapper
– new python wrapper for MET tool mtd (mode time domain)
• pcp_combine_wrapper
– Threshold values specified in the config files now require a comparison operator (>,>=,==,!=,<,<=,gt,ge,eq,ne,lt,le) Previously _THRESH values were assumed to use >= by pcp_combine
• grid_stat_wrapper
– grid_stat will now process all name/level/threshold combinations in a single run if desired (some cases require splitting up calls to grid_stat, such as processing probabilistic forecasts or precip accumulations)
– Added probability threshold configs for grid_stat probabilistic forecast evaluation
General:
• Compressed input files with certain file extensions (gz, zip, bz2) will be automatically uncompressed and placed into a staging area for use in METplus (with option to scrub staging directory after run) - Gempak files now can automatically be converted to NetCDF for use in METplus (See [FCST/OBS]_[MET-APP]_DATATYPE)
• NetCDF field levels can now be specified in config files, i.e. (0,0,,). NOTE: Quotes around these items are required
• Updated MET config files to use MET 8.0
• Cleanup of plotting scripts
METplus-2.0.2
Minor release including addition of user_env_vars conf functionality.
Users can add variables to a new conf section called [user_env_vars] in METplus config files. These new conf items will be set as environment variables with the same name to be used in MET config files.
See Assets from v2.0.1, as nothing has changed between these versions in that regard.
METplus-2.0.1
Minor release including bug fixes.
See the METplus_Users_Guide.pdf Release Notes for details.