Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased

Added

Added the annotations collected by Bhandari et al., (2020).
Added BLANC
Added the annotations collected by the BLANC paper.
Added a wrapper around the implementation of APES.
Added the Multi-News dataset.
Added the WCEP dataset

Fixed

Fixed a bug in which QAEval would crash if you don't use LERC

v0.1.5 - 2021-01-02

Fixed

Including the LERC output from the individual QA pairs in QAEval

v0.1.4 - 2021-01-02

Added

Added scoring QAEval predictions with LERC

Fixed

Creating the .sacrerouge/metrics directory in the BLEURT setup script if it doesn't exist.

v0.1.3 - 2020-11-25

Added

Added ability to skip calculating specific correlation levels (summary, system, and global)
Added optionally generating plots of the system-level and global metric values
Added passing a List[Metrics] to the correlation calculation instead of just a file or list of files

Changed

Updating spacy package version to 2.3.3 and model version to 2.3.1. DecomposedRouge's unit tests and experiments subsequently updated.
Changed all positional arguments to commands to non-positional for improved readability of the commands.