- On Ruby 3.2+, you can now use the new Coverage library feature for
eval
- See simplecov-ruby#1037. Thanks @mame!
- Fix for making the test suite pass against the upcoming Ruby 3.2 - See simplecov-ruby#1035. Thanks @mame
maximum_coverage_drop
won't fail any more if.last_run.json
is still in the old format. Thanks @petertellgrenmaximum_coverage_drop
won't fail if an expectation is specified for a previous unrecorded criterion, it will just pass (there's nothing, so nothing to drop)- fixed bug in
maximum_coverage_drop
calculation that could falsely report it had dropped for minimal differences
minimum_coverage_by_file
works again as expected (errored out before 😱)
The "Collate++" release making it more viable for big CI setups by limiting memory consumption. Also includes some nice new additions for branch coverage settings.
- Performance of
SimpleCov.collate
improved - it should both run faster and consume much less memory esp. when run with many files (memory consumption should not increase with number of files any more) - Can now define the minimum_coverage_by_file, maximum_coverage_drop and refuse_coverage_drop by branch as well as line coverage. Thanks to @jemmaissroff
- Can set primary coverage to something other than line by setting
primary_coverage :branch
in SimpleCov Configuration. Thanks to @jemmaissroff
- reduce gem size by splitting Changelog into
Changelog.md
and a pre 0.18Changelog.old.md
, the latter of which is not included in the gem - The interface of
ResultMeger.merge_and_store
is changed to support thecollate
performance improvements mentioned above. It's not considered an official API, hence this is not in the breaking section. For people using it to merge results from different machines, it's recommended to migrate to collate.
The "JSON formatter" release. Starting now a JSON formatter is included by default in the release. This is mostly done for Code Climate reasons, you can find more details in this issue.
Shipping with so much by default is sub-optimal, we know. It's the long term plan to also provide simplecov-core
without the HTML or JSON formatters for those who don't need them/for other formatters to rely on.
simplecov_json_formatter
included by default (docs), this should enable the Code Climate test reporter to work again once it's updated- invalidate internal cache after switching
SimpleCov.root
, should help with some bugs
- No more warnings triggered by
enable_for_subprocesses
. Thanks to @mame - Avoid trying to patch
Process.fork
when it isn't available. Thanks to @MSP-Greg
- Dropped support for Ruby 2.4, it reached EOL
- observe forked processes (enable with SimpleCov.enable_for_subprocesses). See #881, thanks to @robotdana
- SimpleCov distinguishes better that it stopped processing because of a previous error vs. SimpleCov is the originator of said error due to coverage requirements.
- Changing the
SimpleCov.root
combined with the root filtering didn't work. Now they do! Thanks to @deivid-rodriguez and see #894 - in parallel test execution it could happen that the last coverage result was written to disk when it didn't complete yet, changed to only write it once it's the final result
- if you run parallel tests only the final process will report violations of the configured test coverage, not all previous processes
- changed the parallel_tests merging mechanisms to do the waiting always in the last process, should reduce race conditions
- The repo has moved to https://github.com/simplecov-ruby/simplecov - everything stays the same, redirects should work but you might wanna update anyhow
- The primary development branch is now
main
, notmaster
anymore. If you get simplecov directly from github change your reference. For a whilemaster
will still be occasionally updated but that's no long term solion.
Can you guess? Another bugfix release!
- minitest won't crash if SimpleCov isn't loaded - aka don't execute SimpleCov code in the minitest plugin if SimpleCov isn't loaded. Thanks to @edariedl for the report of the peculiar problem in #877.
Another small bugfix release 🙈 Fixes SimpleCov running with rspec-rails, which was broken due to our fixed minitest integration.
- SimpleCov will run again correctly when used with rspec-rails. The excellent bug report #873 by @odlp perfectly details what went wrong. Thanks to @adam12 for the fix #874.
Small bugfix release. It's especially recommended to upgrade simplecov-html as well because of bugs in the 0.12.0 release.
- Fix a regression related to file encodings as special characters were missing. Furthermore we now respect the magic
# encoding: ...
comment and read files in the right encoding. Thanks (@Tietew) - see #866 - Use
Minitest.after_run
hook to trigger post-run hooks ifMinitest
is present. See #756 and #855 thanks (@adam12)
Small release just to allow you to use the new simplecov-html.
- Relax simplecov-html requirement so that you're able to use 0.12.0
Small Bugfix release.
- Just putting
# :nocov:
on top of a file or having an uneven number of them in general works again and acts as if ignoring until the end of the file. See #846 and thanks @DannyBen for the report.
Huge release! Highlights are support for branch coverage (Ruby 2.5+) and dropping support for EOL'ed Ruby versions (< 2.4). Please also read the other beta patch notes.
You can run with branch coverage by putting enable_coverage :branch
into your SimpleCov configuration (like the SimpleCov.start do .. end
block)
- You can now define the minimum expected coverage by criterion like
minimum_coverage line: 90, branch: 80
- Memoized some internal data structures that didn't change to reduce SimpleCov overhead
- Both
FileList
andSourceFile
now have acoverage
method that returns a hash that points from a coverage criterion to aCoverageStatistics
object for uniform access to overall coverage statistics for both line and branch coverage
- we were losing precision by rounding the covered strength early, that has been removed. For Formatters this also means that you may need to round it yourself now.
- Removed an inconsistency in how we treat skipped vs. irrelevant lines (see #565) - SimpleCov's definition of 100% is now "You covered everything that you could" so if coverage is 0/0 that's counted as a 100% no matter if the lines were irrelevant or ignored/skipped
FileList
stopped inheriting from Array, it includes Enumerable so if you didn't use Array specific methods on it in formatters you should be fine- We needed to change an internal file format, which we use for merging across processes, to accommodate branch coverage. Sadly CodeClimate chose to use this file to report test coverage. Until a resolution is found the code climate test reporter won't work with SimpleCov for 0.18+, see this issue on the test reporter.
- Instead of ignoring old
.resultset.json
s that are inside the merge timeout, adapt and respect them
- Remove the constant warning printing if you still have a
.resultset.json
in pre 0.18 layout that is within your merge timeout
- only turn on the requested coverage criteria (when activating branch coverage before SimpleCov would also instruct Ruby to take Method coverage)
- Change how branch coverage is displayed, now it's
branch_type: hit_count
which should be more self explanatory. See #830 for an example and feel free to give feedback! - Allow early running exit tasks and avoid the
at_exit
hook through theSimpleCov.run_exit_tasks!
method. (thanks @macumber) - Allow manual collation of result sets through the
SimpleCov.collate
entrypoint. See the README for more details (thanks @ticky) - Within
case
, even if there is noelse
branch declared show missing coverage for it (aka no branch of it). See #825 - Stop symbolizing all keys when loading cache (should lead to be faster and consume less memory)
- Cache whether we can use/are using branch coverage (should be slightly faster)
- Fix a crash that happened when an old version of our internal cache file
.resultset.json
was still present
This is a huge release highlighted by changing our support for ruby versions to 2.4+ (so things that aren't EOL'ed) and finally adding branch coverage support!
This release is still beta because we'd love for you to test out branch coverage and get your feedback before doing a full release.
On a personal note from @PragTob thanks to ruby together for sponsoring this work on SimpleCov making it possible to deliver this and subsequent releases.
- Dropped support for all EOL'ed rubies meaning we only support 2.4+. Simplecov can no longer be installed on older rubies, but older simplecov releases should still work. (thanks @deivid-rodriguez)
- Dropped the
rake simplecov
task that "magically" integreated with rails. It was always undocumented, caused some issues and had some issues. Use the integration as described in the README please :)
- Branch coverage is here! Please try it out and test it! You can activate it with
enable_coverage :branch
. See the README for more details. This is thanks to a bunch of people most notably @som4ik, @tycooon, @stepozer, @klyonrad and your humble maintainers also contributed ;) - If the minimum coverage is set to be greater than 100, a warning will be shown. See #737 (thanks @belfazt)
- Add a configuration option to disable the printing of non-successful exit statuses. See #747 (thanks @JacobEvelyn)
- Calculating 100% coverage is now stricter, so 100% means 100%. See #680 thanks @gleseur
- Add new instance of
Minitest
constant. TheMiniTest
constant (with the capital T) will be removed in the next major release of Minitest. See #757 (thanks @adam12)
Looking for older changelogs? Please check the old Changelog