Skip to content

Commit

Permalink
Now load_tests() returns a named list, where the names corresponds to…
Browse files Browse the repository at this point in the history
… the test titles
  • Loading branch information
HenrikBengtsson committed Feb 8, 2025
1 parent 72e86a4 commit 8ae9efd
Show file tree
Hide file tree
Showing 14 changed files with 412 additions and 398 deletions.
4 changes: 2 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@

# Contributing to the 'future.tests' package

This Git repository uses the [Git Flow](https://nvie.com/posts/a-successful-git-branching-model/) branching model (the [`git flow`](https://github.com/petervanderdoes/gitflow-avh) extension is useful for this). The [`develop`](https://github.com/HenrikBengtsson/future.tests/tree/develop) branch contains the latest contributions and other code that will appear in the next release, and the [`master`](https://github.com/HenrikBengtsson/future.tests) branch contains the code of the latest release, which is exactly what is currently on [CRAN](https://cran.r-project.org/package=future.tests).
This Git repository uses the [Git Flow](https://nvie.com/posts/a-successful-git-branching-model/) branching model (the [`git flow`](https://github.com/petervanderdoes/gitflow-avh) extension is useful for this). The [`develop`](https://github.com/futureverse/future.tests/tree/develop) branch contains the latest contributions and other code that will appear in the next release, and the [`master`](https://github.com/futureverse/future.tests) branch contains the code of the latest release, which is exactly what is currently on [CRAN](https://cran.r-project.org/package=future.tests).

Contributing to this package is easy. Just send a [pull request](https://help.github.com/articles/using-pull-requests/). When you send your PR, make sure `develop` is the destination branch on the [future.tests repository](https://github.com/HenrikBengtsson/future.tests). Your PR should pass `R CMD check --as-cran`, which will also be checked by <a href="https://github.com/HenrikBengtsson/future.tests/actions?query=workflow%3AR-CMD-check">GitHub Actions</a> and when the PR is submitted.
Contributing to this package is easy. Just send a [pull request](https://help.github.com/articles/using-pull-requests/). When you send your PR, make sure `develop` is the destination branch on the [future.tests repository](https://github.com/futureverse/future.tests). Your PR should pass `R CMD check --as-cran`, which will also be checked by <a href="https://github.com/futureverse/future.tests/actions?query=workflow%3AR-CMD-check">GitHub Actions</a> and when the PR is submitted.

We abide to the [Code of Conduct](https://www.contributor-covenant.org/version/2/0/code_of_conduct/) of Contributor Covenant.
2 changes: 1 addition & 1 deletion DESCRIPTION
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
Package: future.tests
Title: Test Suite for 'Future API' Backends
Version: 0.7.0-9001
Version: 0.7.0-9002
Authors@R: c(
person("Henrik", "Bengtsson", role = c("aut", "cre", "cph"), email = "[email protected]"),
person(family = "The R Consortium", comment = "Project was awared an Infrastructure Steering Committee (ISC) grant in 2017", role = "fnd"))
Expand Down
5 changes: 4 additions & 1 deletion NEWS.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
# Version (development version)

* ...
## New Features

* Now `load_tests()` returns a named list, where the names
corresponds to the test titles.


# Version 0.7.0 [2023-05-20]
Expand Down
4 changes: 3 additions & 1 deletion R/test_db.R
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,9 @@ test_db <- local({
}
if (!skip) {
# message(sprintf("Registering %s: %s", class(test)[1], sQuote(test$title)))
db <<- c(db, list(test))
entry <- list(test)
names(entry) <- test$title
db <<- c(db, entry)
}
}

Expand Down
116 changes: 58 additions & 58 deletions backend_results/future,cluster.out
Original file line number Diff line number Diff line change
@@ -1,70 +1,70 @@
── Settings ────────────────────────────────────────────────────────────────────
- future.tests version : 0.6.0.9007
- future.tests version : 0.7.0.9001
- R_FUTURE_TESTS_ROOT :
- Option 'future.tests.root': NULL
- Default test set folder : /home/henrik/R/x86_64-pc-linux-gnu-library/4.3-CBI-gcc11/future.tests/test-db
- Default test set folder : /home/henrik/R/ubuntu22_04-x86_64-pc-linux-gnu-library/4.4-CBI-gcc11/future.tests/test-db
- Max number of workers : 2
- Timeout : N/A

── Running 54 test sets with plan(future::cluster) ─────────────────────────────
ℹ Backend package: future 1.32.0
✔ 1. future() - conditions (1 test) (101ms)
✔ 2. %<-% - conditions (1 test) (287ms)
✔ 3. future() - muffle conditions (1 test) (229ms)
✔ 4. Argument '...' (1 test) (224ms)
✔ 5. Argument '...' from parent function (1 test) (265ms)
✔ 6. Argument '...' - non existing (1 test) (263ms)
✔ 7. Argument '...' - exception (1 test) (267ms)
✔ 8. Early signaling of errors (4 tests) (943ms)
✔ 9. Early signaling of warnings (4 tests) (1s)
✔ 10. Early signaling of messages (4 tests) (1s)
✔ 11. %<-% - local evaluation (2 tests) (494ms)
✔ 12. %<-% - local evaluation & global variable (2 tests) (535ms)
✔ 13. %<-% - errors (2 tests) (423ms)
✔ 14. %<-% - errors and listenv (2 tests) (673ms)
✔ 15. %<-% & %->% (2 tests) (553ms)
✔ 16. %<-% - nested (1 test) (286ms)
✔ 17. futureAssign() - lazy evaluation (2 tests) (528ms)
✔ 18. futureAssign() - potential task name clashes (1 test) (325ms)
✔ 19. futureAssign() - global variables with and without lazy evaluation (2 tests) (655ms)
✔ 20. futureAssign() - lazy evaluation via disposable option (2 tests) (526ms)
✔ 21. futureCall() (4 tests) (3.1s)
✔ 22. futureCall() - globals = list(a = 3) (2 tests) (1.6s)
✔ 23. futureCall() - globals = "a" (2 tests) (1.6s)
✔ 24. future() - rm() a global variable (2 tests) (531ms)
✔ 25. future() - non-exported package objects (1 test) (387ms)
✔ 26. future() - NSE '...' (1 test) (345ms)
✔ 27. resolved() on lazy futures (1 test) (306ms)
✔ 28. demo("mandelbrot", package = "future") (2 tests) (1.6s)
✔ 29. nbrOfWorkers() (1 test) (4ms)
✔ 30. future() - preserve R options (data.table) (1 test) (927ms)
✔ 31. future() - 'data.table' inject (1 test) (548ms)
✔ 32. future() - can load 'ff' package (1 test) (290ms)
✔ 33. future() - can attach 'ff' package (1 test) (255ms)
✔ 34. future() - preserve R options (ff) (1 test) (746ms)
✔ 35. plan() (1 test) (1ms)
✔ 36. plan() - workers=<numeric> (1 test) (396ms)
✔ 37. plan() - workers=<function> (1 test) (1.5s)
✔ 38. plan() - workers=<invalid> (1 test) (2ms)
✔ 39. resolve() (8 tests) (6s)
✔ 40. resolve() - run-time exception (8 tests) (2.1s)
✔ 41. resolve(<list of futures and values>) (2 tests) (534ms)
✔ 42. resolve(<list of futures>) (2 tests) (527ms)
✔ 43. resolve(<named matrix list of futures and values>) - time ordering (1 test) (772ms)
✔ 44. resolved() - assert non-blocking while launching lazy futures (1 test) (4.4s)
✔ 45. Random Number Generation (RNG) - seeds and preserving RNGkind (1 test) (197ms)
✔ 46. Random Number Generation (RNG) - future (2 tests) (894ms)
✔ 47. Random Number Generation (RNG) - %<-% (2 tests) (957ms)
✔ 48. Orchestration Stability - future() does not update RNG state (1 test) (307ms)
✔ 49. Orchestration Stability - run() does not update RNG state (1 test) (288ms)
✔ 50. Orchestration Stability - result() does not update RNG state (1 test) (255ms)
✔ 51. Orchestration Stability - value() does not update RNG state (1 test) (252ms)
✔ 52. future() - standard output (2 tests) (548ms)
✔ 53. %<-% - standard output (2 tests) (484ms)
✔ 54. value() - visibility (1 test) (273ms)
ℹ Backend package: future 1.34.0.9109
✔ 1. future() - conditions (1 test) (104ms)
✔ 2. %<-% - conditions (1 test) (387ms)
✔ 3. future() - muffle conditions (1 test) (415ms)
✔ 4. Argument '...' (1 test) (362ms)
✔ 5. Argument '...' from parent function (1 test) (377ms)
✔ 6. Argument '...' - non existing (1 test) (339ms)
✔ 7. Argument '...' - exception (1 test) (349ms)
✔ 8. Early signaling of errors (4 tests) (1.4s)
✔ 9. Early signaling of warnings (4 tests) (1.3s)
✔ 10. Early signaling of messages (4 tests) (1.3s)
✔ 11. %<-% - local evaluation (2 tests) (696ms)
✔ 12. %<-% - local evaluation & global variable (2 tests) (696ms)
✔ 13. %<-% - errors (2 tests) (703ms)
✔ 14. %<-% - errors and listenv (2 tests) (923ms)
✔ 15. %<-% & %->% (2 tests) (808ms)
✔ 16. %<-% - nested (1 test) (482ms)
✔ 17. futureAssign() - lazy evaluation (2 tests) (738ms)
✔ 18. futureAssign() - potential task name clashes (1 test) (424ms)
✔ 19. futureAssign() - global variables with and without lazy evaluation (2 tests) (935ms)
✔ 20. futureAssign() - lazy evaluation via disposable option (2 tests) (1.1s)
✔ 21. futureCall() (4 tests) (7.2s)
✔ 22. futureCall() - globals = list(a = 3) (2 tests) (4s)
✔ 23. futureCall() - globals = "a" (2 tests) (4.8s)
✔ 24. future() - rm() a global variable (2 tests) (1.7s)
✔ 25. future() - non-exported package objects (1 test) (855ms)
✔ 26. future() - NSE '...' (1 test) (875ms)
✔ 27. resolved() on lazy futures (1 test) (698ms)
✔ 28. demo("mandelbrot", package = "future") (2 tests) (2s)
✔ 29. nbrOfWorkers() (1 test) (18ms)
✔ 30. future() - preserve R options (data.table) (1 test) (918ms)
✔ 31. future() - 'data.table' inject (1 test) (768ms)
✔ 32. future() - can load 'ff' package (1 test) (747ms)
✔ 33. future() - can attach 'ff' package (1 test) (670ms)
✔ 34. future() - preserve R options (ff) (1 test) (1.4s)
✔ 35. plan() (1 test) (2ms)
✔ 36. plan() - workers=<numeric> (1 test) (961ms)
✔ 37. plan() - workers=<function> (1 test) (1.1s)
✔ 38. plan() - workers=<invalid> (1 test) (5ms)
✔ 39. resolve() (8 tests) (8.8s)
✔ 40. resolve() - run-time exception (8 tests) (4.8s)
✔ 41. resolve(<list of futures and values>) (2 tests) (1.6s)
✔ 42. resolve(<list of futures>) (2 tests) (1.5s)
✔ 43. resolve(<named matrix list of futures and values>) - time ordering (1 test) (1.2s)
✔ 44. resolved() - assert non-blocking while launching lazy futures (1 test) (4.5s)
✔ 45. Random Number Generation (RNG) - seeds and preserving RNGkind (1 test) (311ms)
✔ 46. Random Number Generation (RNG) - future (2 tests) (1.9s)
✔ 47. Random Number Generation (RNG) - %<-% (2 tests) (1.8s)
✔ 48. Orchestration Stability - future() does not update RNG state (1 test) (510ms)
✔ 49. Orchestration Stability - run() does not update RNG state (1 test) (625ms)
✔ 50. Orchestration Stability - result() does not update RNG state (1 test) (672ms)
✔ 51. Orchestration Stability - value() does not update RNG state (1 test) (618ms)
✔ 52. future() - standard output (2 tests) (1.2s)
✔ 53. %<-% - standard output (2 tests) (1.1s)
✔ 54. value() - visibility (1 test) (689ms)

Number of tests: 54
Number of test steps: 98
Duration: 43.4s
Duration: 1m 16.4s
Results: 98 ok ✔ | 0 skips ★ | 0 errors ✖ | 0 timeouts T

Loading

0 comments on commit 8ae9efd

Please sign in to comment.