Flank v20.05.0

Stable release for commit ead2739

Release highlights

Flank 20 has been released! This includes 41 features and bug fixes from 9 authors (bootstraponline, RainNapper, Kurt-Bonatz, doodla, jan-gogo, pawelpasterz, fondesa, Writhe, adamfilipow92).

Highlights include:

• Date based version numbers! 20.05.0 is the first Flank release in May.
• Server side sharding. All the shards show up in one matrix if you're using a single APK. This is a huge stability and user experience win. num-flaky-test-attempts will retry entire shards.
• Video, auto login, and perf metrics default to off to optimize for performance. You can turn them back on if desired.
• Flank no longer hangs on exceptions!
• The API is used to fetch XML results on Android instead of parsing XML files. This improves performance and correctness.
• Web links to the matrices are printed at the start of each run.
• Many new features are now supported in Flank and are coming soon to Fladle. additional-apks, disableSharding, smartFlankDisableUpload, testRunnerClass, localResultsDir, testTargetsAlwaysRun, runTimeout, ignoreFailedTests, numUniformShards, clientDetails, otherFiles, networkProfile, roboScript, roboDirectives
• Improved memory usage for running on small virtual machines
• ASCII doc in the repo for every supported Flank command
• Flank is now on maven central! The group id has changed from flank to com.github.flank We're working to automatically sync each new release to maven.
• Timing values corrected in JUnit XML files on Android.
• Fixed test filtering logic when using notPackage and notClass

v20.05.0

• #764 Fix crash on parse some control chars. (adamfilipow92)
• #772 Fail fast when results-dir is incorrect. (jan-gogo)
• #757 Reduce memory usage by using Reader and Writer instead of ByteArrays. (jan-gogo)
• #763 Use "localhost" as default for hostname to fix backward compatibility. (jan-gogo)
• #757 Print version and revision before each command. (jan-gogo)
• #759 Add shard name for uploaded xctestrun files. (pawelpasterz)
• #755 Remove ascii doc generated section header. (jan-gogo)
• #731 Refactor jUnit HTML report. (Writhe)
• #754 Sync README.md flank.yml flank.ios.yml. (jan-gogo)
• #746 Ignore apk with filtered out tests instead of failing. (pawelpasterz)
• #741 Allow APKs with zero tests. (fondesa)
• #737 Generate ascii doc. (jan-gogo)
• #720 Update group id from flank to com.github.flank (bootstraponline)
• #714 Add support for num-uniform-shards option. (jan-gogo)
• #712 Add keep file path for ios. (pawelpasterz)
• #711 Remove hardcoded height. (pawelpasterz)
• #708 Add ignore failed tests option to Flank. (pawelpasterz)
• #704 Add robo for robo-directives & robo-script options. (jan-gogo)
• #704 Fix shards calculation when there are ignored tests and shardTime is -1. (jan-gogo)
• #692 Add support for other-files option. (jan-gogo)
• #695 Add support for additional-apks option. (jan-gogo)
• #683 Print web link. (pawelpasterz)
• #692 Add support for network-profiles list command & --network-profile option. (jan-gogo)
• #689 Add support for client-details option. (jan-gogo)
• #687 Debug message printed after every command. (pawelpasterz)
• #684 Add overhead time to junit test case report. (jan-gogo)
• #666 Use API instead of XML for result parsing for android. (jan-gogo)
• #678 Skip Bugsnag initialization if user disabled gcloud analytics. (pawelpasterz)
• #672 Flank timeout feature. (pawelpasterz)
• #657 Fix execution hangs. (pawelpasterz)
• #654 Fix test filters when using both notPackage and notClass. (jan-gogo)
• #648 Include @ignore JUnit tests in JUnit XML. (pawelpasterz)
• #646 Adopt kotlin-logging as a logging framework. (jan-gogo)
• #644 Use high performance options by default. Video, login, and perf metrics are now disabled by default. (pawelpasterz)
• #643 Add --dry option to android run & ios run. (jan-gogo)
• #642 Flank doctor should exit 1 on validation issues. (pawelpasterz)
• #641 Move all deps to Deps.kt (doodla)
• #640 Update gradle to 6.2.1 and JaCoCo to 0.8.5. (doodla)
• #639 Cache all uploads and downloads to GCS. (Kurt-Bonatz)
• #635 Default to 2m time estimate for unknown tests when sharding. (RainNapper)
• #621 Adopt server side sharding. Max shard count is 50. (bootstraponline)

Flank v8.1.0

Stable release for commit 4f0d4a3

v8.1.0

• #612 Print HtmlErrorReport location. (bootstraponline)
• #615 Add --keep-file-path for Android when downloading assets from Google Cloud Storage. (tahirhajizada)

Flank v8.0.1

Stable release for commit 4942e6f

v8.0.1

• #608 Use MatrixRollupOutcome to set exit code value. (bootstraponline)

Flank v8.0.0

Stable release for commit a484ff0

v8.0.0

• #595 Rename flaky-test-attempts to num-flaky-test-attempts. Rename repeat-tests to num-test-runs. (bootstraponline)
• #605 Improve exit code logging. Use matrix outcome to set exit code. (bootstraponline)
• #597 Support parsing testLabExecutionId. (yogurtearl)
• #599 Disable FAIL_ON_UNKNOWN_PROPERTIES for forward compatibility. (narenkmanoharan)

Flank v7.0.2

Stable release for commit 9c25955

v7.0.2

• #589 Fix java.lang.NumberFormatException: empty String. (vfadc)
• #587 Optimize polling. (bootstraponline)

Flank v7.0.1

Stable release for commit 9d431d2

v7.0.1

• #586 Poll devices in parallel. Fixes performance regression in Flank v7. (bootstraponline)

Flank v7.0.0

Stable release for commit 332acb8

v7.0.0

• #574 Improve test shard error reporting. Update device catalog to use projectId. (bootstraponline)
• #582 Fix iOS exit code when using flaky-test-attempts. Don't print environment-variables to stdout for security. (bootstraponline)
• #584 Poll all test executions instead of only the first per matrix. (bootstraponline)
• #585 Fix bug in smart flank when sharding tests that run in 0 seconds. (bootstraponline)

Flank v6.2.3

Stable release for commit db71eb8

v6.2.3

• #567 Fix --app & --test on Android CLI. (bootstraponline)
• #571 Add flank ios run --dump-shards and flank android run --dump-shards for debugging (bootstraponline)
• #572 Fix exit code reporting when using flaky-test-attempts (bootstraponline)

Flank v6.2.2

Stable release for commit 6844b48

v6.2.2

• #566 Fix --test & --xctestrun-file on iOS CLI. (bootstraponline)

Flank v6.2.1

Stable release for commit b63fc7f

v6.2.1

• #563 Fix CLI support for iOS. (bootstraponline)