Skip to content

Latest commit

 

History

History
92 lines (78 loc) · 2.8 KB

README.md

File metadata and controls

92 lines (78 loc) · 2.8 KB

drone-testng

Building

Build the plugin binary:

scripts/build.sh

Build the plugin image:

docker build -t plugins/testng -f docker/Dockerfile .

Testing

Execute the plugin from your current working directory:

TestNG: This plugin process the TestNG report files and log the Test Reports in the console.

docker run --rm \
  -e PLUGIN_REPORT_FILENAME_PATTERN="**/target/testng-results.xml" \
  -e PLUGIN_FAILED_FAILS=5 \
  -e PLUGIN_FAILED_SKIPS=3 \
  -e PLUGIN_THRESHOLD_MODE=1 \
  -e PLUGIN_FAILURE_ON_FAILED_TEST_CONFIG=true \
  -e PLUGIN_PLUGIN_FAIL_IF_NO_RESULTS=true \
  -v $(pwd):$(pwd) \
  plugins/testng

Example Harness Step:

- step:
    identifier: testngtojunitconversion
    name: TestNG
    spec:
      image: plugins/testng
      settings:
        report_filename_pattern: "**/target/testng-results.xml"
        failed_fails: 5
        failed_skips: 3
        threshold_mode: 1
        failure_on_failed_test_config: true
        fail_if_no_results: true
    timeout: ''
    type: Plugin

Plugin Settings

  • PLUGIN_REPORT_FILENAME_PATTERN Description: The file name pattern to locate TestNG XML report files. Supports Ant-style patterns. Example: **/target/testng-results.xml

  • PLUGIN_FAILED_FAILS Description: Maximum number of failed tests before the build is marked as FAILURE. Example: 5

  • PLUGIN_FAILED_SKIPS Description: Maximum number of skipped tests before the build is marked as FAILURE. Example: 3

  • PLUGIN_THRESHOLD_MODE: (Optional) Specifies the mode for threshold validation:

    • absolute: In this mode, the thresholds are validated against specific counts of failed and skipped tests.
    • percentage: In this mode, the thresholds are validated against percentage values of failed and skipped tests relative to the total tests executed.
    • Example:
    - step:
  identifier: testng80776e
  type: Plugin
  name: testng
  spec:
    connectorRef: nunitdockerconnector
    image: mamid1b/testng
    settings:
      failed_fails: "10"                     # Threshold for failure rate in percentage
      failed_skips: "100"                    # Threshold for skip rate in percentage
      failure_on_failed_test_config: "false"
      level: info
      report_filename_pattern: ./testng-report.xml
      threshold_mode: percentage
    • The configured failure threshold is 10%, and the actual failure rate (28.57%) exceeds this limit.
    • Since the threshold_mode is percentage, the plugin fails based on the percentage validation.
    • Default: absolute.

  • PLUGIN_FAILURE_ON_FAILED_TEST_CONFIG Description: If true, the build will fail if any configuration method (e.g., @BeforeSuite, @AfterTest) fails. Example: true

  • LOG_LEVEL debug/info Level defines the plugin log level. Set this to debug to see the response from NUnit