Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates flakeguard for better data reporting #16269

Merged
merged 2 commits into from
Feb 7, 2025
Merged

Updates flakeguard for better data reporting #16269

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
38214b8
Updates flakeguard for better data reporting
kalverra Feb 6, 2025
783b696
Rename summary file
kalverra Feb 6, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 5 additions & 7 deletions .github/workflows/flakeguard.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ jobs:
- name: Install flakeguard
if: ${{ inputs.runAllTests == false }}
shell: bash
run: go install github.com/smartcontractkit/chainlink-testing-framework/tools/flakeguard@051b483f1e9e99b0219d1ccea4d8f7bf3be203b7 # [email protected]
run: go install github.com/smartcontractkit/chainlink-testing-framework/tools/flakeguard@6d6c1b28224c181f0925bf0d5ce169a830d3dad7 # [email protected]

- name: Find new or updated test packages
if: ${{ inputs.runAllTests == false && env.RUN_CUSTOM_TEST_PACKAGES == '' }}
Expand Down Expand Up @@ -334,7 +334,7 @@ jobs:

- name: Install flakeguard
shell: bash
run: go install github.com/smartcontractkit/chainlink-testing-framework/tools/flakeguard@051b483f1e9e99b0219d1ccea4d8f7bf3be203b7 # [email protected]
run: go install github.com/smartcontractkit/chainlink-testing-framework/tools/flakeguard@6d6c1b28224c181f0925bf0d5ce169a830d3dad7 # [email protected]

- name: Run tests with flakeguard
shell: bash
Expand Down Expand Up @@ -411,7 +411,7 @@ jobs:

- name: Install flakeguard
shell: bash
run: go install github.com/smartcontractkit/chainlink-testing-framework/tools/flakeguard@051b483f1e9e99b0219d1ccea4d8f7bf3be203b7 # [email protected]
run: go install github.com/smartcontractkit/chainlink-testing-framework/tools/flakeguard@6d6c1b28224c181f0925bf0d5ce169a830d3dad7 # [email protected]

- name: Aggregate Flakeguard Results
id: results
Expand Down Expand Up @@ -454,10 +454,10 @@ jobs:

# Print out the summary file
echo -e "\nFlakeguard Summary:"
jq . ./flakeguard-report/all-test-summary.json
jq .summary_data ./flakeguard-report/all-test-results.json

# Read the summary from the generated report
summary=$(jq -c '.' ./flakeguard-report/all-test-summary.json)
summary=$(jq -c '.summary_data' ./flakeguard-report/all-test-results.json)
echo "summary=$summary" >> $GITHUB_OUTPUT

- name: Upload All Test Results as Artifact
Expand Down Expand Up @@ -503,7 +503,6 @@ jobs:
if [ "$GH_EVENT_NAME" = "pull_request" ]; then
flakeguard generate-report \
--aggregated-results-path ./flakeguard-report/all-test-results.json \
--summary-path ./flakeguard-report/all-test-summary.json \
--output-path ./flakeguard-report \
--github-repository "${{ github.repository }}" \
--github-run-id "${{ github.run_id }}" \
Expand All @@ -518,7 +517,6 @@ jobs:
else
flakeguard generate-report \
--aggregated-results-path ./flakeguard-report/all-test-results.json \
--summary-path ./flakeguard-report/all-test-summary.json \
--output-path ./flakeguard-report \
--github-repository "${{ github.repository }}" \
--github-run-id "${{ github.run_id }}" \
Expand Down
Loading