Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Debug CCIP Load Test in E2E Workflow Conversion #14479

Merged
merged 13 commits into from
Sep 19, 2024
Merged

Debug CCIP Load Test in E2E Workflow Conversion #14479

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
5d53445
Use K8s config
kalverra Sep 18, 2024
e17e4b0
Disable detach runner
kalverra Sep 18, 2024
07764ce
Check if detach is what breaks it?
kalverra Sep 18, 2024
9568668
I guess it did?
kalverra Sep 18, 2024
17e077d
Add test image suites to run
kalverra Sep 18, 2024
3022e8b
Suite name get around
kalverra Sep 18, 2024
b785579
Proper rename
kalverra Sep 18, 2024
37181d2
Merge branch 'TT-1550-Provide-PoC-for-keeping-test-configs-in-git' in…
lukaszcl Sep 19, 2024
84d2744
Fix
lukaszcl Sep 19, 2024
d587a15
Merge branch 'TT-1550-Provide-PoC-for-keeping-test-configs-in-git' in…
lukaszcl Sep 19, 2024
d75d0ca
remove DEBUG: Debugging new execution
lukaszcl Sep 19, 2024
d30d66d
Remove debug
kalverra Sep 19, 2024
2ad9fd1
Merge branch 'fixCCIPLoadTest' of github.com:smartcontractkit/chainli…
kalverra Sep 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions .github/e2e-tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1047,9 +1047,9 @@ runner-test-matrix:

- id: integration-tests/ccip-tests/load/ccip_test.go:TestLoadCCIPStableRPS
path: integration-tests/ccip-tests/load/ccip_test.go
test_env_type: docker
test_env_type: k8s-remote-runner
runs_on: ubuntu-latest
test_cmd: cd integration-tests/ccip-tests/load && go test -test.run TestLoadCCIPStableRPS -timeout 70m -count=1 -test.parallel=1 -json
test_cmd: cd integration-tests/ccip-tests/load && DETACH_RUNNER=false go test -test.run ^TestLoadCCIPStableRPS$ -timeout 70m -count=1 -test.parallel=1 -json
test_env_vars:
E2E_TEST_GRAFANA_DASHBOARD_URL: "/d/6vjVx-1V8/ccip-long-running-tests"
workflows:
Expand All @@ -1061,9 +1061,9 @@ runner-test-matrix:
#
# - id: integration-tests/ccip-tests/load/ccip_test.go:TestLoadCCIPStableRPSAfterARMCurseAndUncurse
# path: integration-tests/ccip-tests/load/ccip_test.go
# test_env_type: docker
# test_env_type: k8s-remote-runner
# runs_on: ubuntu-latest
# test_cmd: cd integration-tests/ccip-tests/load && go test -test.run $TestLoadCCIPStableRPSAfterARMCurseAndUncurse$ -timeout 70m -count=1 -test.parallel=1 -json
# test_cmd: cd integration-tests/ccip-tests/load && DETACH_RUNNER=false go test -test.run $TestLoadCCIPStableRPSAfterARMCurseAndUncurse$ -timeout 70m -count=1 -test.parallel=1 -json
# test_config_override_path: integration-tests/ccip-tests/testconfig/tomls/load-with-arm-curse-uncurse.toml
# test_env_vars:
# E2E_TEST_GRAFANA_DASHBOARD_URL: "/d/6vjVx-1V8/ccip-long-running-tests"
Expand Down
5 changes: 3 additions & 2 deletions .github/workflows/run-e2e-tests-reusable-workflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -767,6 +767,7 @@ jobs:
uses: smartcontractkit/chainlink-github-actions/chainlink-testing-framework/run-tests@4f377a6b1cc07f0eca82745782736b4908a1da30 # v2.3.32
env:
DETACH_RUNNER: true
TEST_SUITE: ${{ inputs.test_image_suites }}
RR_MEM: ${{ matrix.tests.remote_runner_memory }}
TEST_ARGS: -test.timeout 900h -test.memprofile memprofile.out -test.cpuprofile profile.out
ENV_JOB_IMAGE: ${{ secrets.QA_AWS_ACCOUNT_NUMBER }}.dkr.ecr.${{ secrets.QA_AWS_REGION }}.amazonaws.com/chainlink-tests:${{ needs.get-remote-runner-test-image.outputs.remote-runner-version }}
Expand Down Expand Up @@ -880,13 +881,13 @@ jobs:
{
"attachments": [
{
"color": "${{ contains(join(needs.*.result, ','), 'failure') && '#C62828' || contains(join(needs.*.result, ','), 'cancelled') && '#FFA000' || '2E7D32' }}",
"color": "${{ contains(join(needs.*.result, ','), 'failure') && '#C62828' || contains(join(needs.*.result, ','), 'cancelled') && '#FFA000' || contains(join(needs.*.result, ','), 'skipped') && '#FFA000' || '2E7D32' }}",
"blocks": [
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "${{ inputs.slack_notification_after_tests_name }} - ${{ contains(join(needs.*.result, ','), 'failure') && 'Failed :x:' || contains(join(needs.*.result, ','), 'cancelled') && 'Cancelled :warning:' || 'Passed :white_check_mark:' }}"
"text": "${{ inputs.slack_notification_after_tests_name }} - ${{ contains(join(needs.*.result, ','), 'failure') && 'Failed :x:' || contains(join(needs.*.result, ','), 'cancelled') && 'Cancelled :warning:' || contains(join(needs.*.result, ','), 'skipped') && 'Skipped :warning:' || 'Passed :white_check_mark:' }}"
}
},
{
Expand Down
1 change: 1 addition & 0 deletions integration-tests/scripts/buildTests
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ do
elif [ "$x" = "ccip-load" ]; then
echo "Changing directory and executing go test -c ./... for 'ccip-load' package"
pushd "./ccip-tests/load" && go test -c -tags embed -o ../ ./...
mv ../load.test ../ccip-load.test # rename the binary to match the suite name
popd
else
go test -c -tags embed ./"${x}"
Expand Down
Loading