Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disables CCIP Load Tests in CI #16494

Merged
merged 7 commits into from
Feb 20, 2025
+12 −51
Merged

Disables CCIP Load Tests in CI #16494

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
c11cb2c
Adds team to CCIP load tests
kalverra Feb 20, 2025
d2a7fe2
Sets CCIP user team for more tests
kalverra Feb 20, 2025
b0df52e
A few more
kalverra Feb 20, 2025
caa840c
Merge branch 'develop' of github.com:smartcontractkit/chainlink into …
kalverra Feb 20, 2025
a9a698c
Disables no-longer-needed CCIP tests
kalverra Feb 20, 2025
147af0b
Merge branch 'develop' of github.com:smartcontractkit/chainlink into …
kalverra Feb 20, 2025
3104df6
Disables load test auto-runs
kalverra Feb 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 2 additions & 42 deletions .github/e2e-tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1227,6 +1227,7 @@ runner-test-matrix:
test_cmd: cd integration-tests/ccip-tests/smoke && go test -test.run ^TestSmokeCCIPForBidirectionalLane$ -timeout 30m -count=1 -test.parallel=1 -json
test_env_vars:
E2E_TEST_SELECTED_NETWORK: SIMULATED_1,SIMULATED_2
CHAINLINK_USER_TEAM: CCIP
test_config_override_path: integration-tests/ccip-tests/testconfig/tomls/leader-lane.toml

- id: ccip-tests/smoke/ccip_test.go:^TestSmokeCCIPTokenPoolRateLimits$
Expand Down Expand Up @@ -1345,34 +1346,6 @@ runner-test-matrix:
CHAINLINK_USER_TEAM: CCIP
test_config_override_path: integration-tests/ccip-tests/testconfig/tomls/ccip-reorg.toml

- id: integration-tests/ccip-tests/load/ccip_test.go:TestLoadCCIPStableRPS
path: integration-tests/ccip-tests/load/ccip_test.go
test_env_type: k8s-remote-runner
runs_on: ubuntu-latest
test_cmd: cd integration-tests/ccip-tests/load && DETACH_RUNNER=false go test -test.run ^TestLoadCCIPStableRPS$ -timeout 70m -count=1 -test.parallel=1 -json
test_env_vars:
TEST_SUITE: ccip-load
E2E_TEST_GRAFANA_DASHBOARD_URL: "/d/6vjVx-1V8/ccip-long-running-tests"
triggers:
- E2E CCIP Load Tests
test_artifacts_on_failure:
- ./integration-tests/load/logs/payload_ccip.json

# Enable when CCIP-2277 is resolved
#
# - id: integration-tests/ccip-tests/load/ccip_test.go:TestLoadCCIPStableRPSAfterARMCurseAndUncurse
# path: integration-tests/ccip-tests/load/ccip_test.go
# test_env_type: k8s-remote-runner
# runs_on: ubuntu-latest
# test_cmd: cd integration-tests/ccip-tests/load && DETACH_RUNNER=false go test -test.run $TestLoadCCIPStableRPSAfterARMCurseAndUncurse$ -timeout 70m -count=1 -test.parallel=1 -json
# test_config_override_path: integration-tests/ccip-tests/testconfig/tomls/load-with-arm-curse-uncurse.toml
# test_env_vars:
# E2E_TEST_GRAFANA_DASHBOARD_URL: "/d/6vjVx-1V8/ccip-long-running-tests"
# triggers:
# - E2E CCIP Load Tests
# test_artifacts_on_failure:
# - ./integration-tests/load/logs/payload_ccip.json

- id: ccip-tests/chaos/ccip_test.go
path: integration-tests/ccip-tests/chaos/ccip_test.go
test_env_type: k8s-remote-runner
Expand All @@ -1384,19 +1357,6 @@ runner-test-matrix:
TEST_SUITE: chaos
TEST_TRIGGERED_BY: ccip-cron-chaos-eth
TEST_LOG_LEVEL: debug

- id: ccip-tests/load/ccip_test.go:^TestLoadCCIPStableWithPodChaosDiffCommitAndExec
path: integration-tests/ccip-tests/load/ccip_test.go
test_env_type: k8s-remote-runner
runs_on: ubuntu-latest
triggers:
# Disabled until CCIP-2555 is resolved
# - E2E CCIP Chaos Tests
test_cmd: cd integration-tests/ccip-tests/load && DETACH_RUNNER=false go test -run '^TestLoadCCIPStableWithPodChaosDiffCommitAndExec' -v -test.parallel=4 -timeout 120m -count=1 -json
test_env_vars:
TEST_SUITE: chaos
TEST_TRIGGERED_BY: ccip-cron-chaos-eth
TEST_LOG_LEVEL: debug
E2E_TEST_GRAFANA_DASHBOARD_URL: /d/6vjVx-1V8/ccip-long-running-tests
CHAINLINK_USER_TEAM: CCIP

# END: CCIP tests
19 changes: 10 additions & 9 deletions .github/workflows/ccip-load-tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,13 +1,14 @@
# CCIP rarely runs these anymore. Leaving for now, but can likely be removed in the future.
name: CCIP Load Test
on:
push:
paths:
- '**/*ccip*'
- '**/*ccip*/**'
branches:
- develop
tags:
- '*'
# push:
# paths:
# - '**/*ccip*'
# - '**/*ccip*/**'
# branches:
# - develop
# tags:
# - '*'
workflow_dispatch:
inputs:
test_config_override_path:
Expand Down Expand Up @@ -46,7 +47,7 @@ jobs:
slack_notification_after_tests_channel_id: '#ccip-testing'
slack_notification_after_tests_name: CCIP E2E Load Tests
test_image_suites: ccip-load
team: ${{ inputs.team }}
team: ${{ inputs.team || 'ccip' }}
test_secrets_override_key: ${{ github.event.inputs.test_secrets_override_key }}
secrets:
QA_AWS_REGION: ${{ secrets.QA_AWS_REGION }}
Expand Down
Loading