eco-gotest:v4.17.0

Release-4.17.0

Number of test cases: 525 ( +75)

Golang version: 1.23
Operator versions: 4.17
k8s libs versions: v0.30.5
k8s.io/kubernetes version: v1.30.5

List of test suites:

• ASSEL:

1. upgrade

• ASSISTED:

1. ztp operator
2. ztp spoke

• CNF

1. core net bfd
2. core net cni
3. core net day1day2
4. core net dpdk
5. core net metallb
6. core net policy
7. core net sriov
8. ran containernshide
9. ran gitopsztp
10. ran powermanagement
11. ran talm

• HW-ACCEL

1. kmm upgrade
2. kmm mcm
3. kmm module
4. nfd features
5. nfd upgrade
6. gpu gpu

• LCA

1. ibu cnf upgrade
2. ibu mgmt negative
3. ibu mgmt upgrade

• RHWA

1. far
2. mdr
3. nmo

• SYSTEM

1. diskencryption
2. ran-du
3. vcore
4. spk
5. rdscore
6. ipsec

What's Changed

• cnf ran: ztp hub templating and node delete migration by @klaskosk in #84
• cnf ran: adding CR reporting to powermanagement by @klaskosk in #93
• cnf ran: add reporting for CRs on each cluster by @klaskosk in #90
• cnf ran: ztp policies app and machine config migration by @klaskosk in #96
• cnf-network: Tests for the SR-IOV Expose MTU feature by @evgenLevin in #95
• cnf network: QinQ TC update by @ajaggapa in #102
• cnf ran: ztp generator and spoke checker migration by @klaskosk in #101
• system-tests: update test suites to use eco-goinfra's bmc by @greyerof in #19
• cnf ran: ztp generator tweaks based on testing by @klaskosk in #104
• deps: bump eco-goinfra to v0.0.0-20240719152154-1785516033a2 by @trewest in #106
• cnf ran: add secret creation to ztp hub templating by @klaskosk in #108
• vCore: logging operator test refactoring, switch from the elasticsearch to the loki + internal odf fix by @elenagerman in #107
• vCore: adjustments for the remote cmd and homedir by @elenagerman in #109
• vCore: execute oc cmd on the hypervisor instead of container by @elenagerman in #110
• infra: remove url package duplication by @kononovn in #105
• hwaccel: change log test by @ggordaniRed in #99
• vCore: create templates directly on the hyperviser by @elenagerman in #111
• vCore: separate odf from the main run by @elenagerman in #112
• accel: add internal folder by @siserafin in #113
• vCore: fix helm redis deployment failure by @elenagerman in #114
• deps: bump eco-goinfra to v0.0.0-20240723150001-514ea49f5511 by @trewest in #115
• system-test: handle error while listing pods by @yprokule in #117
• vCore: loki: increase pvc creation timeout by @elenagerman in #118
• assisted ztp: add operator suite test namespaces to reporter by @trewest in #120
• cnf ran: ztp reporting and improvements by @klaskosk in #119
• deps: bump eco-goinfra to v0.0.0-20240726142624-8eb62208ad75 by @kononovn in #122
• accel: add ocp upgrade test by @siserafin in #116
• bump eco-goinfra to v0.0.0-20240731154756-d6b470ae81c2 by @kononovn in #130
• cnf ran: image registry CR report and spoke checker fix by @klaskosk in #125
• cnf ran: disable talm backup tests for 4.16+ by @klaskosk in #126
• assisted ztp: increased timeout for flaky tests by @trewest in #131
• lca: increase the scope of seedimage pkg by @trewest in #133
• bump eco-goinfra to v0.0.0-20240806143944-e49acf61eb1b by @kononovn in #134
• cnf-network:MetalLB: speaker pods replaced by frr-8ks pods by @evgenLevin in #124
• cnf ran: rename ztp directory to ran-ztp by @klaskosk in #136
• assisted ztp: increase timeouts for platform and trustbundle tests by @trewest in #139
• vcore: odf nodes usage refactoring by @elenagerman in #140
• vcore: change ObjectBucketClaim storageClass noobaa -> ceph-rgw by @elenagerman in #142
• vcore: odf pv creation, cnt verification adjustment by @elenagerman in #143
• noobaa: increase configmap timeout by @elenagerman in #144
• system-tests: ran-du hard reboot clean up ipmitools image by @mcornea in #141
• cnf-network: Added logLevel to SriovNetworks by @evgenLevin in #127
• bump: eco-goinfra v0.0.0-20240809133315-01bbbf4c9ede by @edcdavid in #145
• bump: eco-goinfra v0.0.0-20240809150049-0634a7a9fb27 by @kononovn in #146
• vcore: odf, reduce maxDeviceCount value by @elenagerman in #147
• bump: eco-goinfra v0.0.0-20240809175523-08d2ee10447b by @kononovn in #148
• vcore: refactoring for the redis and odf nodes by @elenagerman in #149
• vcore: odf, increase pv timeout by @elenagerman in #151
• bump: eco-goinfra v0.0.0-20240812145528-915aa75bfdb6 by @kononovn in #152
• odf: storage adjustments by @elenagerman in #153
• vcore: storage switch to the nfs, single storageClass by @elenagerman in #154
• system-test: refactor KernelCrashKdump function by @yprokule in #155
• ibi mgmt: add directory structure for ibi tests by @trewest in #138
• bump: eco-goinfra v0.0.0-20240813134610-7cfb14e1ce75 by @edcdavid in #156
• system-test: KDump tests for RDS Core by @yprokule in #157
• global: move internal ran functions to global scope by @edcdavid in #128
• vcore: exclude odf deployment from the general test suite by @elenagerman in #159
• cnf ran: reorganize powermanagement helpers by @klaskosk in #160
• vcore: separate lso from the odf by @elenagerman in #164
• Samsung ODF: move label and taints test to the lso package by @elenagerman in #165
• vcore: fix verification statement by @elenagerman in #166
• vCore: add timeout for getting redis ns fsGroup value by @elenagerman in #167
• vCore: sleep added before pv creation stage to avoid failure by @elenagerman in #168
• Refactor IPSec tests for SNO, SNO+1, and MNO by @bradyallenjohnson in #169
• vCore: increase loki and odf timeouts by @elenagerman in #171
• cnf-network: fixed reportxml ID for the expose MTU test by @evgenLevin in #163
• global: fail fast on retry errors by @klaskosk in #162
• bump: eco-goinfra v0.0.0-20240819205434-62b2119d4777 by @klaskosk in #172
• RDS Core: IPVLAN connectivity test added by @elenagerman in #150
• vCore odf: increase more odf/lso/loki timeouts by @elenagerman in #175
• system-test: Extend polling interval for kdump tests by @yprokule in #176
• system-test: use dedicated IPVLAN NADs per test by @yprokule in #177
• system-tests: new test for disk encryption with support for TMPv2 PCR protection by @edcdavid in #129
• vCore: increased redis ns object timeout + debug log added by @elenagerman in #179
• cnf-network: fixed Metallb metric tests by @evgenLevin in https:/...

eco-gotest:v4.16.0

Release-4.16.0

Number of test cases: 450 ( +155)

Golang version: 1.22
Operator versions: 4.16
k8s libs versions: v0.29.4
k8s.io/kubernetes version: v1.29.4

List of test suites:

• ASSISTED:

1. ztp operator
2. ztp spoke

• CNF

1. core net bfd
2. core net cni
3. core net day1day2
4. core net dpdk
5. core net metallb
6. core net policy
7. core net sriov
8. ran containernshidenshide
9. ran powermanagement
10. ran talm
11. ran ztp

• HW-ACCEL

1. kmm upgrade
2. kmm mcm
3. kmm module
4. nfd features
5. nfd upgrade
6. gpu gpudeploy

• LCA

1. imagebasedupgrade upgrade-talm
2. mgmt negative
3. mgmt upgrade

• RHWA

1. far
2. mdr
3. nmo

• SYSTEM

1. ran-du
2. vcore
3. spk
4. rdscore
5. ipsec

What's Changed

• ci: switch to ubuntu-latest runner by @kononovn in #2
• ci: switch docker-images ci to setup-qemu-action@v3 by @kononovn in #3
• ci: update docker-image-ci.yml ran-du push action by @kononovn in #4
• ci: fix minor issue with ran-du image building by @kononovn in #5
• ci: fix registry link by @kononovn in #6
• ci: remove invalid parameters from image step by @kononovn in #7
• ibu mgmt: add proxy test to upgrade suite by @trewest in #1
• cnf ran: fixed some talm robustness issues by @klaskosk in #15
• ibu mgmt: remove workaround for lca backup/restore bug by @trewest in #16
• ibu mgmt: update proxy tests to ignore no_proxy by @trewest in #18
• ibu cnf: add prep abort test case by @mpmaruthu in #13
• cnf-test: exmanaged: added sleep time to workaround issue with nmstate ds by @evgenLevin in #11
• cnf network: add qinq second PR multi-cvlans by @gkopels in #10
• ci: update checkout to v4 by @sebrandon1 in #20
• Update Go to v1.22.4 by @sebrandon1 in #23
• mgmt ibu: add negative test suite by @trewest in #26
• ready-for-final-review: ibu cnf: add upgrade abort test case by @mpmaruthu in #14
• ibu cnf: post upgrade validations by @mcornea in #12
• system-test: Refactor methods for PVC tests by @yprokule in #30
• cnf ran: talm precache excluded image fix by @klaskosk in #28
• bump: updates all libs to the latest versions by @kononovn in #32
• hw-accel: fix KMM test by @cdvultur in #34
• deps: update github.com/containernetworking/cni module by @trewest in #36
• system-tests: update ran-du reboot tests by @mcornea in #39
• system-tests: wait for SriovFecNodeConfig resource to be configured by @mcornea in #40
• system-test: sleep 90 seconds between runs by @yprokule in #41
• hw-accel: use multi-stage image in firmware test by @cdvultur in #38
• assisted ztp: add disruptive label to operator tests by @trewest in #33
• system-test: remove RBD deployment pre-requisite by @yprokule in #42
• lca: add negative test for patching the stage from idle to rollback. by @achuzhoy in #37
• ibu cnf: add 'rollback after a successful upgrade' test by @mpmaruthu in #45
• lca: Adding coverage for idle to upgrade negative test. by @achuzhoy in #46
• cnf network: add qinq dpdk tc by @gkopels in #25
• Added tests for reserved core frequency tuning by @josclark42 in #35
• vCore: SR-IOV verification test suite added by @elenagerman in #44
• lca: add negative test for patching the stage from prep to rollback. by @achuzhoy in #50
• system-test: added tests for NNCP and Policies by @yprokule in #53
• system-test: test workloads with different SR-IOV networks by @yprokule in #55
• system-tests: parameterize StorageClass names by @yprokule in #57
• lca: cnf exclude operators and sriov nnp from post validation checks by @mcornea in #56
• lca: cnf retry kcat command execution by @mcornea in #58
• lca: negative test to cover unsupported stage update. by @achuzhoy in #52
• ibu mgmt: move backup/restore tasks to separate utility by @trewest in #47
• deps: bump eco-goinfra to 1f702e37c052 by @trewest in #59
• ibu mgmt: add missing dpa test by @trewest in #62
• cnf network: add qinq nmstate test case by @gkopels in #49
• vCore: keda test suite by @elenagerman in #63
• ibu mgmt: fix backup storage location by @trewest in #66
• ready-for-final-review: ibu cnf: add 'rollback after a failed upgrade' test by @mpmaruthu in #29
• system-tests: ran-du: force delete guaranteed pod by @mcornea in #60
• cnf network: update Dockerfile for dpdk client image by @ajaggapa in #67
• ibu mgmt: move the set to idle to after all. by @achuzhoy in #68
• system-test: deploy workload with RBD volumes by @yprokule in #64
• Add stability tests for ran du by @rlmanrique in #61
• lca: cnf: Retry seed image info retrieval in post validations by @mcornea in #70
• vCore: numa test suite by @elenagerman in #69
• system-test: Documentation for tests parameters by @yprokule in #71
• system-test: update parameters by @yprokule in #73
• system-test: Unify delete workload mechanism in ran du tests by @rlmanrique in #74
• system-test: verify SR-IOV post cluster reboot by @yprokule in #77
• system-test: Enable ptp checks in existing test cases by @rlmanrique in #75
• lca: cnf: fix rollback-after-failed-upgrade-test by @mcornea in #78
• cnf ran: ztp test migration preliminaries by @klaskosk in #72
• Add Version Check to Reserved Core Freqency Tuning Test. Fix and move CompareOCPVersionWithCurrent() by @josclark42 in #51
• lca: cnf: wait for ibu idle stage after finalize cgu by @mcornea in #79
• sytem-tests: Add retries to PTP validations by @rlmanrique in #80
• cnf network: fix-dpdk-test-case by @gkopels in #76
• system-tests: ran-du: add tuned restarts check to stability tests by @mcornea in #82
• cnf ran: remove cat hack from powersave by @klaskosk in #43
• cnf ran: ztp acm crs and clusters app tests by @klaskosk in #81
• system-tests: increase ptp retries by @rlmanrique in #85
• system-tests: use different file names for tuned stability checks by @mcornea in #88
• IPSec System Test troubleshooting guide by @bradyallenjohnson in #89
• Revise Polarion Test Case IDs in TALM tests by @josclark42 in #91
• system-tests: ran_du store ptp logs in case of failure by @rlmanrique in #92

New Contributors

• @trewest made their first contribution in #1
• @klaskosk made their first contribution in #15
• @mpmaruthu made their first contribution in https...

eco-gotest:v4.15.0

Release-4.15.0

Number of test cases: 295 ( +178)

Golang version: 1.20
Operator versions: 4.15
k8s libs versions: v0.27.8
k8s.io/kubernetes version: v1.28.7

List of test suites:

• ASSISTED:

1. ztp operator
2. ztp spoke

• CNF

1. core net cni
2. core net day1day2
3. core net dpdk
4. core net metallb
5. core net policy
6. core net sriov

• HW-ACCEL

1. kmm upgrade
2. kmm mcm
3. kmm module
4. nfd feature
5. gpu gpu

• RHWA

1. far
2. mdr
3. nmo

• SYSTEM

1. ran-du
2. vcore
3. spk
4. rdscore

New Contributors

• @sebrandon1 made their first contribution in https://github.com/openshift-kni/eco-gotests/pull/524
• @shaior made their first contribution in https://github.com/openshift-kni/eco-gotests/pull/534
• @rlmanrique made their first contribution in https://github.com/openshift-kni/eco-gotests/pull/570

eco-gotest:v4.14.0

Release-4.14.0

Number of test cases: 117

Golang version: 1.20
Operator versions: 4.14
k8s libs versions: v0.27.4
k8s.io/kubernetes version: v1.27.4

List of test suites:

• ASSISTED:

1. ztp operator
2. ztp spoke

• CNF

1. core net cni
2. core net day1day2
3. core net dpdk
4. core net metallb

• HW-ACCEL

1. kmm module
2. nfd feature
3. gpu gpu

• RHWA

1. far
2. mdr
3. nmo

• SYSTEM

1. randu
2. spk

Link to container: quay.io/ocp-edge-qe/eco-gotests:v4.14.0

eco-gotests:v4.13.0

Release-4.13.0
Number of test cases: 19
List of test suites: cnf metallb, ztp operator, ztp spoke, kmm modules, nvidiagpu gpudeploy