Skip to content

Commit

Permalink
Temporarily skip qos and pfcwd test scripts in PR testing (sonic-net#…
Browse files Browse the repository at this point in the history
…15897)

What is the motivation for this PR?
Since the test scripts for qos and pfcwd are not yet included in PR testing, we have temporarily applied conditional marks to skip them. Once these scripts are integrated into PR testing, this PR can be reverted.

How did you do it?

How did you verify/test it?
  • Loading branch information
yutongzhang-microsoft authored Dec 9, 2024
1 parent 700c02b commit 6590c66
Showing 1 changed file with 73 additions and 0 deletions.
73 changes: 73 additions & 0 deletions tests/common/plugins/conditional_mark/tests_mark_conditions.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1357,6 +1357,19 @@ pfcwd/test_pfcwd_all_port_storm.py:
conditions:
- "hwsku in ['Arista-7060X6-64PE-256x200G']"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

pfcwd/test_pfcwd_cli.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

pfcwd/test_pfcwd_function.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

pfcwd/test_pfcwd_function.py::TestPfcwdFunc::test_pfcwd_no_traffic:
skip:
Expand All @@ -1365,6 +1378,13 @@ pfcwd/test_pfcwd_function.py::TestPfcwdFunc::test_pfcwd_no_traffic:
conditions:
- "asic_type != 'cisco-8000'"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

pfcwd/test_pfcwd_timer_accuracy.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

pfcwd/test_pfcwd_warm_reboot.py:
skip:
Expand All @@ -1374,6 +1394,7 @@ pfcwd/test_pfcwd_warm_reboot.py:
- "'t2' in topo_name"
- "'standalone' in topo_name"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"
xfail:
reason: "Warm Reboot is not supported in dualtor and has a known issue on 202305 branch"
conditions:
Expand All @@ -1395,6 +1416,7 @@ process_monitoring/test_critical_process_monitoring.py::test_orchagent_heartbeat
qos:
skip:
reason: "M0/MX topo does not support qos"
conditions_logical_operator: or
conditions:
- "topo_type in ['m0', 'mx']"

Expand Down Expand Up @@ -1422,6 +1444,25 @@ qos/test_buffer_traditional.py:
conditions:
- "release not in ['201911']"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

qos/test_ecn_config.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

qos/test_pfc_counters.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

qos/test_pfc_pause.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

qos/test_pfc_pause.py::test_pfc_pause_lossless:
# For this test, we use the fanout connected to the DUT to send PFC pause frames.
Expand All @@ -1438,6 +1479,10 @@ qos/test_qos_dscp_mapping.py:
strict: True
conditions:
- "asic_type in ['cisco-8000'] and platform in ['x86_64-8122_64eh_o-r0']"
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping_pipe_mode:
skip:
Expand All @@ -1447,6 +1492,7 @@ qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to
- "asic_type in ['mellanox', 'broadcom', 'cisco-8000']"
- https://github.com/sonic-net/sonic-mgmt/issues/12906
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

qos/test_qos_masic.py:
skip:
Expand All @@ -1455,6 +1501,7 @@ qos/test_qos_masic.py:
conditions:
- "is_multi_asic==False or topo_name not in ['t1-lag', 't1-64-lag', 't1-56-lag', 't1-backend']"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

qos/test_qos_sai.py:
skip:
Expand All @@ -1463,6 +1510,7 @@ qos/test_qos_sai.py:
conditions:
- "asic_type in ['barefoot'] and topo_name in ['t1']"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai:
skip:
Expand All @@ -1471,6 +1519,7 @@ qos/test_qos_sai.py::TestQosSai:
conditions:
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "topo_type in ['m0', 'mx']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testIPIPQosSaiDscpToPgMapping:
skip:
Expand All @@ -1481,6 +1530,7 @@ qos/test_qos_sai.py::TestQosSai::testIPIPQosSaiDscpToPgMapping:
- https://github.com/sonic-net/sonic-mgmt/issues/12906
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testPfcStormWithSharedHeadroomOccupancy:
skip:
Expand All @@ -1490,6 +1540,7 @@ qos/test_qos_sai.py::TestQosSai::testPfcStormWithSharedHeadroomOccupancy:
- "asic_type in ['cisco-8000']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiBufferPoolWatermark:
skip:
Expand All @@ -1499,6 +1550,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiBufferPoolWatermark:
- "platform in ['x86_64-nokia_ixr7250e_36x400g-r0', 'x86_64-arista_7800r3_48cq2_lc', 'x86_64-arista_7800r3_48cqm2_lc', 'x86_64-arista_7800r3a_36d2_lc', 'x86_64-arista_7800r3a_36dm2_lc','x86_64-arista_7800r3ak_36dm2_lc']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiDot1pPgMapping:
skip:
Expand All @@ -1508,6 +1560,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiDot1pPgMapping:
- "'backend' not in topo_name"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiDot1pQueueMapping:
skip:
Expand All @@ -1517,6 +1570,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiDot1pQueueMapping:
- "'backend' not in topo_name"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiDscpQueueMapping:
skip:
Expand All @@ -1526,6 +1580,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiDscpQueueMapping:
- "'backend' in topo_name"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiDscpToPgMapping:
skip:
Expand All @@ -1535,6 +1590,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiDscpToPgMapping:
- "'backend' in topo_name"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiDwrrWeightChange:
skip:
Expand All @@ -1544,6 +1600,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiDwrrWeightChange:
- "asic_type in ['mellanox']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiFullMeshTrafficSanity:
skip:
Expand All @@ -1553,6 +1610,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiFullMeshTrafficSanity:
- "asic_type not in ['cisco-8000'] or topo_name not in ['ptf64']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiHeadroomPoolSize:
skip:
Expand All @@ -1565,6 +1623,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiHeadroomPoolSize:
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "'t2' in topo_name and asic_subtype in ['broadcom-dnx']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiHeadroomPoolWatermark:
skip:
Expand All @@ -1576,6 +1635,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiHeadroomPoolWatermark:
and https://github.com/sonic-net/sonic-mgmt/issues/12292 and hwsku in ['Force10-S6100'] and topo_type in ['t1-64-lag']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"
xfail:
reason: "Headroom pool size not supported."
conditions:
Expand All @@ -1589,6 +1649,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiLosslessVoq:
- "asic_type not in ['cisco-8000'] or platform in ['x86_64-8122_64eh_o-r0']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiLossyQueueVoq:
skip:
Expand All @@ -1598,6 +1659,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiLossyQueueVoq:
- "asic_type not in ['cisco-8000'] or platform in ['x86_64-8122_64eh_o-r0']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiLossyQueueVoqMultiSrc:
skip:
Expand All @@ -1607,6 +1669,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiLossyQueueVoqMultiSrc:
- "asic_type not in ['cisco-8000'] or platform in ['x86_64-8122_64eh_o-r0']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiPGDrop:
skip:
Expand All @@ -1616,6 +1679,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiPGDrop:
- "asic_type not in ['cisco-8000'] or platform in ['x86_64-8122_64eh_o-r0']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiPgHeadroomWatermark:
skip:
Expand All @@ -1625,6 +1689,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiPgHeadroomWatermark:
- "asic_type in ['cisco-8000'] and platform not in ['x86_64-8122_64eh_o-r0']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiPgSharedWatermark[None-wm_pg_shared_lossy]:
xfail:
Expand All @@ -1640,6 +1705,7 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiQWatermarkAllPorts:
- "asic_type not in ['cisco-8000']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_qos_sai.py::TestQosSai::testQosSaiSharedReservationSize:
skip:
Expand All @@ -1649,6 +1715,13 @@ qos/test_qos_sai.py::TestQosSai::testQosSaiSharedReservationSize:
- "asic_type not in ['cisco-8000'] or platform in ['x86_64-8122_64eh_o-r0']"
- "topo_type in ['m0', 'mx']"
- "topo_name not in ['t0', 't0-64', 't0-116', 't0-35', 't0-56', 't0-standalone-32', 't0-standalone-64', 't0-standalone-128', 't0-standalone-256', 'dualtor-56', 'dualtor-120', 'dualtor', 't0-80', 't0-backend', 't1-lag', 't1-64-lag', 't1-56-lag', 't1-backend', 't2', 't2_2lc_36p-masic', 't2_2lc_min_ports-masic'] and asic_type not in ['mellanox']"
- "asic_type in ['vs']"

qos/test_tunnel_qos_remap.py:
skip:
reason: "Temporarily skip in PR testing"
conditions:
- "asic_type in ['vs']"

qos/test_tunnel_qos_remap.py::test_pfc_watermark_extra_lossless_active:
xfail:
Expand Down

0 comments on commit 6590c66

Please sign in to comment.