Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [t0-118] : qos/test_qos_sai.py::TestQosSai fails with sai_qos_tests.ARPpopulate KeyError #17228

Open
dayouliu1 opened this issue Feb 27, 2025 · 0 comments
Labels

Comments

@dayouliu1
Copy link
Contributor

dayouliu1 commented Feb 27, 2025

Issue Type

Bug Report

Description

qos/test_qos_sai.py::TestQosSai does not support a testbed setup with multiple vlans, however, t0-118 topo uses 2 vlans by default.

Issue Details

Run qos/test_qos_sai.py::TestQosSai for t0-118

Impact or Proposed Behavior

qos/test_qos_sai.py::TestQosSai should pass for t0-118

Importance or Severity

Medium

Is it platform specific

generic

Relevant log output

failed on setup with "tests.common.errors.RunAnsibleModuleFail: run module shell failed, Ansible Results =>
failed = True
changed = True
end = 2025-02-24 18:46:04.422372
cmd = /root/env-python3/bin/ptf --test-dir saitests/py3 sai_qos_tests.ARPpopulate --platform-dir ptftests --qlen=10000 --platform remote -t 'router_mac='"'"''"'"';src_server='"'"'10.240.83.68:9092'"'"';port_map_file='"'"'/root/ptf_test_port_map.json'"'"';sonic_asic_type='"'"'broadcom'"'"';sonic_version='"'"'branch.202411-ars.207a9f84-buildimage.origin.202411-nightly-2025.02.22.04.20'"'"';src_dut_index=0;src_asic_index=0;dst_dut_index=0;dst_asic_index=0;dut_username='"'"'admin'"'"';dut_password='"'"'password'"'"';platform_asic='"'"'broadcom'"'"';dst_port_id=0;dst_port_ip='"'"'192.168.0.2'"'"';dst_port_vlan=None;dst_port_2_id=2;dst_port_2_ip='"'"'192.168.0.4'"'"';dst_port_2_vlan=None;dst_port_3_id=3;dst_port_3_ip='"'"'192.168.0.5'"'"';dst_port_3_vlan=None;src_port_id=1;src_port_ip='"'"'192.168.0.3'"'"';src_port_vlan=None;dst_sys_ports={};uplink_port_ids=[];uplink_port_ips=[];uplink_port_names=[];downlink_port_ids=[];downlink_port_ips=[];downlink_port_names=[];testPortIds={0: {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117]}};testPortIps={0: {0: {0: {'"'"'peer_addr'"'"': '"'"'192.168.0.2'"'"'}, 1: {'"'"'peer_addr'"'"': '"'"'192.168.0.3'"'"'}, 2: {'"'"'peer_addr'"'"': '"'"'192.168.0.4'"'"'}, 3: {'"'"'peer_addr'"'"': '"'"'192.168.0.5'"'"'}, 4: {'"'"'peer_addr'"'"': '"'"'192.168.0.6'"'"'}, 5: {'"'"'peer_addr'"'"': '"'"'192.168.0.7'"'"'}, 6: {'"'"'peer_addr'"'"': '"'"'192.168.0.8'"'"'}, 7: {'"'"'peer_addr'"'"': '"'"'192.168.0.9'"'"'}, 8: {'"'"'peer_addr'"'"': '"'"'192.168.0.10'"'"'}, 9: {'"'"'peer_addr'"'"': '"'"'192.168.0.11'"'"'}, 10: {'"'"'peer_addr'"'"': '"'"'192.168.0.12'"'"'}, 11: {'"'"'peer_addr'"'"': '"'"'192.168.0.13'"'"'}, 12: {'"'"'peer_addr'"'"': '"'"'192.168.0.14'"'"'}, 13: {'"'"'peer_addr'"'"': '"'"'192.168.0.15'"'"'}, 14: {'"'"'peer_addr'"'"': '"'"'192.168.0.16'"'"'}, 15: {'"'"'peer_addr'"'"': '"'"'192.168.0.17'"'"'}, 16: {'"'"'peer_addr'"'"': '"'"'192.168.0.18'"'"'}, 17: {'"'"'peer_addr'"'"': '"'"'192.168.0.19'"'"'}, 18: {'"'"'peer_addr'"'"': '"'"'192.168.0.20'"'"'}, 19: {'"'"'peer_addr'"'"': '"'"'192.168.0.21'"'"'}, 20: {'"'"'peer_addr'"'"': '"'"'192.168.0.22'"'"'}, 21: {'"'"'peer_addr'"'"': '"'"'192.168.0.23'"'"'}, 30: {'"'"'peer_addr'"'"': '"'"'192.168.0.32'"'"'}, 31: {'"'"'peer_addr'"'"': '"'"'192.168.0.33'"'"'}, 32: {'"'"'peer_addr'"'"': '"'"'192.168.0.34'"'"'}, 33: {'"'"'peer_addr'"'"': '"'"'192.168.0.35'"'"'}, 34: {'"'"'peer_addr'"'"': '"'"'192.168.0.36'"'"'}, 35: {'"'"'peer_addr'"'"': '"'"'192.168.0.37'"'"'}, 36: {'"'"'peer_addr'"'"': '"'"'192.168.0.38'"'"'}, 37: {'"'"'peer_addr'"'"': '"'"'192.168.0.39'"'"'}, 38: {'"'"'peer_addr'"'"': '"'"'192.168.0.40'"'"'}, 39: {'"'"'peer_addr'"'"': '"'"'192.168.0.41'"'"'}, 40: {'"'"'peer_addr'"'"': '"'"'192.168.0.42'"'"'}, 41: {'"'"'peer_addr'"'"': '"'"'192.168.0.43'"'"'}, 42: {'"'"'peer_addr'"'"': '"'"'192.168.0.44'"'"'}, 43: {'"'"'peer_addr'"'"': '"'"'192.168.0.45'"'"'}, 44: {'"'"'peer_addr'"'"': '"'"'192.168.0.46'"'"'}, 45: {'"'"'peer_addr'"'"': '"'"'192.168.0.47'"'"'}, 46: {'"'"'peer_addr'"'"': '"'"'192.168.0.48'"'"'}, 47: {'"'"'peer_addr'"'"': '"'"'192.168.0.49'"'"'}, 48: {'"'"'peer_addr'"'"': '"'"'192.168.0.50'"'"'}, 49: {'"'"'peer_addr'"'"': '"'"'192.168.0.51'"'"'}, 50: {'"'"'peer_addr'"'"': '"'"'192.168.0.52'"'"'}, 51: {'"'"'peer_addr'"'"': '"'"'192.168.0.53'"'"'}, 52: {'"'"'peer_addr'"'"': '"'"'192.168.0.54'"'"'}, 53: {'"'"'peer_addr'"'"': '"'"'192.168.0.55'"'"'}, 54: {'"'"'peer_addr'"'"': '"'"'192.168.0.56'"'"'}, 55: {'"'"'peer_addr'"'"': '"'"'192.168.0.57'"'"'}, 56: {'"'"'peer_addr'"'"': '"'"'192.168.0.58'"'"'}, 57: {'"'"'peer_addr'"'"': '"'"'192.168.0.59'"'"'}, 58: {'"'"'peer_addr'"'"': '"'"'192.168.0.60'"'"'}, 59: {'"'"'peer_addr'"'"': '"'"'192.168.0.61'"'"'}, 60: {'"'"'peer_addr'"'"': '"'"'192.168.0.62'"'"'}, 61: {'"'"'peer_addr'"'"': '"'"'192.168.0.63'"'"'}, 62: {'"'"'peer_addr'"'"': '"'"'192.168.0.64'"'"'}}}};testbed_type='"'"'t0-118'"'"'' --debug info --log-file /tmp/sai_qos_tests.ARPpopulate.log --socket-recv-size 16384 --test-case-timeout 2000  --disable-ipv6 --disable-vxlan --disable-geneve --disable-erspan --disable-mpls --disable-nvgre
delta = 0:00:39.883507
rc = 1
invocation = {'module_args': {'creates': None, 'executable': None, 'chdir': '/root', 'strip_empty_ends': True, '_raw_params': '/root/env-python3/bin/ptf --test-dir saitests/py3 sai_qos_tests.ARPpopulate --platform-dir ptftests --qlen=10000 --platform remote -t \'router_mac=\'"\'"\'\'"\'"\';src_server=\'"\'"\'10.240.83.68:9092\'"\'"\';port_map_file=\'"\'"\'/root/ptf_test_port_map.json\'"\'"\';sonic_asic_type=\'"\'"\'broadcom\'"\'"\';sonic_version=\'"\'"\'branch.202411-ars.207a9f84-buildimage.origin.202411-nightly-2025.02.22.04.20\'"\'"\';src_dut_index=0;src_asic_index=0;dst_dut_index=0;dst_asic_index=0;dut_username=\'"\'"\'admin\'"\'"\';dut_password=\'"\'"\'password\'"\'"\';platform_asic=\'"\'"\'broadcom\'"\'"\';dst_port_id=0;dst_port_ip=\'"\'"\'192.168.0.2\'"\'"\';dst_port_vlan=None;dst_port_2_id=2;dst_port_2_ip=\'"\'"\'192.168.0.4\'"\'"\';dst_port_2_vlan=None;dst_port_3_id=3;dst_port_3_ip=\'"\'"\'192.168.0.5\'"\'"\';dst_port_3_vlan=None;src_port_id=1;src_port_ip=\'"\'"\'192.168.0.3\'"\'"\';src_port_vlan=None;dst_sys_ports={};uplink_port_ids=[];uplink_port_ips=[];uplink_port_names=[];downlink_port_ids=[];downlink_port_ips=[];downlink_port_names=[];testPortIds={0: {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117]}};testPortIps={0: {0: {0: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.2\'"\'"\'}, 1: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.3\'"\'"\'}, 2: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.4\'"\'"\'}, 3: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.5\'"\'"\'}, 4: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.6\'"\'"\'}, 5: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.7\'"\'"\'}, 6: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.8\'"\'"\'}, 7: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.9\'"\'"\'}, 8: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.10\'"\'"\'}, 9: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.11\'"\'"\'}, 10: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.12\'"\'"\'}, 11: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.13\'"\'"\'}, 12: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.14\'"\'"\'}, 13: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.15\'"\'"\'}, 14: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.16\'"\'"\'}, 15: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.17\'"\'"\'}, 16: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.18\'"\'"\'}, 17: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.19\'"\'"\'}, 18: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.20\'"\'"\'}, 19: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.21\'"\'"\'}, 20: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.22\'"\'"\'}, 21: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.23\'"\'"\'}, 30: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.32\'"\'"\'}, 31: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.33\'"\'"\'}, 32: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.34\'"\'"\'}, 33: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.35\'"\'"\'}, 34: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.36\'"\'"\'}, 35: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.37\'"\'"\'}, 36: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.38\'"\'"\'}, 37: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.39\'"\'"\'}, 38: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.40\'"\'"\'}, 39: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.41\'"\'"\'}, 40: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.42\'"\'"\'}, 41: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.43\'"\'"\'}, 42: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.44\'"\'"\'}, 43: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.45\'"\'"\'}, 44: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.46\'"\'"\'}, 45: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.47\'"\'"\'}, 46: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.48\'"\'"\'}, 47: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.49\'"\'"\'}, 48: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.50\'"\'"\'}, 49: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.51\'"\'"\'}, 50: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.52\'"\'"\'}, 51: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.53\'"\'"\'}, 52: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.54\'"\'"\'}, 53: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.55\'"\'"\'}, 54: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.56\'"\'"\'}, 55: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.57\'"\'"\'}, 56: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.58\'"\'"\'}, 57: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.59\'"\'"\'}, 58: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.60\'"\'"\'}, 59: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.61\'"\'"\'}, 60: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.62\'"\'"\'}, 61: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.63\'"\'"\'}, 62: {\'"\'"\'peer_addr\'"\'"\': \'"\'"\'192.168.0.64\'"\'"\'}}}};testbed_type=\'"\'"\'t0-118\'"\'"\'\' --debug info --log-file /tmp/sai_qos_tests.ARPpopulate.log --socket-recv-size 16384 --test-case-timeout 2000  --disable-ipv6 --disable-vxlan --disable-geneve --disable-erspan --disable-mpls --disable-nvgre', 'removes': None, 'argv': None, 'warn': False, '_uses_shell': True, 'stdin_add_newline': True, 'stdin': None}}
start = 2025-02-24 18:45:24.538865
msg = non-zero return code
_ansible_no_log = None
stdout =
Using packet manipulation module: ptf.packet_scapy

******************************************
ATTENTION: SOME TESTS DID NOT PASS!!!

The following tests errored:
ARPpopulate

******************************************stderr =
/root/env-python3/lib/python3.7/site-packages/scapy/config.py:542: CryptographyDeprecationWarning: Python 3.7 is no longer supported by the Python core team and support for it is deprecated in cryptography. A future release of cryptography will remove support for Python 3.7.
  import cryptography
/root/env-python3/lib/python3.7/site-packages/scapy/layers/ipsec.py:512: CryptographyDeprecationWarning: TripleDES has been moved to cryptography.hazmat.decrepit.ciphers.algorithms.TripleDES and will be removed from cryptography.hazmat.primitives.ciphers.algorithms in 48.0.0.
  cipher=algorithms.TripleDES,
/root/env-python3/lib/python3.7/site-packages/scapy/layers/ipsec.py:516: CryptographyDeprecationWarning: TripleDES has been moved to cryptography.hazmat.decrepit.ciphers.algorithms.TripleDES and will be removed from cryptography.hazmat.primitives.ciphers.algorithms in 48.0.0.
  cipher=algorithms.TripleDES,
sai_qos_tests.ARPpopulate ... ERROR

======================================================================
ERROR: sai_qos_tests.ARPpopulate
----------------------------------------------------------------------
Traceback (most recent call last):
  File "saitests/py3/sai_qos_tests.py", line 770, in runTest
    dst_port_ip = self.test_port_ips[dut_i][asic_i][dst_port_id]
KeyError: 63

----------------------------------------------------------------------

Output of show version

202411

Attach files (if any)

No response

@mssonicbld mssonicbld added the bug label Feb 27, 2025
@dayouliu1 dayouliu1 changed the title [Bug|Enhancement|Test Gap]: [Bug] : qos/test_qos_sai.py::TestQosSai fails with sai_qos_tests.ARPpopulate KeyError Feb 27, 2025
@dayouliu1 dayouliu1 changed the title [Bug] : qos/test_qos_sai.py::TestQosSai fails with sai_qos_tests.ARPpopulate KeyError [Bug] [t0-118] : qos/test_qos_sai.py::TestQosSai fails with sai_qos_tests.ARPpopulate KeyError Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants