[tests/mclag] Submit mclag testcases according to mclagtest plan by freeman386 · Pull Request #1237 · sonic-net/sonic-mgmt

freeman386 · 2019-11-26T09:23:44Z

Description of PR

Summary:
Submit MCLAG testcases according to mclag test plan [Azure/SONiC/pull/422].

It works together with below PRs:

MCLAG feature for SONIC [Azure/sonic-buildimage/pull/2514]

Type of change

[] Bug fix
[] Testbed and Framework(new/improvement)
Test case(new/improvement)

Approach

How did you do it?

mclag test on test_scenario L2

root@sonic-mgmt:/var/root/sonic-mgmt-main/tests# pytest -vvv --disable_loganalyzer --inventory veos --host-pattern all --user admin --testbed vms-t0-mclag-16 --testbed_file testbed.csv   --show-capture=stdout  test_mclag.py                                   
========================================================================================================= test session starts =========================================================================================================
platform linux2 -- Python 2.7.12, pytest-4.6.3, py-1.8.0, pluggy-0.12.0 -- /usr/bin/python
cachedir: .pytest_cache
ansible: 2.0.0.2
rootdir: /var/root/sonic-mgmt-main/tests, inifile: pytest.ini
plugins: repeat-0.8.0, ansible-2.0.2
collected 56 items                                                                                                                                                                                                                    

test_mclag.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_check_teamd_system_id PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_traffic_between_servers PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_down PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_up PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_peer_link_interface_down PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_syncheck_on_mclag_interface[syncheck0] PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_peer_link_interface_up PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_keepalive_link_down PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_keepalive_link_up PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_peer_keepalive_link_down PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_peer_keepalive_link_up PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_active_down PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_active_up PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_standby_down PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_standby_up PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_traffic_between_servers PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_syncheck_after_warmreboot[syncheck0] PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_traffic_between_servers PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_syncheck_after_warmreboot[syncheck0] PASSED
test_mclag.py::TestCase10_MacFlapping::test_traffic_before_mac_flapping PASSED
test_mclag.py::TestCase10_MacFlapping::test_syncheck_before_mac_flapping[syncheck0] PASSED
test_mclag.py::TestCase10_MacFlapping::test_mac_flapping PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_traffic_between_servers PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_mclag_member_port_down PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_mclag_member_port_up PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_traffic_between_servers_after_mclag_member_port_up PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_traffic_between_servers PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_before_age PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mac_aging_on_peer PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_aging PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_relearn_after_mac_age PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_relearn PASSED
test_mclag.py::TestCase12_ICCP_CSM::test_active_restart PASSED
test_mclag.py::TestCase12_ICCP_CSM::test_standby_restart PASSED
test_mclag.py::TestCase13_Scaling::test_traffic_between_servers PASSED
test_mclag.py::TestCase13_Scaling::test_mac_arp_sync PASSED
test_mclag.py::TestCase14_CornerTest::test_stop_teamd_on_active PASSED
test_mclag.py::TestCase14_CornerTest::test_start_teamd_on_active PASSED
test_mclag.py::TestCase14_CornerTest::test_stop_teamd_on_standby PASSED
test_mclag.py::TestCase14_CornerTest::test_start_teamd_on_standby PASSED
============================================================================================== 56 passed, 1 warnings in 5459.90 seconds ===============================================================================================

mclag test on test_scenario L3

root@sonic-mgmt:/var/root/sonic-mgmt-main/tests# pytest -vvv --disable_loganalyzer --inventory veos --host-pattern all --user admin --testbed vms-t0-mclag-16 --testbed_file testbed.csv --show-capture=stdout test_mclag_l3.py
========================================================================================================= test session starts =========================================================================================================
platform linux2 -- Python 2.7.12, pytest-4.6.3, py-1.8.0, pluggy-0.12.0 -- /usr/bin/python
cachedir: .pytest_cache
ansible: 2.0.0.2
rootdir: /var/root/sonic-mgmt-main/tests, inifile: pytest.ini
plugins: repeat-0.8.0, ansible-2.0.2
collected 24 items                                                                                                                                                                                                                    

test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_teamd_system_id PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_syncheck PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_down PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_up PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_keepalive_link_down PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_keepalive_link_up PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_active_down PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_active_up PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_standby_down PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_standby_up PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_syncheck PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_syncheck PASSED
test_mclag_l3.py::TestCase8_Scaling::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase8_Scaling::test_syncheck PASSED

========================================================================================================== warnings summary ===========================================================================================================
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link
  /usr/local/lib/python2.7/dist-packages/pytest_ansible/module_dispatcher/v2.py:70: UserWarning: provided hosts list is empty, only localhost is available
    warnings.warn("provided hosts list is empty, only localhost is available")

-- Docs: https://docs.pytest.org/en/latest/warnings.html
============================================================================================== 24 passed, 1 warnings in 2198.84 seconds ===============================================================================================

Supported testbed topology if it's a new test case?

According test plan, we build mclag topo based on topo-t0, supported for topo_t0-mclag(which has 32 dut ports) and topo_t0-mclag-16(which has 16 dut ports).

Documentation

https://github.com/shine4chen/SONiC/blob/mclag-test-case/doc/mclag_hld/MCLAG-ansible-test-plan.md

add pytest enter point files

msftclas · 2019-11-26T09:23:57Z

All CLA requirements met.

freeman386 · 2019-11-26T09:35:45Z

We will add deploy mclag topo PR to required PRs later

…tically (sonic-net#15678) src/sonic-sairedis * 82a132f - (HEAD -> 202205, origin/202205) [warmboot] Add workaround for `INIT_VIEW` failure (sonic-net#1252) (6 hours ago) [Jing Zhang] * c901fa8 - [202205] Use SAI_STATUS_ITEM_NOT_FOUND when key not found (sonic-net#1237) (20 hours ago) [Lawrence Lee]

[portsorch] Enable port-level buffer drop counters (sonic-net#1237) [vnet]: Fix double route installation for BITMAP VNET interface (sonic-net#1114)

Revert "[portsorch] Enable port-level buffer drop counters (sonic-net#1237)" (sonic-net#1308) Add more log message, fix test code (sonic-net#1239)

c0df6355deb8bc3685395f727983a5e9f3b06f61 (HEAD -> 201911, origin/201911) Updates to bgp config and show commands with BGP_INTERNAL_NEIGHBOR table (sonic-net#1224) (sonic-net#1237) d683bb48604220942b9f6bdea90c0ea4ff4f72ef [CLI][show][platform] Added ASIC count in the output. (sonic-net#1185) (sonic-net#1227) 4585be10aa8e761ce1091ac4a20e562c2550970c [show] Fix 'show int neigh expected' (sonic-net#1189) 29e4469d5e6c5058fe20c1ce71790f69b7193e7e [201911][fwutil]: Use logger from sonic-py-common (sonic-net#1190) Signed-off-by: Abhishek Dosi <abdosi@microsoft.com>

freeman386 and others added 5 commits November 26, 2019 15:22

Add files via upload

59c9c18

add pytest enter point files

add mclag topo files based on topo-t0

9b020f0

add mclag pytest files

b702415

link arp_responder files to ansible files

4753680

add mclag topo vars and add module_dir to be called in pytest

17d1404

freeman386 closed this Nov 26, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237
freeman386 wants to merge 5 commits intosonic-net:masterfrom
freeman386:master

freeman386 commented Nov 26, 2019

Uh oh!

msftclas commented Nov 26, 2019 •

edited

Loading

Uh oh!

freeman386 commented Nov 26, 2019

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

freeman386 commented Nov 26, 2019

Description of PR

Type of change

Approach

How did you do it?

Supported testbed topology if it's a new test case?

Documentation

Uh oh!

msftclas commented Nov 26, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

freeman386 commented Nov 26, 2019

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

msftclas commented Nov 26, 2019 •

edited

Loading