CSIT-1142 Change thread perf test TAGs

[csit.git] / tests / vpp / perf / container_memif / 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot

diff --git a/tests/vpp/perf/container_memif/40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot b/tests/vpp/perf/container_memif/40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
index a167ae4..b39d27f 100644 (file)
--- a/tests/vpp/perf/container_memif/40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
+++ b/tests/vpp/perf/container_memif/40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
@@ -25,7 +25,9 @@
 | ...
 | Suite Teardown | Tear down 3-node performance topology with container
 | ...
-| Test Setup | Set up performance test
+| Test Setup | Run Keywords
+| ... | Set up performance test
+| ... | AND | Restart VPP in all 'VNF' containers
 | ...
 | Test Teardown | Tear down performance mrr test
 | ...
@@ -39,7 +41,7 @@
 | ... | Memif interface. LXC is running same VPP version as running on DUT. LXC
 | ... | is limited via cgroup to use 3 cores allocated from pool of isolated
 | ... | CPUs. There are no memory constraints. DUT1 and DUT2 tested with
-| ... | 2p40GE NIC XL710 Niantic by Intel.
+| ... | 2p40GE NIC XL710 by Intel.
 | ... | *[Ver] TG verification:* In MaxReceivedRate test TG sends traffic
 | ... | at line rate and reports total received/sent packets over trial period.
 | ... | Test packets are generated by TG on links to DUTs. TG traffic profile
@@ -59,10 +61,12 @@
 | ${container_count}= | ${1}
 | ${container_engine}= | LXC
 | ${container_image}= | ${EMPTY}
+| ${container_install_dkms}= | ${FALSE}
+| ${container_chain_topology}= | chain
 # CPU settings
 | ${system_cpus}= | ${1}
 | ${vpp_cpus}= | ${5}
-| ${container_cpus}= | ${3}
+| ${container_cpus}= | ${5}
 
 *** Keywords ***
 | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
@@ -82,79 +86,146 @@
 | | ... | ${max_rate} > ${s_18.75Mpps} | ${s_18.75Mpps} | ${max_rate}
 | | ...
 | | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology
-| | And Add PCI devices to DUTs in 3-node single link topology
+| | And Add PCI devices to all DUTs
 | | And Run Keyword If | ${get_framesize} < ${1522}
 | | ... | Add no multi seg to all DUTs
 | | And Apply startup configuration on all VPP DUTs
-| | And Initialize L2 Bridge Domain for '1' memif pairs in 3-node circular topology
+| | And Initialize L2 Bridge Domain for '1' memif pairs and '${rxq}' rxqueues in 3-node circular topology
 | | Then Traffic should pass with maximum rate | ${perf_trial_duration}
 | | ... | ${max_rate}pps | ${framesize} | ${traffic_profile}
 
 *** Test Cases ***
 | tc01-64B-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
 | | [Documentation]
-| | ... | [Cfg] DUT runs L2BD switching config with 1 thread, 1 phy core,\
+| | ... | [Cfg] DUT runs L2BD switching config with 1 phy core,\
 | | ... | 1 receive queue per NIC port.
 | | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\
 | | ... | throughput test.
 | | ...
-| | [Tags] | 64B | 1T1C | STHREAD
+| | [Tags] | 64B | 1C
 | | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
 | | framesize=${64} | wt=1 | rxq=1
 
-| tc02-IMIX-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| tc02-1518B-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
 | | [Documentation]
-| | ... | [Cfg] DUT runs L2BD switching config with 1 thread, 1 phy core,\
+| | ... | [Cfg] DUT runs L2BD switching config with 1 phy core,\
+| | ... | 1 receive queue per NIC port.
+| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\
+| | ... | throughput test.
+| | ...
+| | [Tags] | 1518B | 1C
+| | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
+| | framesize=${1518} | wt=1 | rxq=1
+
+| tc03-9000B-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| | [Documentation]
+| | ... | [Cfg] DUT runs L2BD switching config with 1 phy core,\
+| | ... | 1 receive queue per NIC port.
+| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\
+| | ... | throughput test.
+| | ...
+| | [Tags] | 9000B | 1C
+| | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
+| | framesize=${9000} | wt=1 | rxq=1
+
+| tc04-IMIX-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| | [Documentation]
+| | ... | [Cfg] DUT runs L2BD switching config with 1 phy core,\
 | | ... | 1 receive queue per NIC port.
 | | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\
 | | ... | throughput test.
 | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B)
 | | ...
-| | [Tags] | IMIX | 1T1C | STHREAD
+| | [Tags] | IMIX | 1C
 | | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
 | | framesize=IMIX_v4_1 | wt=1 | rxq=1
 
-| tc03-1518B-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| tc05-64B-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| | [Documentation]
+| | ... | [Cfg] DUT runs L2BD switching config with 2 phy cores,\
+| | ... | 1 receive queue per NIC port.
+| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\
+| | ... | throughput test.
+| | ...
+| | [Tags] | 64B | 2C
+| | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
+| | framesize=${64} | wt=2 | rxq=1
+
+| tc06-1518B-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
 | | [Documentation]
-| | ... | [Cfg] DUT runs L2BD switching config with 1 thread, 1 phy core,\
+| | ... | [Cfg] DUT runs L2BD switching config with 2 phy cores,\
 | | ... | 1 receive queue per NIC port.
 | | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\
 | | ... | throughput test.
 | | ...
-| | [Tags] | 1518B | 1T1C | STHREAD
+| | [Tags] | 1518B | 2C
 | | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
-| | framesize=${1518} | wt=1 | rxq=1
+| | framesize=${1518} | wt=2 | rxq=1
 
-| tc04-64B-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| tc07-9000B-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
 | | [Documentation]
-| | ... | [Cfg] DUT runs L2BD switching config with 2 thread, 2 phy core,\
+| | ... | [Cfg] DUT runs L2BD switching config with 2 phy cores,\
 | | ... | 1 receive queue per NIC port.
-| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\
+| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\
 | | ... | throughput test.
 | | ...
-| | [Tags] | 64B | 2T2C | MTHREAD
+| | [Tags] | 9000B | 2C
 | | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
-| | framesize=${64} | wt=2 | rxq=1
+| | framesize=${9000} | wt=2 | rxq=1
 
-| tc05-IMIX-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| tc08-IMIX-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
 | | [Documentation]
-| | ... | [Cfg] DUT runs L2BD switching config with 2 thread, 2 phy core,\
+| | ... | [Cfg] DUT runs L2BD switching config with 2 phy cores,\
 | | ... | 1 receive queue per NIC port.
-| | ... | [Ver] Measure MaxReceivedRate forIMIX_v4_1 frames using single trial\
+| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\
 | | ... | throughput test.
 | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B)
 | | ...
-| | [Tags] | IMIX | 2T2C | MTHREAD
+| | [Tags] | IMIX | 2C
 | | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
 | | framesize=IMIX_v4_1 | wt=2 | rxq=1
 
-| tc06-1518B-2t2c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| tc09-64B-4t4c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
 | | [Documentation]
-| | ... | [Cfg] DUT runs L2BD switching config with 2 thread, 1 phy core,\
-| | ... | 1 receive queue per NIC port.
+| | ... | [Cfg] DUT runs L2BD switching config with 4 phy cores,\
+| | ... | 2 receive queues per NIC port.
+| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\
+| | ... | throughput test.
+| | ...
+| | [Tags] | 64B | 4C
+| | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
+| | framesize=${64} | wt=4 | rxq=2
+
+| tc10-1518B-4t4c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| | [Documentation]
+| | ... | [Cfg] DUT runs L2BD switching config with 4 phy cores,\
+| | ... | 2 receive queues per NIC port.
 | | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\
 | | ... | throughput test.
 | | ...
-| | [Tags] | 1518B | 2T2C | MTHREAD
+| | [Tags] | 1518B | 4C
 | | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
-| | framesize=${1518} | wt=2 | rxq=1
+| | framesize=${1518} | wt=4 | rxq=2
+
+| tc11-9000B-4t4c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| | [Documentation]
+| | ... | [Cfg] DUT runs L2BD switching config with 4 phy cores,\
+| | ... | 2 receive queues per NIC port.
+| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\
+| | ... | throughput test.
+| | ...
+| | [Tags] | 9000B | 4C
+| | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
+| | framesize=${9000} | wt=4 | rxq=2
+
+| tc12-IMIX-4t4c-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr
+| | [Documentation]
+| | ... | [Cfg] DUT runs L2BD switching config with 4 phy cores,\
+| | ... | 2 receive queues per NIC port.
+| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\
+| | ... | throughput test.
+| | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B)
+| | ...
+| | [Tags] | IMIX | 4C
+| | [Template] | Check RR for l2bdbasemaclrn-eth-2memif-1lxc
+| | framesize=IMIX_v4_1 | wt=4 | rxq=2