X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=tests%2Fperf%2F10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc.robot;h=d2604cf00b63600e750e458247c72d82f9bd8f23;hp=3aa624cf21c32d524f27e90dcaa0375903967c2e;hb=086f3a5065d744e00fe10289eb2f090b7bde208e;hpb=1cb9b4af51c289045a729cc9cbfc5f34aa54e948 diff --git a/tests/perf/10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc.robot b/tests/perf/10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc.robot index 3aa624cf21..d2604cf00b 100644 --- a/tests/perf/10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc.robot +++ b/tests/perf/10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc.robot @@ -12,19 +12,19 @@ # limitations under the License. *** Settings *** -| Resource | resources/libraries/robot/performance.robot +| Resource | resources/libraries/robot/performance_setup.robot | Library | resources.libraries.python.QemuUtils | ... | Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDRDISC | ... | NIC_Intel-X520-DA2 | ETH | IP4FWD | BASE | VHOST | VM | ... -| Suite Setup | 3-node Performance Suite Setup with DUT's NIC model +| Suite Setup | Set up 3-node performance topology with DUT's NIC model | ... | L3 | Intel-X520-DA2 -| Suite Teardown | 3-node Performance Suite Teardown +| Suite Teardown | Tear down 3-node performance topology | ... -| Test Setup | Performance test setup -| Test Teardown | Performance test with vhost and VM with dpdk-testpmd teardown -| ... | ${min_rate}pps | ${framesize} | 3-node-IPv4 +| Test Setup | Set up performance test +| Test Teardown | Tear down performance test with vhost and VM with dpdk-testpmd +| ... | ${min_rate}pps | ${framesize} | ${traffic_profile} | ... | dut1_node=${dut1} | dut1_vm_refs=${dut1_vm_refs} | ... | dut2_node=${dut2} | dut2_vm_refs=${dut2_vm_refs} | ... @@ -56,12 +56,14 @@ | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Variables *** -#X520-DA2 bandwidth limit +# X520-DA2 bandwidth limit | ${s_limit}= | ${10000000000} -#CPU settings +# CPU settings | ${system_cpus}= | ${1} | ${vpp_cpus}= | ${5} | ${vm_cpus}= | ${5} +# Traffic profile: +| ${traffic_profile} | trex-sl-3n-ethip4-ip4src253 *** Test Cases *** | tc01-64B-1t1c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc @@ -69,7 +71,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 1T1C | STHREAD | NDRDISC +| | [Tags] | 64B | 1T1C | STHREAD | NDRDISC | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -80,22 +82,22 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc02-64B-1t1c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 1T1C | STHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -106,23 +108,23 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc03-1518B-1t1c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 1T1C | STHREAD | NDRDISC +| | [Tags] | 1518B | 1T1C | STHREAD | NDRDISC | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -133,22 +135,22 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc04-1518B-1t1c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 1T1C | STHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -159,16 +161,16 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc05-IMIX-1t1c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] @@ -176,7 +178,7 @@ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for IMIX_v4_1 frame \ | | ... | size using binary search start at 10GE linerate, step 10kpps. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 1T1C | STHREAD | NDRDISC +| | [Tags] | IMIX | 1T1C | STHREAD | NDRDISC | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -187,15 +189,15 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc06-IMIX-1t1c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] @@ -203,7 +205,7 @@ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for IMIX_v4_1 frame \ | | ... | size using binary search start at 10GE linerate, step 10kpps, LT=0.5%. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 1T1C | STHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -214,23 +216,23 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc07-64B-2t2c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 2T2C | MTHREAD | NDRDISC +| | [Tags] | 64B | 2T2C | MTHREAD | NDRDISC | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -241,22 +243,22 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc08-64B-2t2c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -267,23 +269,23 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc09-1518B-2t2c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -294,22 +296,22 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc10-1518B-2t2c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -320,16 +322,16 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc11-IMIX-2t2c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] @@ -337,7 +339,7 @@ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for IMIX_v4_1 frame \ | | ... | size using binary search start at 10GE linerate, step 10kpps. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -348,15 +350,15 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc12-IMIX-2t2c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] @@ -364,7 +366,7 @@ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for IMIX_v4_1 frame \ | | ... | size using binary search start at 10GE linerate, step 10kpps, LT=0.5%. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -375,23 +377,23 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc13-64B-4t4c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 4T4C | MTHREAD | NDRDISC +| | [Tags] | 64B | 4T4C | MTHREAD | NDRDISC | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -402,22 +404,22 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc14-64B-4t4c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -428,23 +430,23 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc15-1518B-4t4c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1518 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -455,22 +457,22 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc16-1518B-4t4c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1518 Byte frames \ | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -481,16 +483,16 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} | tc17-IMIX-4t4c-ethip4-ip4base-eth-4vhost-2vm-ndrdisc | | [Documentation] @@ -498,7 +500,7 @@ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for IMIX_v4_1 frame \ | | ... | size using binary search start at 10GE linerate, step 10kpps. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -509,15 +511,15 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find NDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find NDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc18-IMIX-4t4c-ethip4-ip4base-eth-4vhost-2vm-pdrdisc | | [Documentation] @@ -525,7 +527,7 @@ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for IMIX_v4_1 frame \ | | ... | size using binary search start at 10GE linerate, step 10kpps, LT=0.5%. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} @@ -536,13 +538,13 @@ | | ${dut2_vm_refs}= | Create Dictionary | | Set Test Variable | ${dut1_vm_refs} | | Set Test Variable | ${dut2_vm_refs} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | When IPv4 forwarding with Vhost-User for '2' VMs initialized in a 3-node circular topology -| | And '2' Guest VMs with dpdk-testpmd-mac connected via vhost-user is setup in a 3-node circular topology -| | Then Find PDR using binary search and pps -| | ... | ${framesize} | ${binary_min} | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} | ${threshold} -| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type} +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | When Initialize IPv4 forwarding with vhost for '2' VMs in 3-node circular topology +| | And Configure '2' guest VMs with dpdk-testpmd-mac connected via vhost-user in 3-node circular topology +| | Then Find PDR using binary search and pps +| | ... | ${framesize} | ${binary_min} | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} +| | ... | ${perf_pdr_loss_acceptance} | ${perf_pdr_loss_acceptance_type}