X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=tests%2Fperf%2F40ge2p1xl710-ethip4-ip4base-ndrpdrdisc.robot;h=926f2547dfeb172b3165110a05c3c4bdae5b3840;hb=859157b5db45927c7b4bb0b2d575e68805777a86;hp=cc04ea0d5c4b066b12bacf8c2d17ceabf666a885;hpb=974897e8bcff8f3baeadf09b87840f530d8f41c1;p=csit.git diff --git a/tests/perf/40ge2p1xl710-ethip4-ip4base-ndrpdrdisc.robot b/tests/perf/40ge2p1xl710-ethip4-ip4base-ndrpdrdisc.robot index cc04ea0d5c..926f2547df 100644 --- a/tests/perf/40ge2p1xl710-ethip4-ip4base-ndrpdrdisc.robot +++ b/tests/perf/40ge2p1xl710-ethip4-ip4base-ndrpdrdisc.robot @@ -12,7 +12,7 @@ # limitations under the License. *** Settings *** -| Resource | resources/libraries/robot/performance.robot +| Resource | resources/libraries/robot/performance_setup.robot | Library | resources.libraries.python.topology.Topology | Library | resources.libraries.python.NodePath | Library | resources.libraries.python.InterfaceUtil @@ -24,13 +24,14 @@ | Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDRDISC | ... | NIC_Intel-XL710 | ETH | IP4FWD | BASE | ... -| Suite Setup | 3-node Performance Suite Setup with DUT's NIC model +| Suite Setup | Set up 3-node performance topology with DUT's NIC model | ... | L3 | Intel-XL710 -| Suite Teardown | 3-node Performance Suite Teardown +| Suite Teardown | Tear down 3-node performance topology | ... -| Test Setup | Performance test setup -| Test Teardown | Performance test teardown | ${min_rate}pps | ${framesize} -| ... | 3-node-IPv4 +| Test Setup | Set up performance test +| ... +| Test Teardown | Tear down performance discovery test | ${min_rate}pps +| ... | ${framesize} | ${traffic_profile} | ... | Documentation | *RFC2544: Pkt throughput IPv4 routing test cases* | ... @@ -59,6 +60,8 @@ | ${s_24.5G} | ${24500000000} # XL710-DA2 Mpps limit 37.5Mpps/2=18.75Mpps | ${s_18.75Mpps} | ${18750000} +# Traffic profile: +| ${traffic_profile} | trex-sl-3n-ethip4-ip4src253 *** Test Cases *** | tc01-64B-1t1c-ethip4-ip4base-ndrdisc @@ -66,132 +69,126 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames | | ... | using binary search start at 18.75Mpps rate, step 100kpps. -| | [Tags] | 1T1C | STHREAD | NDRDISC +| | [Tags] | 64B | 1T1C | STHREAD | NDRDISC | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${100000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc03-1518B-1t1c-ethip4-ip4base-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames | | ... | using binary search start at 24.5G rate, step 10kpps. -| | [Tags] | 1T1C | STHREAD | NDRDISC +| | [Tags] | 1518B | 1T1C | STHREAD | NDRDISC | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${framesize} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc07-64B-2t2c-ethip4-ip4base-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames | | ... | using binary search start at 18.75Mpps rate, step 100kpps. -| | [Tags] | 2T2C | MTHREAD | NDRDISC +| | [Tags] | 64B | 2T2C | MTHREAD | NDRDISC | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${100000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc09-1518B-2t2c-ethip4-ip4base-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames | | ... | using binary search start at 24.5G rate, step 10kpps. -| | [Tags] | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${framesize} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc13-64B-4t4c-ethip4-ip4base-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames | | ... | using binary search start at 18.75Mpps rate, step 100kpps. -| | [Tags] | 4T4C | MTHREAD | NDRDISC +| | [Tags] | 64B | 4T4C | MTHREAD | NDRDISC | | ${framesize}= | Set Variable | ${64} | | ${min_rate}= | Set Variable | ${100000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc15-1518B-4t4c-ethip4-ip4base-ndrdisc | | [Documentation] | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1518 Byte frames | | ... | using binary search start at 24.5G rate, step 10kpps. -| | [Tags] | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | ${1518} | | ${min_rate}= | Set Variable | ${10000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${framesize} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add PCI devices to DUTs from 3-node single link topology -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc19-IMIX-1t1c-ethip4-ip4base-ndrdisc | | [Documentation] @@ -199,22 +196,21 @@ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for IMIX_v4_1 frame size | | ... | using binary search start at 24.5G rate, step 100kpps. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 1T1C | STHREAD | NDRDISC +| | [Tags] | IMIX | 1T1C | STHREAD | NDRDISC | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${100000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${framesize} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add all PCI devices to all DUTs -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc20-IMIX-2t2c-ethip4-ip4base-ndrdisc | | [Documentation] @@ -222,22 +218,21 @@ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for IMIX_v4_1 frame size | | ... | using binary search start at 24.5G rate, step 100kpps. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 2T2C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${100000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${framesize} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and rxqueues '1' in 3-node single-link topo -| | And Add all PCI devices to all DUTs -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold} | tc21-IMIX-4t4c-ethip4-ip4base-ndrdisc | | [Documentation] @@ -245,20 +240,18 @@ | | ... | 2 receive queue per NIC port. [Ver] Find NDR for IMIX_v4_1 frame size | | ... | using binary search start at 24.5G rate, step 100kpps. | | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | [Tags] | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 4T4C | MTHREAD | NDRDISC | SKIP_PATCH | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${min_rate}= | Set Variable | ${100000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${framesize} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and rxqueues '2' in 3-node single-link topo -| | And Add all PCI devices to all DUTs -| | And Add No Multi Seg to all DUTs -| | And Apply startup configuration on all VPP DUTs -| | And IPv4 forwarding initialized in a 3-node circular topology +| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add no multi seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And Initialize IPv4 forwarding in 3-node circular topology | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} -| | ... | ${binary_max} | 3-node-IPv4 -| | ... | ${min_rate} | ${max_rate} -| | ... | ${threshold} - +| | ... | ${binary_max} | ${traffic_profile} +| | ... | ${min_rate} | ${max_rate} | ${threshold}