X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=tests%2Fperf%2FLong_IPv4_Intel-X520-DA2.robot;h=c211d122536004761e1b7216c7a9c39f2fdc2ffd;hb=refs%2Fchanges%2F04%2F2504%2F10;hp=d287373cbfc9b25c797a1b514283480462c6e8ff;hpb=f45cd0ceb17f33376a04edf9b4fb5a37d9ebfb89;p=csit.git diff --git a/tests/perf/Long_IPv4_Intel-X520-DA2.robot b/tests/perf/Long_IPv4_Intel-X520-DA2.robot index d287373cbf..c211d12253 100644 --- a/tests/perf/Long_IPv4_Intel-X520-DA2.robot +++ b/tests/perf/Long_IPv4_Intel-X520-DA2.robot @@ -24,8 +24,13 @@ | ... | L3 | Intel-X520-DA2 | Suite Teardown | 3-node Performance Suite Teardown | Test Setup | Setup all DUTs before test -| Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs -| ... | AND | Show vpp trace dump on all DUTs +| Test Teardown | Run Keywords +| ... | Run Keyword If Test Failed +| ... | Traffic should pass with no loss | 10 +| ... | ${min_rate}pps | ${framesize} | 3-node-IPv4 +| ... | fail_on_loss=${False} +| ... | AND | Remove startup configuration of VPP from all DUTs +| ... | AND | Show vpp trace dump on all DUTs | Documentation | *RFC2544: Pkt throughput IPv4 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -54,7 +59,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames | | ... | using binary search start at 10GE linerate, step 100kpps. -| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR | SKIP_PATCH +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR | | ${framesize}= | Set Variable | 64 | | ${min_rate}= | Set Variable | 100000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_64B} @@ -76,7 +81,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames | | ... | using binary search start at 10GE linerate, step 100kpps, LT=0.5%. -| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR | SKIP_PATCH | | ${framesize}= | Set Variable | 64 | | ${min_rate}= | Set Variable | 100000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_64B} @@ -100,7 +105,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames | | ... | using binary search start at 10GE linerate, step 10kpps. -| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR | SKIP_PATCH +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR | | ${framesize}= | Set Variable | 1518 | | ${min_rate}= | Set Variable | 10000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_1518B} @@ -122,7 +127,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames | | ... | using binary search start at 10GE linerate, step 10kpps, LT=0.5%. -| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR | SKIP_PATCH | | ${framesize}= | Set Variable | 1518 | | ${min_rate}= | Set Variable | 10000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_1518B} @@ -146,7 +151,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames | | ... | using binary search start at 10GE linerate, step 5kpps. -| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR | SKIP_PATCH +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR | | ${framesize}= | Set Variable | 9000 | | ${min_rate}= | Set Variable | 5000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_9000B} @@ -167,7 +172,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames | | ... | using binary search start at 10GE linerate, step 5kpps, LT=0.5%. -| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR | SKIP_PATCH | | ${framesize}= | Set Variable | 9000 | | ${min_rate}= | Set Variable | 5000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_9000B} @@ -190,7 +195,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames | | ... | using binary search start at 10GE linerate, step 100kpps. -| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD | NDR | SKIP_PATCH +| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD | NDR | | ${framesize}= | Set Variable | 64 | | ${min_rate}= | Set Variable | 100000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_64B} @@ -212,7 +217,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames | | ... | using binary search start at 10GE linerate, step 100kpps, LT=0.5%. -| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD | PDR +| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD | PDR | SKIP_PATCH | | ${framesize}= | Set Variable | 64 | | ${min_rate}= | Set Variable | 100000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_64B} @@ -326,7 +331,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames | | ... | using binary search start at 10GE linerate, step 100kpps. -| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD | NDR | SKIP_PATCH +| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD | NDR | | ${framesize}= | Set Variable | 64 | | ${min_rate}= | Set Variable | 100000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_64B} @@ -348,7 +353,7 @@ | | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames | | ... | using binary search start at 10GE linerate, step 100kpps, LT=0.5%. -| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD | PDR +| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD | PDR | SKIP_PATCH | | ${framesize}= | Set Variable | 64 | | ${min_rate}= | Set Variable | 100000 | | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_64B} @@ -456,3 +461,52 @@ | | ... | ${threshold} | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} + +*** Test Cases *** +| TC19: IMIX_v4_1 NDR binary search - DUT IPv4 - 1thread 1core 1rxq +| | [Documentation] +| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ +| | ... | 1 receive queue per NIC port. [Ver] Find NDR for IMIX_v4_1 frame size +| | ... | using binary search start at 10GE linerate, step 100kpps. +| | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR +| | ${framesize}= | Set Variable | IMIX_v4_1 +| | ${min_rate}= | Set Variable | 100000 +| | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_IMIX_v4_1} +| | ${binary_min}= | Set Variable | ${min_rate} +| | ${binary_max}= | Set Variable | ${max_rate} +| | ${threshold}= | Set Variable | ${min_rate} +| | Given Add '1' worker threads and rxqueues '1' without HTT to all DUTs +| | And Add all PCI devices to all DUTs +| | And Add No Multi Seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And IPv4 forwarding initialized in a 3-node circular topology +| | Then Find NDR using binary search and pps | ${framesize} | ${binary_min} +| | ... | ${binary_max} | 3-node-IPv4 +| | ... | ${min_rate} | ${max_rate} +| | ... | ${threshold} + +| TC20: IMIX_v4_1 PDR binary search - DUT IPv4 - 1thread 1core 1rxq +| | [Documentation] +| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core, \ +| | ... | 1 receive queue per NIC port. [Ver] Find PDR for IMIX_v4_1 frame size +| | ... | using binary search start at 10GE linerate, step 100kpps, LT=0.5%. +| | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) +| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | PDR | SKIP_PATCH +| | ${framesize}= | Set Variable | IMIX_v4_1 +| | ${min_rate}= | Set Variable | 100000 +| | ${max_rate}= | Set Variable | ${10Ge_linerate_pps_IMIX_v4_1} +| | ${binary_min}= | Set Variable | ${min_rate} +| | ${binary_max}= | Set Variable | ${max_rate} +| | ${threshold}= | Set Variable | ${min_rate} +| | Given Add '1' worker threads and rxqueues '1' without HTT to all DUTs +| | And Add all PCI devices to all DUTs +| | And Add No Multi Seg to all DUTs +| | And Apply startup configuration on all VPP DUTs +| | And IPv4 forwarding initialized in a 3-node circular topology +| | Then Find PDR using binary search and pps | ${framesize} | ${binary_min} +| | ... | ${binary_max} | 3-node-IPv4 +| | ... | ${min_rate} | ${max_rate} +| | ... | ${threshold} +| | ... | ${glob_loss_acceptance} +| | ... | ${glob_loss_acceptance_type}