X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=tests%2Fsuites%2Fperformance%2Flong_bridge_domain.robot;h=e912f8d842dddf148fb6e78b73fc9f195c2606e1;hp=43076b38aa8dc9f4f664c8cfbf5239a3bb6a1801;hb=9f09722c66162b0e01d1aa972f650bf1cd9b3a52;hpb=d637af34421fffe61417bb16e45a7105aae118b9 diff --git a/tests/suites/performance/long_bridge_domain.robot b/tests/suites/performance/long_bridge_domain.robot index 43076b38aa..e912f8d842 100644 --- a/tests/suites/performance/long_bridge_domain.robot +++ b/tests/suites/performance/long_bridge_domain.robot @@ -11,56 +11,169 @@ # See the License for the specific language governing permissions and # limitations under the License. *** Settings *** -| Resource | resources/libraries/robot/default.robot -| Resource | resources/libraries/robot/interfaces.robot -| Resource | resources/libraries/robot/bridge_domain.robot | Resource | resources/libraries/robot/performance.robot -| Resource | resources/libraries/robot/counters.robot -| Library | resources.libraries.python.TrafficGenerator -| Library | resources.libraries.python.TrafficGenerator.TGDropRateSearchImpl | Library | resources.libraries.python.NodePath | Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_LONG -| Suite Setup | 3-node Performance Suite Setup +| Suite Setup | 3-node Performance Suite Setup | L2 | Suite Teardown | 3-node Performance Suite Teardown | Test Setup | Setup all DUTs before test -| Test Teardown | Run Keyword If Test Failed | Show statistics on all DUTs -| Documentation | Throughput search suite (long running test suite based on RFC2544). +| Test Teardown | Run Keyword | Show statistics on all DUTs +| Documentation | *Throughput search suite (based on RFC2544).* +| ... +| ... | Test suite uses 3-node topology TG - DUT1 - DUT2 - TG, with one link +| ... | between nodes. Traffic profile contain 2 L2 streams (1 stream per +| ... | direction). Packets contain Ethernet header, IPv4 header, +| ... | IP protocol=61 and random payload. Ethernet header MAC addresses are +| ... | matching MAC addresses of the TG node. *** Test Cases *** -| Find NDR by using linear search and 64B frames through bridge domain in 3-node topology -| | Given L2 bridge domain initialized in a 3-node circular topology -| | Then Find NDR using linear search and pps | 64 | 4600000 | 100000 -| | ... | 3-node-bridge | 14000000 | 100000 +| Find NDR by using RFC2544 linear search and 64B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput with non drop rate for 64B frames by using +| | ... | linear search starting at 4.1Mpps, stepping down with step of 0.1Mpps +| | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD +| | ${framesize}= | Set Variable | 64 +| | ${start_rate}= | Set Variable | 4100000 +| | ${step_rate}= | Set Variable | 100000 +| | ${min_rate}= | Set Variable | 100000 +| | ${max_rate}= | Set Variable | 14880952 +| | Given Setup '1' worker threads and rss '1' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} -*** Keywords *** +| Find NDR by using RFC2544 linear search and 1518B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput with non drop rate for 1518B frames by using +| | ... | linear search starting at 812,743pps, stepping down with step of +| | ... | 10,000pps +| | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD +| | ${framesize}= | Set Variable | 1518 +| | ${start_rate}= | Set Variable | 812743 +| | ${step_rate}= | Set Variable | 10000 +| | ${min_rate}= | Set Variable | 10000 +| | ${max_rate}= | Set Variable | 812743 +| | Given Setup '1' worker threads and rss '1' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} -| 3-node Performance Suite Setup -| | 3-node circular Topology Variables Setup -| | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} -| | ... | ${dut1} | ${dut1_if1} | ${dut1_if2} -| | ... | ${dut2} | ${dut2_if1} | ${dut2_if2} -| | ... | L2 +| Find NDR by using RFC2544 linear search and 9000B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput with non drop rate for 9000B frames by using +| | ... | linear search starting at 138,580pps, stepping down with step of +| | ... | 5,000pps +| | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD +| | ${framesize}= | Set Variable | 9000 +| | ${start_rate}= | Set Variable | 138580 +| | ${step_rate}= | Set Variable | 5000 +| | ${min_rate}= | Set Variable | 5000 +| | ${max_rate}= | Set Variable | 138580 +| | Given Setup '1' worker threads and rss '1' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} -| 3-node Performance Suite Teardown -| | Teardown traffic generator | ${tg} +| Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 64B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput on 2 cores with non drop rate for 64B frames by using +| | ... | linear search starting at 8.2Mpps, stepping down with step of 0.1Mpps +| | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD +| | ${framesize}= | Set Variable | 64 +| | ${start_rate}= | Set Variable | 8200000 +| | ${step_rate}= | Set Variable | 100000 +| | ${min_rate}= | Set Variable | 100000 +| | ${max_rate}= | Set Variable | 14880952 +| | Given Setup '2' worker threads and rss '1' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} -| L2 bridge domain initialized in a 3-node circular topology -| | Vpp l2bd forwarding setup | ${dut1} | ${dut1_if1} | ${dut1_if2} -| | Vpp l2bd forwarding setup | ${dut2} | ${dut2_if1} | ${dut2_if2} -| | All Vpp Interfaces Ready Wait | ${nodes} +| Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 1518B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput on 2 cores with non drop rate for 1518B frames by +| | ... | using linear search starting at 812,743pps, stepping down with step +| | ... | of 10,000pps +| | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD +| | ${framesize}= | Set Variable | 1518 +| | ${start_rate}= | Set Variable | 812743 +| | ${step_rate}= | Set Variable | 10000 +| | ${min_rate}= | Set Variable | 10000 +| | ${max_rate}= | Set Variable | 812743 +| | Given Setup '2' worker threads and rss '1' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} -| Find NDR using linear search and pps -| | [Arguments] | ${framesize} | ${start_rate} | ${step_rate} -| | ... | ${topology_type} | ${min_rate} | ${max_rate} -| | Set Duration | 60 -| | Set Search Rate Boundaries | 14000000 | 100000 -| | Set Search Linear Step | ${step_rate} -| | Set Search Rate Type pps -| | Linear Search | ${start_rate} | ${topology_type} -| | ${result_rate}= | Verify Search Result -| | Set Test Message | FINAL_RATE: ${result_rate} pps +| Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 9000B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput on 2 cores with non drop rate for 9000B frames by +| | ... | using linear search starting at 138,580pps, stepping down with step +| | ... | of 5,000pps +| | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD +| | ${framesize}= | Set Variable | 9000 +| | ${start_rate}= | Set Variable | 138580 +| | ${step_rate}= | Set Variable | 5000 +| | ${min_rate}= | Set Variable | 5000 +| | ${max_rate}= | Set Variable | 138580 +| | Given Setup '2' worker threads and rss '1' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} -| Show statistics on all DUTs -| | Sleep | 10 | Waiting for statistics to be collected -| | Vpp show stats | ${dut1} -| | Vpp show stats | ${dut2} +| Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 64B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput on 4 cores and rss 2 with non drop rate for 64B +| | ... | frames by using linear search starting at 9.8Mpps, stepping down +| | ... | with step of 0.1Mpps +| | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD +| | ${framesize}= | Set Variable | 64 +| | ${start_rate}= | Set Variable | 9800000 +| | ${step_rate}= | Set Variable | 100000 +| | ${min_rate}= | Set Variable | 100000 +| | ${max_rate}= | Set Variable | 14880952 +| | Given Setup '4' worker threads and rss '2' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} + +| Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 1518B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput on 4 cores and rss 2 with non drop rate for 1518B +| | ... | frames by using linear search starting at 812,743pps, stepping down +| | ... | with step of 10,000pps +| | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD +| | ${framesize}= | Set Variable | 1518 +| | ${start_rate}= | Set Variable | 812743 +| | ${step_rate}= | Set Variable | 10000 +| | ${min_rate}= | Set Variable | 10000 +| | ${max_rate}= | Set Variable | 812743 +| | Given Setup '4' worker threads and rss '2' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate} + +| Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 9000B frames through bridge domain in 3-node topology +| | [Documentation] +| | ... | Find throughput on 4 cores and rss 2 with non drop rate for 9000B +| | ... | frames by using linear search starting at 138,580pps, stepping +| | ... | down with step of 5,000pps +| | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD +| | ${framesize}= | Set Variable | 9000 +| | ${start_rate}= | Set Variable | 138580 +| | ${step_rate}= | Set Variable | 5000 +| | ${min_rate}= | Set Variable | 5000 +| | ${max_rate}= | Set Variable | 138580 +| | Given Setup '4' worker threads and rss '2' without HTT on all DUTs +| | AND L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | ${framesize} | ${start_rate} +| | ... | ${step_rate} | 3-node-bridge +| | ... | ${min_rate} | ${max_rate}