X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=tests%2Fsuites%2Fperformance%2Fshort_xconnect.robot;h=25eef3f65ca13c544b5697ced7186f2d650c268f;hb=refs%2Fchanges%2F26%2F826%2F5;hp=7c33d4f545eab4a2fc36c0aff32576c27868c333;hpb=cdf3213528f5f560d8d8b92c642f655cef706745;p=csit.git diff --git a/tests/suites/performance/short_xconnect.robot b/tests/suites/performance/short_xconnect.robot index 7c33d4f545..25eef3f65c 100644 --- a/tests/suites/performance/short_xconnect.robot +++ b/tests/suites/performance/short_xconnect.robot @@ -11,57 +11,131 @@ # See the License for the specific language governing permissions and # limitations under the License. *** Settings *** -| Resource | resources/libraries/robot/default.robot -| Resource | resources/libraries/robot/interfaces.robot -| Resource | resources/libraries/robot/l2_xconnect.robot | Resource | resources/libraries/robot/performance.robot -| Resource | resources/libraries/robot/counters.robot -| Library | resources.libraries.python.TrafficGenerator | Library | resources.libraries.python.InterfaceUtil | Library | resources.libraries.python.NodePath -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV -| Suite Setup | 3-node Performance Suite Setup +| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_SHORT +| Suite Setup | 3-node Performance Suite Setup | L2 | Suite Teardown | 3-node Performance Suite Teardown | Test Setup | Setup all DUTs before test -| Test Teardown | Run Keyword If Test Failed | Show statistics on all DUTs +| Test Teardown | Run Keywords | Show statistics on all DUTs +| ... | AND | Reset startup configuration of VPP on all DUTs +| Documentation | Minimal throughput acceptance test cases *** Test Cases *** -| 1core VPP passes 64B frames through L2 cross connect at 3.5mpps in 3-node topology -| | Given L2 xconnect initialized in a 3-node circular topology -| | Then Traffic should pass with no loss | 10 | 3.5mpps | 64 | 3-node-xconnect +| 1core VPP passes 64B frames through L2 cross connect at 2x 3.8Mpps in 3-node topology +| | [Documentation] +| | ... | VPP with 1 core should pass 64B frames through L2 cross connect +| | ... | at 2x3.8Mpps in 3-node topology +| | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD +| | ${framesize}= | Set Variable | 64 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 3.8mpps +| | Given Setup '1' worker threads and rss '1' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| 1core VPP passes 1518B frames through L2 cross connect at 10gbps in 3-node topology -| | Given L2 xconnect initialized in a 3-node circular topology -| | Then Traffic should pass with no loss | 10 | 10gbps | 1518 | 3-node-xconnect +| 1core VPP passes 1518B frames through L2 cross connect at 2x 10Gbps in 3-node topology +| | [Documentation] +| | ... | VPP with 1 core should pass 1518B frames through L2 cross connect +| | ... | at 2x10Gbps in 3-node topology +| | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD +| | ${framesize}= | Set Variable | 1518 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 10gbps +| | Given Setup '1' worker threads and rss '1' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| 1core VPP passes 9000B frames through L2 cross connect at 10gbps in 3-node topology -| | Given L2 xconnect initialized in a 3-node circular topology -| | Then Traffic should pass with no loss | 10 | 10gbps | 9000 | 3-node-xconnect +| 1core VPP passes 9000B frames through L2 cross connect at 2x 10Gbps in 3-node topology +| | [Documentation] +| | ... | VPP with 1 core should pass 9000B frames through L2 cross connect +| | ... | at 2x10Gbps in 3-node topology +| | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD +| | ${framesize}= | Set Variable | 9000 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 10gbps +| | Given Setup '1' worker threads and rss '1' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -*** Keywords *** +| 2core VPP with rss 1 passes 64B frames through L2 cross connect at 2x 8.3Mpps in 3-node topology +| | [Documentation] +| | ... | VPP with 2 cores should pass 64B frames through L2 cross connect +| | ... | at 2x8.3Mpps in 3-node topology +| | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD +| | ${framesize}= | Set Variable | 64 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 8.3mpps +| | Given Setup '2' worker threads and rss '1' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| 3-node Performance Suite Setup -| | 3-node circular Topology Variables Setup -| | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} -| | ... | ${dut1} | ${dut1_if1} | ${dut1_if2} -| | ... | ${dut2} | ${dut2_if1} | ${dut2_if2} -| | ... | L2 +| 2core VPP with rss 1 passes 1518B frames through L2 cross connect at 2x 10Gbps in 3-node topology +| | [Documentation] +| | ... | VPP with 2 cores should pass 1518B frames through L2 cross connect +| | ... | at 2x10Gbps in 3-node topology +| | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD +| | ${framesize}= | Set Variable | 1518 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 10gbps +| | Given Setup '2' worker threads and rss '1' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| 3-node Performance Suite Teardown -| | Teardown traffic generator | ${tg} +| 2core VPP with rss 1 passes 9000B frames through L2 cross connect at 2x 10Gbps in 3-node topology +| | [Documentation] +| | ... | VPP with 2 cores should pass 9000B frames through L2 cross connect +| | ... | at 2x10Gbps in 3-node topology +| | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD +| | ${framesize}= | Set Variable | 9000 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 10gbps +| | Given Setup '2' worker threads and rss '1' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| L2 xconnect initialized in a 3-node circular topology -| | L2 setup xconnect on DUT | ${dut1} | ${dut1_if1} | ${dut1_if2} -| | L2 setup xconnect on DUT | ${dut2} | ${dut2_if1} | ${dut2_if2} -| | All Vpp Interfaces Ready Wait | ${nodes} +| 4core VPP with rss 2 passes 64B frames through L2 cross connect at 2x 9.9Mpps in 3-node topology +| | [Documentation] +| | ... | VPP with 4 cores and rss 2 should pass 64B frames through L2 cross +| | ... | connect at 2x9.9Mpps in 3-node topology +| | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD +| | ${framesize}= | Set Variable | 64 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 9.9mpps +| | Given Setup '4' worker threads and rss '2' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| Traffic should pass with no loss -| | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} -| | Send traffic on | ${nodes} | ${duration} -| | ... | ${rate} | ${framesize} | ${topology_type} -| | No traffic loss occured +| 4core VPP with rss 2 passes 1518B frames through L2 cross connect at 2x 10Gbps in 3-node topology +| | [Documentation] +| | ... | VPP with 4 cores and rss 2 should pass 1518B frames through L2 cross +| | ... | connect at 2x10Gbps in 3-node topology +| | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD +| | ${framesize}= | Set Variable | 1518 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 10gbps +| | Given Setup '4' worker threads and rss '2' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect -| Show statistics on all DUTs -| | Sleep | 10 | Waiting for statistics to be collected -| | Vpp show stats | ${dut1} -| | Vpp show stats | ${dut2} +| 4core VPP with rss 2 passes 9000B frames through L2 cross connect at 2x 10Gbps in 3-node topology +| | [Documentation] +| | ... | VPP with 4 cores and rss 2 should pass 9000B frames through L2 cross +| | ... | connect at 2x10Gbps in 3-node topology +| | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD +| | ${framesize}= | Set Variable | 9000 +| | ${duration}= | Set Variable | 10 +| | ${rate}= | Set Variable | 10gbps +| | Given Setup '4' worker threads and rss '2' without HTT on all DUTs +| | AND L2 xconnect initialized in a 3-node circular topology +| | Then Traffic should pass with no loss | ${duration} | ${rate} +| | ... | ${framesize} | 3-node-xconnect