X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=resources%2Flibraries%2Frobot%2Fperformance.robot;h=66cc8f794f9e996e7f216997b4a9de848e647622;hp=ce4433c9ccf4c04487b2842a4d9c5d1884faa15f;hb=ac7203cc1104f0e4868c07748d8a6b288182263f;hpb=490256818796108eb9fc169fc477517c490c5d6a diff --git a/resources/libraries/robot/performance.robot b/resources/libraries/robot/performance.robot index ce4433c9cc..66cc8f794f 100644 --- a/resources/libraries/robot/performance.robot +++ b/resources/libraries/robot/performance.robot @@ -30,168 +30,6 @@ | Documentation | Performance suite keywords *** Keywords *** -| Setup performance rate Variables -| | [Documentation] -| | ... | Setup performance linerates as Suite Variables. Variables are used -| | ... | as search boundaries in RFC2544 throughput search. -| | ... -| | ... | _NOTE:_ This KW sets following suite variables: -| | ... | - 10Ge_linerate_pps_64B - Maximum number of packet per second -| | ... | for 10GE with 64B L2 Frame. -| | ... | - 10Ge_linerate_pps_68B - Maximum number of packet per second -| | ... | for 10GE with 68B L2 Frame. -| | ... | - 10Ge_linerate_pps_72B - Maximum number of packet per second -| | ... | for 10GE with 72B L2 Frame. -| | ... | - 10Ge_linerate_pps_78B - Maximum number of packet per second -| | ... | for 10GE with 78B L2 Frame. -| | ... | - 10Ge_linerate_pps_114B - Maximum number of packet per second -| | ... | for 10GE with 114B L2 Frame. -| | ... | - 10Ge_linerate_pps_1518B - Maximum number of packet per second -| | ... | for 10GE with 1518B L2 Frame. -| | ... | - 10Ge_linerate_pps_1522B - Maximum number of packet per second -| | ... | for 10GE with 1522B L2 Frame. -| | ... | - 10Ge_linerate_pps_1526B - Maximum number of packet per second -| | ... | for 10GE with 1526B L2 Frame. -| | ... | - 10Ge_linerate_pps_1568B - Maximum number of packet per second -| | ... | for 10GE with 1568B L2 Frame. -| | ... | - 10Ge_linerate_pps_9000B - Maximum number of packet per second -| | ... | for 10GE with 9000B L2 Frame. -| | ... | - 10Ge_linerate_pps_9004B - Maximum number of packet per second -| | ... | for 10GE with 9004B L2 Frame. -| | ... | - 10Ge_linerate_pps_9008B - Maximum number of packet per second -| | ... | for 10GE with 9008B L2 Frame. -| | ... | - 10Ge_linerate_pps_9050B - Maximum number of packet per second -| | ... | for 10GE with 9050B L2 Frame. -| | ... | - 10Ge_linerate_pps_IMIX_v4_1 - Maximum number of packet per second -| | ... | for 10GE with IMIX_v4_1 profile. -| | ... | - 10Ge_lisp_linerate_pps_72B - Maximum number of packets per second -| | ... | for 10GE with 72B L2 Frame, Lisp and -| | ... | IPv4 header. -| | ... | - 10Ge_lisp_linerate_pps_86B - Maximum number of packets per second -| | ... | for 10GE with 86B L2 Frame, Lisp and -| | ... | IPv4 header. -| | ... | - 10Ge_lisp_linerate_pps_1488B - Maximum number of packets per -| | ... | second for 10GE with 1488B L2 -| | ... | Frame, Lisp and IPv6 header. -| | ... | - 10Ge_lisp_linerate_pps_9008B - Maximum number of packets per -| | ... | second for 10GE with 9008B L2 -| | ... | Frame, Lisp, IPv4 or IPv6 header. -| | ... | - 10Ge_lisp_iph_linerate_pps_112B - Maximum number of packets per -| | ... | second for 10GE with 112B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 10Ge_lisp_iph_linerate_pps_126B - Maximum number of packets per -| | ... | second for 10GE with 126B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 10Ge_lisp_iph_linerate_pps_1508B - Maximum number of packets per -| | ... | second for 10GE with 1508B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 10Ge_lisp_iph_linerate_pps_9048B - Maximum number of packets per -| | ... | second for 10GE with 9048B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 40Ge_linerate_pps_64B - Maximum number of packet per second -| | ... | for 40GE with 64B L2 Frame. -| | ... | - 40Ge_linerate_pps_68B - Maximum number of packet per second -| | ... | for 40GE with 68B L2 Frame. -| | ... | - 40Ge_linerate_pps_72B - Maximum number of packet per second -| | ... | for 40GE with 72B L2 Frame. -| | ... | - 40Ge_linerate_pps_78B - Maximum number of packet per second -| | ... | for 40GE with 78B L2 Frame. -| | ... | - 40Ge_linerate_pps_114B - Maximum number of packet per second -| | ... | for 40GE with 114B L2 Frame. -| | ... | - 40Ge_linerate_pps_1518B - Maximum number of packet per second -| | ... | for 40GE with 1518B L2 Frame. -| | ... | - 40Ge_linerate_pps_1522B - Maximum number of packet per second -| | ... | for 40GE with 1522B L2 Frame. -| | ... | - 40Ge_linerate_pps_1526B - Maximum number of packet per second -| | ... | for 40GE with 1526B L2 Frame. -| | ... | - 40Ge_linerate_pps_1568B - Maximum number of packet per second -| | ... | for 40GE with 1568B L2 Frame. -| | ... | - 40Ge_linerate_pps_9000B - Maximum number of packet per second -| | ... | for 40GE with 9000B L2 Frame. -| | ... | - 40Ge_linerate_pps_9004B - Maximum number of packet per second -| | ... | for 40GE with 9004B L2 Frame. -| | ... | - 40Ge_linerate_pps_9008B - Maximum number of packet per second -| | ... | for 40GE with 9008B L2 Frame. -| | ... | - 40Ge_linerate_pps_9050B - Maximum number of packet per second -| | ... | for 40GE with 9050B L2 Frame. -| | ... | - 40Ge_linerate_pps_IMIX_v4_1 - Maximum number of packet per second -| | ... | for 40GE with IMIX_v4_1 profile. -| | ... | - 40Ge_lisp_linerate_pps_72B - Maximum number of packets per second -| | ... | for 40GE with 72B L2 Frame, Lisp and -| | ... | IPv4 header. -| | ... | - 40Ge_lisp_linerate_pps_86B - Maximum number of packets per second -| | ... | for 40GE with 86B L2 Frame, Lisp and -| | ... | IPv4 header. -| | ... | - 40Ge_lisp_linerate_pps_1488B - Maximum number of packets per -| | ... | second for 40GE with 1488B L2 -| | ... | Frame, Lisp and IPv6 header. -| | ... | - 40Ge_lisp_linerate_pps_9008B - Maximum number of packets per -| | ... | second for 40GE with 9008B L2 -| | ... | Frame, Lisp, IPv4 or IPv6 header. -| | ... | - 40Ge_lisp_iph_linerate_pps_112B - Maximum number of packets per -| | ... | second for 40GE with 112B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 40Ge_lisp_iph_linerate_pps_126B - Maximum number of packets per -| | ... | second for 40GE with 126B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 40Ge_lisp_iph_linerate_pps_1508B - Maximum number of packets per -| | ... | second for 40GE with 1508B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... | - 40Ge_lisp_iph_linerate_pps_9048B - Maximum number of packets per -| | ... | second for 40GE with 9048B L2 -| | ... | Frame, Lisp, IPv4 and IPv6 -| | ... | header. -| | ... -| | Set Suite Variable | ${10Ge_linerate_pps_64B} | 14880952 -| | Set Suite Variable | ${10Ge_linerate_pps_68B} | 14204545 -| | Set Suite Variable | ${10Ge_linerate_pps_72B} | 13586956 -| | Set Suite Variable | ${10Ge_linerate_pps_78B} | 12755102 -| | Set Suite Variable | ${10Ge_linerate_pps_114B} | 9328358 -| | Set Suite Variable | ${10Ge_linerate_pps_1518B} | 812743 -| | Set Suite Variable | ${10Ge_linerate_pps_1522B} | 810635 -| | Set Suite Variable | ${10Ge_linerate_pps_1568B} | 787153 -| | Set Suite Variable | ${10Ge_linerate_pps_9000B} | 138580 -| | Set Suite Variable | ${10Ge_linerate_pps_9004B} | 138519 -| | Set Suite Variable | ${10Ge_linerate_pps_9008B} | 138458 -| | Set Suite Variable | ${10Ge_linerate_pps_9050B} | 137816 -| | Set Suite Variable | ${10Ge_linerate_pps_IMIX_v4_1} | 3343736 -| | Set Suite Variable | ${10Ge_lisp_linerate_pps_72B} | 13586956 -| | Set Suite Variable | ${10Ge_lisp_linerate_pps_86B} | 11792452 -| | Set Suite Variable | ${10Ge_lisp_linerate_pps_1488B} | 828912 -| | Set Suite Variable | ${10Ge_lisp_linerate_pps_9008B} | 138458 -| | Set Suite Variable | ${10Ge_lisp_iph_linerate_pps_112B} | 9469696 -| | Set Suite Variable | ${10Ge_lisp_iph_linerate_pps_126B} | 8561643 -| | Set Suite Variable | ${10Ge_lisp_iph_linerate_pps_1508B} | 818062 -| | Set Suite Variable | ${10Ge_lisp_iph_linerate_pps_9048B} | 137847 -| | Set Suite Variable | ${40Ge_linerate_pps_64B} | 59523809 -| | Set Suite Variable | ${40Ge_linerate_pps_68B} | 56818181 -| | Set Suite Variable | ${40Ge_linerate_pps_72B} | 54347826 -| | Set Suite Variable | ${40Ge_linerate_pps_78B} | 51020408 -| | Set Suite Variable | ${40Ge_linerate_pps_114B} | 37313432 -| | Set Suite Variable | ${40Ge_linerate_pps_1518B} | 3250975 -| | Set Suite Variable | ${40Ge_linerate_pps_1522B} | 3242542 -| | Set Suite Variable | ${40Ge_linerate_pps_1568B} | 3148614 -| | Set Suite Variable | ${40Ge_linerate_pps_9000B} | 554323 -| | Set Suite Variable | ${40Ge_linerate_pps_9004B} | 554078 -| | Set Suite Variable | ${40Ge_linerate_pps_9008B} | 553832 -| | Set Suite Variable | ${40Ge_linerate_pps_9050B} | 551267 -| | Set Suite Variable | ${40Ge_linerate_pps_IMIX_v4_1} | 13374944 -| | Set Suite Variable | ${40Ge_lisp_linerate_pps_72B} | 54347826 -| | Set Suite Variable | ${40Ge_lisp_linerate_pps_86B} | 47169811 -| | Set Suite Variable | ${40Ge_lisp_linerate_pps_1488B} | 3315649 -| | Set Suite Variable | ${40Ge_lisp_linerate_pps_9008B} | 553832 -| | Set Suite Variable | ${40Ge_lisp_iph_linerate_pps_112B} | 37878787 -| | Set Suite Variable | ${40Ge_lisp_iph_linerate_pps_126B} | 34246575 -| | Set Suite Variable | ${40Ge_lisp_iph_linerate_pps_1508B} | 3272251 -| | Set Suite Variable | ${40Ge_lisp_iph_linerate_pps_9048B} | 551389 - | Calculate pps | | [Documentation] | | ... | Calculate pps for given rate and L2 frame size, @@ -240,7 +78,7 @@ | | ... | | Set Suite Variable | ${glob_loss_acceptance} | 0.5 | | Set Suite Variable | ${glob_loss_acceptance_type} | percentage -| | Set Suite Variable | ${glob_vm_image} | /var/lib/vm/csit-nested-1.3.img +| | Set Suite Variable | ${glob_vm_image} | /var/lib/vm/csit-nested-1.5.img | 2-node circular Topology Variables Setup | | [Documentation] @@ -329,7 +167,7 @@ | | Append Node | ${nodes['TG']} | | Append Node | ${nodes['DUT1']} | filter_list=${iface_model_list} | | Append Node | ${nodes['TG']} -| | Compute Path +| | Compute Path | always_same_link=${FALSE} | | ${tg_if1} | ${tg}= | Next Interface | | ${dut1_if1} | ${dut1}= | Next Interface | | ${dut1_if2} | ${dut1}= | Next Interface @@ -697,9 +535,9 @@ | | Vpp Route Add | ${dut1} | 2001:1::0 | ${host_prefix} | 2001:3::2 | | ... | interface=${dut1_if1} | count=${count} | | Vpp Route Add | ${dut2} | 2001:1::0 | ${host_prefix} | 2001:4::1 -| | ... | interface=${dut2_if2} | count=${count} -| | Vpp Route Add | ${dut2} | 2001:2::0 | ${host_prefix} | 2001:5::2 | | ... | interface=${dut2_if1} | count=${count} +| | Vpp Route Add | ${dut2} | 2001:2::0 | ${host_prefix} | 2001:5::2 +| | ... | interface=${dut2_if2} | count=${count} | IPv6 iAcl whitelist initialized in a 3-node circular topology | | [Documentation] @@ -823,6 +661,73 @@ | | Interface is added to bridge domain | ${dut2} | ${vhost_if2} | ${bd_id2} | | All Vpp Interfaces Ready Wait | ${nodes} +| L2 bridge domain with VXLANoIPv4 initialized in a 3-node circular topology +| | [Documentation] +| | ... | Setup L2 bridge domain topology with VXLANoIPv4 by connecting +| | ... | physical and vxlan interfaces on each DUT. All interfaces are brought +| | ... | up. IPv4 addresses with prefix /24 are configured on interfaces +| | ... | between DUTs. VXLAN sub-interfaces has same IPv4 address as +| | ... | interfaces. +| | ... +| | VPP interfaces in path are up in a 3-node circular topology +| | IP addresses are set on interfaces | ${dut1} | ${dut1_if2} | 172.16.0.1 | 24 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_if1} | 172.16.0.2 | 24 +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | Add arp on dut | ${dut1} | ${dut1_if2} | 172.16.0.2 | ${dut2_if1_mac} +| | Add arp on dut | ${dut2} | ${dut2_if1} | 172.16.0.1 | ${dut1_if2_mac} +| | ${dut1s_vxlan}= | Create VXLAN interface | ${dut1} | 24 +| | ... | 172.16.0.1 | 172.16.0.2 +| | ${dut2s_vxlan}= | Create VXLAN interface | ${dut2} | 24 +| | ... | 172.16.0.2 | 172.16.0.1 +| | Vpp l2bd forwarding setup | ${dut1} | ${dut1_if1} | ${dut1s_vxlan} +| | Vpp l2bd forwarding setup | ${dut2} | ${dut2_if2} | ${dut2s_vxlan} +| | All Vpp Interfaces Ready Wait | ${nodes} + +| L2 bridge domains with Vhost-User and VXLANoIPv4 initialized in a 3-node circular topology +| | [Documentation] +| | ... | Create two Vhost-User interfaces on all defined VPP nodes. Add each +| | ... | Vhost-User interface into L2 bridge domains with learning enabled +| | ... | with physical inteface. +| | ... | Setup VXLANoIPv4 between DUTs by connecting physical and vxlan +| | ... | interfaces on each DUT. All interfaces are brought up. +| | ... | IPv4 addresses with prefix /24 are configured on interfaces between +| | ... | DUTs. VXLAN sub-interfaces has same IPv4 address as interfaces. +| | ... +| | ... | *Arguments:* +| | ... | - bd_id1 - Bridge domain ID. Type: integer +| | ... | - bd_id2 - Bridge domain ID. Type: integer +| | ... | - sock1 - Sock path for first Vhost-User interface. Type: string +| | ... | - sock2 - Sock path for second Vhost-User interface. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| L2 bridge domains with Vhost-User initialized in a 3-node \ +| | ... | circular topology \| 1 \| 2 \| /tmp/sock1 \| /tmp/sock2 \| +| | ... +| | [Arguments] | ${bd_id1} | ${bd_id2} | ${sock1} | ${sock2} +| | ... +| | VPP interfaces in path are up in a 3-node circular topology +| | IP addresses are set on interfaces | ${dut1} | ${dut1_if2} | 172.16.0.1 | 24 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_if1} | 172.16.0.2 | 24 +| | ${dut1s_vxlan}= | Create VXLAN interface | ${dut1} | 24 +| | ... | 172.16.0.1 | 172.16.0.2 +| | ${dut2s_vxlan}= | Create VXLAN interface | ${dut2} | 24 +| | ... | 172.16.0.2 | 172.16.0.1 +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut1} +| | ... | ${sock1} | ${sock2} +| | Interface is added to bridge domain | ${dut1} | ${dut1_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut1} | ${vhost_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut1} | ${vhost_if2} | ${bd_id2} +| | Interface is added to bridge domain | ${dut1} | ${dut1s_vxlan} | ${bd_id2} +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut2} +| | ... | ${sock1} | ${sock2} +| | Interface is added to bridge domain | ${dut2} | ${dut2s_vxlan} | ${bd_id1} +| | Interface is added to bridge domain | ${dut2} | ${vhost_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut2} | ${vhost_if2} | ${bd_id2} +| | Interface is added to bridge domain | ${dut2} | ${dut2_if2} | ${bd_id2} +| | All Vpp Interfaces Ready Wait | ${nodes} + 2-node Performance Suite Setup with DUT's NIC model | | [Documentation] | | ... | Suite preparation phase that setup default startup configuration of @@ -838,12 +743,11 @@ | | ... | | ... | \| 2-node Performance Suite Setup \| L2 \| Intel-X520-DA2 \| | | [Arguments] | ${topology_type} | ${nic_model} -| | Setup default startup configuration of VPP on all DUTs | | Show vpp version on all DUTs -| | Setup performance rate Variables | | Setup performance global Variables | | 2-node circular Topology Variables Setup with DUT interface model | | ... | ${nic_model} +| | Setup default startup configuration of VPP on all DUTs | | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} | | ... | ${dut1} | ${dut1_if1} | | ... | ${dut1} | ${dut1_if2} @@ -864,12 +768,11 @@ | | ... | | ... | \| 3-node Performance Suite Setup \| L2 \| Intel-X520-DA2 \| | | [Arguments] | ${topology_type} | ${nic_model} -| | Setup default startup configuration of VPP on all DUTs | | Show vpp version on all DUTs -| | Setup performance rate Variables | | Setup performance global Variables | | 3-node circular Topology Variables Setup with DUT interface model | | ... | ${nic_model} +| | Setup default startup configuration of VPP on all DUTs | | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} | | ... | ${dut1} | ${dut1_if1} | | ... | ${dut2} | ${dut2_if2} @@ -913,13 +816,13 @@ | | ${tmp}= | Create List | 100%NDR | ${lat} | | ${latency}= | Create List | ${tmp} | | ${rate_50p}= | Evaluate | int(${rate_per_stream}*0.5) -| | ${lat_50p}= | Measure latency | ${duration} | ${rate_50p}pps -| | ... | ${framesize} | ${topology_type} +| | ${lat_50p}= | Measure latency pps | ${duration} | ${rate_50p} +| | ... | ${framesize} | ${topology_type} | | ${tmp}= | Create List | 50%NDR | ${lat_50p} | | Append To List | ${latency} | ${tmp} | | ${rate_10p}= | Evaluate | int(${rate_per_stream}*0.1) -| | ${lat_10p}= | Measure latency | ${duration} | ${rate_10p}pps -| | ... | ${framesize} | ${topology_type} +| | ${lat_10p}= | Measure latency pps | ${duration} | ${rate_10p} +| | ... | ${framesize} | ${topology_type} | | ${tmp}= | Create List | 10%NDR | ${lat_10p} | | Append To List | ${latency} | ${tmp} | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 @@ -1000,13 +903,13 @@ | | ${tmp}= | Create List | 100%NDR | ${lat} | | ${latency}= | Create List | ${tmp} | | ${rate_50p}= | Evaluate | int(${rate_per_stream}*0.5) -| | ${lat_50p}= | Measure latency | ${duration} | ${rate_50p}pps -| | ... | ${framesize} | ${topology_type} +| | ${lat_50p}= | Measure latency pps | ${duration} | ${rate_50p} +| | ... | ${framesize} | ${topology_type} | | ${tmp}= | Create List | 50%NDR | ${lat_50p} | | Append To List | ${latency} | ${tmp} | | ${rate_10p}= | Evaluate | int(${rate_per_stream}*0.1) -| | ${lat_10p}= | Measure latency | ${duration} | ${rate_10p}pps -| | ... | ${framesize} | ${topology_type} +| | ${lat_10p}= | Measure latency pps | ${duration} | ${rate_10p} +| | ... | ${framesize} | ${topology_type} | | ${tmp}= | Create List | 10%NDR | ${lat_10p} | | Append To List | ${latency} | ${tmp} | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 @@ -1049,7 +952,9 @@ | | ... | Set Loss Acceptance Type Percentage | | Set Binary Convergence Threshold | ${threshold} | | Binary Search | ${binary_min} | ${binary_max} | ${topology_type} -| | ${rate_per_stream} | ${latency}= | Verify Search Result +| | ${rate_per_stream} | ${lat}= | Verify Search Result +| | ${tmp}= | Create List | 100%NDR | ${lat} +| | ${latency}= | Create List | ${tmp} | | Display result of PDR search | ${rate_per_stream} | ${framesize} | 2 | | ... | ${loss_acceptance} | ${loss_acceptance_type} | | ... | ${latency} @@ -1091,13 +996,13 @@ | | ${tmp}= | Create List | 100%NDR | ${lat} | | ${latency}= | Create List | ${tmp} | | ${rate_50p}= | Evaluate | int(${rate_per_stream}*0.5) -| | ${lat_50p}= | Measure latency | ${duration} | ${rate_50p}pps -| | ... | ${framesize} | ${topology_type} +| | ${lat_50p}= | Measure latency pps | ${duration} | ${rate_50p} +| | ... | ${framesize} | ${topology_type} | | ${tmp}= | Create List | 50%NDR | ${lat_50p} | | Append To List | ${latency} | ${tmp} | | ${rate_10p}= | Evaluate | int(${rate_per_stream}*0.1) -| | ${lat_10p}= | Measure latency | ${duration} | ${rate_10p}pps -| | ... | ${framesize} | ${topology_type} +| | ${lat_10p}= | Measure latency pps | ${duration} | ${rate_10p} +| | ... | ${framesize} | ${topology_type} | | ${tmp}= | Create List | 10%NDR | ${lat_10p} | | Append To List | ${latency} | ${tmp} | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 @@ -1204,7 +1109,7 @@ | | ... | *Example:* | | ... | | ... | \| Display result of PDR search \| 4400000 \| 64 \| 2 \| 0.5 \ -| | ... | \| percentage \| (0, 10/10/10) \| +| | ... | \| percentage \| [100%NDR, [10/10/10, 1/2/3]] \| | | [Arguments] | ${rate_per_stream} | ${framesize} | ${nr_streams} | | ... | ${loss_acceptance} | ${loss_acceptance_type} | ${latency} | | ${framesize}= | Get Frame Size | ${framesize} @@ -1215,30 +1120,32 @@ | | ... | append=yes | | Set Test Message | ${\n}FINAL_BANDWIDTH: ${bandwidth_total} Gbps (untagged) | | ... | append=yes -| | :FOR | ${idx} | ${lat} | IN ENUMERATE | @{latency} -| | | Set Test Message | ${\n}LATENCY_STREAM_${idx}: ${lat} usec (min/avg/max) -| | ... | append=yes +| | Set Test Message | ${\n}LATENCY usec [min/avg/max] | append=yes +| | :FOR | ${lat} | IN | @{latency} +| | | Set Test Message | ${\n}LAT_${lat[0]}: ${lat[1]} | append=yes | | Set Test Message | ${\n}LOSS_ACCEPTANCE: ${loss_acceptance} ${loss_acceptance_type} | | ... | append=yes -| Measure latency +| Measure latency pps | | [Documentation] | | ... | Send traffic at specified rate. Measure min/avg/max latency | | ... | | ... | *Arguments:* | | ... | - duration - Duration of traffic run [s]. Type: integer -| | ... | - rate - Rate for sending packets. Type: string +| | ... | - rate - Rate for sending packets. Type: integer | | ... | - framesize - L2 Frame Size [B]. Type: integer | | ... | - topology_type - Topology type. Type: string | | ... | | ... | *Example:* | | ... -| | ... | \| Measure latency \| 10 \| 4.0mpps \| 64 \| 3-node-IPv4 +| | ... | \| Measure latency \| 10 \| 4.0 \| 64 \| 3-node-IPv4 | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} -| | Clear all counters on all DUTs -| | Send traffic on tg | ${duration} | ${rate} | ${framesize} +| | Return From Keyword If | ${rate} <= 10000 | ${-1} +| | ${ret}= | For DPDK Performance Test +| | Run Keyword If | ${ret}==${FALSE} | Clear all counters on all DUTs +| | Send traffic on tg | ${duration} | ${rate}pps | ${framesize} | | ... | ${topology_type} | warmup_time=0 -| | Show statistics on all DUTs +| | Run Keyword If | ${ret}==${FALSE} | Show statistics on all DUTs | | Run keyword and return | Get latency | Traffic should pass with no loss @@ -1260,10 +1167,11 @@ | | ... | ${fail_on_loss}=${True} | | Clear and show runtime counters with running traffic | ${duration} | | ... | ${rate} | ${framesize} | ${topology_type} -| | Clear all counters on all DUTs +| | ${ret}= | For DPDK Performance Test +| | Run Keyword If | ${ret}==${FALSE} | Clear all counters on all DUTs | | Send traffic on tg | ${duration} | ${rate} | ${framesize} | | ... | ${topology_type} | warmup_time=0 -| | Show statistics on all DUTs +| | Run Keyword If | ${ret}==${FALSE} | Show statistics on all DUTs | | Run Keyword If | ${fail_on_loss} | No traffic loss occurred | Traffic should pass with partial loss @@ -1288,10 +1196,11 @@ | | ... | ${fail_on_loss}=${True} | | Clear and show runtime counters with running traffic | ${duration} | | ... | ${rate} | ${framesize} | ${topology_type} -| | Clear all counters on all DUTs +| | ${ret}= | For DPDK Performance Test +| | Run Keyword If | ${ret}==${FALSE} | Clear all counters on all DUTs | | Send traffic on tg | ${duration} | ${rate} | ${framesize} | | ... | ${topology_type} | warmup_time=0 -| | Show statistics on all DUTs +| | Run Keyword If | ${ret}==${FALSE} | Show statistics on all DUTs | | Run Keyword If | ${fail_on_loss} | Partial traffic loss accepted | | ... | ${loss_acceptance} | ${loss_acceptance_type} @@ -1315,9 +1224,10 @@ | | Send traffic on tg | -1 | ${rate} | ${framesize} | | ... | ${topology_type} | warmup_time=0 | async_call=${True} | | ... | latency=${False} -| | Clear runtime counters on all DUTs +| | ${ret}= | For DPDK Performance Test +| | Run Keyword If | ${ret}==${FALSE} | Clear runtime counters on all DUTs | | Sleep | ${duration} -| | Show runtime counters on all DUTs +| | Run Keyword If | ${ret}==${FALSE} | Show runtime counters on all DUTs | | Stop traffic on tg | Add PCI devices to DUTs from 3-node single link topology @@ -1331,8 +1241,8 @@ | Guest VM with dpdk-testpmd connected via vhost-user is setup | | [Documentation] | | ... | Start QEMU guest with two vhost-user interfaces and interconnecting -| | ... | DPDK testpmd. Qemu Guest is using 3 cores pinned to physical cores 5, -| | ... | 6, 7 and 2048M. Testpmd is using 3 cores (1 main core and 2 cores +| | ... | DPDK testpmd. Qemu Guest is using 5 cores pinned to physical cores +| | ... | 5-9, and 2048M. Testpmd is using 5 cores (1 main core and 4 cores | | ... | dedicated to io) mem-channel=4, txq/rxq=256, burst=64, | | ... | disable-hw-vlan, disable-rss, driver usr/lib/librte_pmd_virtio.so | | ... | and fwd mode is io. @@ -1353,24 +1263,23 @@ | | Run keyword | ${vm_name}.Qemu Add Vhost User If | ${sock1} | | Run keyword | ${vm_name}.Qemu Add Vhost User If | ${sock2} | | Run keyword | ${vm_name}.Qemu Set Node | ${dut_node} -| | Run keyword | ${vm_name}.Qemu Set Smp | 3 | 3 | 1 | 1 +| | Run keyword | ${vm_name}.Qemu Set Smp | 5 | 5 | 1 | 1 | | Run keyword | ${vm_name}.Qemu Set Mem Size | 2048 -| | Run keyword | ${vm_name}.Qemu Set Huge Allocate | | Run keyword | ${vm_name}.Qemu Set Disk Image | ${glob_vm_image} | | ${vm}= | Run keyword | ${vm_name}.Qemu Start -| | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 -| | Dpdk Testpmd Start | ${vm} | eal_coremask=0x7 +| | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 | 8 | 9 +| | Run keyword | ${vm_name}.Qemu Set Scheduler Policy +| | Dpdk Testpmd Start | ${vm} | eal_coremask=0x1f | | ... | eal_mem_channels=4 | | ... | pmd_fwd_mode=io | | ... | pmd_disable_hw_vlan=${True} -| | ... | pmd_disable_rss=${True} | | Return From Keyword | ${vm} | Guest VM with dpdk-testpmd-mac connected via vhost-user is setup | | [Documentation] | | ... | Start QEMU guest with two vhost-user interfaces and interconnecting -| | ... | DPDK testpmd. Qemu Guest is using 3 cores pinned to physical cores 5, -| | ... | 6, 7 and 2048M. Testpmd is using 3 cores (1 main core and 2 cores +| | ... | DPDK testpmd. Qemu Guest is using 5 cores pinned to physical cores +| | ... | 5-9 and 2048M. Testpmd is using 5 cores (1 main core and 4 cores | | ... | dedicated to io) mem-channel=4, txq/rxq=256, burst=64, | | ... | disable-hw-vlan, disable-rss, driver usr/lib/librte_pmd_virtio.so | | ... | and fwd mode is mac rewrite. @@ -1395,20 +1304,18 @@ | | Run keyword | ${vm_name}.Qemu Add Vhost User If | ${sock1} | | Run keyword | ${vm_name}.Qemu Add Vhost User If | ${sock2} | | Run keyword | ${vm_name}.Qemu Set Node | ${dut_node} -| | Run keyword | ${vm_name}.Qemu Set Smp | 3 | 3 | 1 | 1 +| | Run keyword | ${vm_name}.Qemu Set Smp | 5 | 5 | 1 | 1 | | Run keyword | ${vm_name}.Qemu Set Mem Size | 2048 -| | Run keyword | ${vm_name}.Qemu Set Huge Allocate -| | Run keyword | ${vm_name}.Qemu Set Disk Image -| | ... | /var/lib/vm/csit-nested-1.3.img +| | Run keyword | ${vm_name}.Qemu Set Disk Image | ${glob_vm_image} | | ${vm}= | Run keyword | ${vm_name}.Qemu Start -| | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 -| | Dpdk Testpmd Start | ${vm} | eal_coremask=0x7 +| | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 | 8 | 9 +| | Run keyword | ${vm_name}.Qemu Set Scheduler Policy +| | Dpdk Testpmd Start | ${vm} | eal_coremask=0x1f | | ... | eal_mem_channels=4 | | ... | pmd_fwd_mode=mac | | ... | pmd_eth_peer_0=0,${eth0_mac} | | ... | pmd_eth_peer_1=1,${eth1_mac} | | ... | pmd_disable_hw_vlan=${True} -| | ... | pmd_disable_rss=${True} | | Return From Keyword | ${vm} | Guest VM with Linux Bridge connected via vhost-user is setup @@ -1435,10 +1342,10 @@ | | Run keyword | ${vm_name}.Qemu Set Node | ${dut_node} | | Run keyword | ${vm_name}.Qemu Set Smp | 3 | 3 | 1 | 1 | | Run keyword | ${vm_name}.Qemu Set Mem Size | 2048 -| | Run keyword | ${vm_name}.Qemu Set Huge Allocate | | Run keyword | ${vm_name}.Qemu Set Disk Image | ${glob_vm_image} | | ${vm}= | Run keyword | ${vm_name}.Qemu Start | | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 +| | Run keyword | ${vm_name}.Qemu Set Scheduler Policy | | ${br}= | Set Variable | br0 | | ${vhost1}= | Get Vhost User If Name By Sock | ${vm} | ${sock1} | | ${vhost2}= | Get Vhost User If Name By Sock | ${vm} | ${sock2} @@ -1645,11 +1552,11 @@ | | ... | \| Lisp IPv6 over IPv4 forwarding initialized in a 3-node circular topology \ | | ... | \| ${dut1_dut2_ip4_address} \| ${dut1_tg_ip6_address} \ | | ... | \| ${dut2_dut1_ip4_address} \| ${dut2_tg_ip6_address} \ -| | ... | \| ${prefix4} \| ${prefix6} \| +| | ... | \| ${prefix6} \| ${prefix4} \| | | ... | | [Arguments] | ${dut1_dut2_ip4_address} | ${dut1_tg_ip6_address} | | ... | ${dut2_dut1_ip4_address} | ${dut2_tg_ip6_address} -| | ... | ${prefix4} | ${prefix6} +| | ... | ${prefix6} | ${prefix4} | | Set Interface State | ${dut1} | ${dut1_if1} | up | | Set Interface State | ${dut1} | ${dut1_if2} | up | | Set Interface State | ${dut2} | ${dut2_if1} | up @@ -1670,3 +1577,78 @@ | | dut1_v4.set_arp | ${dut1_if2} | ${dut2_dut1_ip4_address} | ${dut2_if1_mac} | | dut2_v4.set_arp | ${dut2_if1} | ${dut1_dut2_ip4_address} | ${dut1_if2_mac} +DPDK 2-node Performance Suite Setup with DUT's NIC model +| | [Documentation] +| | ... | Updates interfaces on all nodes and setup global +| | ... | variables used in test cases based on interface model provided as an +| | ... | argument. Initializes traffic generator. Initializes DPDK test +| | ... | environment. +| | ... +| | ... | *Arguments:* +| | ... | - topology_type - Topology type. Type: string +| | ... | - nic_model - Interface model. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| DPDK 2-node Performance Suite Setup with DUT's NIC model \ +| | ... | \| L2 \| Intel-X520-DA2 \| +| | [Arguments] | ${topology_type} | ${nic_model} +| | Setup performance global Variables +| | 2-node circular Topology Variables Setup with DUT interface model +| | ... | ${nic_model} +| | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} +| | ... | ${dut1} | ${dut1_if1} +| | ... | ${dut1} | ${dut1_if2} +| | ... | ${topology_type} +| | Initialize DPDK Environment | ${dut1} | ${dut1_if1} | ${dut1_if2} + +DPDK 3-node Performance Suite Setup with DUT's NIC model +| | [Documentation] +| | ... | Updates interfaces on all nodes and setup global +| | ... | variables used in test cases based on interface model provided as an +| | ... | argument. Initializes traffic generator. Initializes DPDK test +| | ... | environment. +| | ... +| | ... | *Arguments:* +| | ... | - topology_type - Topology type. Type: string +| | ... | - nic_model - Interface model. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| 3-node Performance Suite Setup \| L2 \| Intel-X520-DA2 \| +| | [Arguments] | ${topology_type} | ${nic_model} +| | Setup performance global Variables +| | 3-node circular Topology Variables Setup with DUT interface model +| | ... | ${nic_model} +| | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} +| | ... | ${dut1} | ${dut1_if1} +| | ... | ${dut2} | ${dut2_if2} +| | ... | ${topology_type} +| | Initialize DPDK Environment | ${dut1} | ${dut1_if1} | ${dut1_if2} +| | Initialize DPDK Environment | ${dut2} | ${dut2_if1} | ${dut2_if2} + +DPDK 3-node Performance Suite Teardown +| | [Documentation] +| | ... | Suite teardown phase with traffic generator teardown. +| | ... | Cleanup DPDK test environment. +| | ... +| | Teardown traffic generator | ${tg} +| | Cleanup DPDK Environment | ${dut1} | ${dut1_if1} | ${dut1_if2} +| | Cleanup DPDK Environment | ${dut2} | ${dut2_if1} | ${dut2_if2} + +DPDK 2-node Performance Suite Teardown +| | [Documentation] +| | ... | Suite teardown phase with traffic generator teardown. +| | ... | Cleanup DPDK test environment. +| | ... +| | Teardown traffic generator | ${tg} +| | Cleanup DPDK Environment | ${dut1} | ${dut1_if1} | ${dut1_if2} + +For DPDK Performance Test +| | [Documentation] +| | ... | Return TRUE if variable DPDK_TEST exist, otherwise FALSE. +| | ${ret} | ${tmp}= | Run Keyword And Ignore Error +| | ... | Variable Should Exist | ${DPDK_TEST} +| | Return From Keyword If | "${ret}" == "PASS" | ${TRUE} +| | Return From Keyword | ${FALSE} +