X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=resources%2Flibraries%2Frobot%2Fperformance.robot;h=b7516ba477de5c23a6346eab2012ed081152033a;hp=4e12ded56d8471778ed0fbf37a089376cb970542;hb=359b07cc72476a29da235f47f05fb539cd339b42;hpb=74afb9bce89ee2ca456c9e9f1e5b016a3befc20e diff --git a/resources/libraries/robot/performance.robot b/resources/libraries/robot/performance.robot index 4e12ded56d..b7516ba477 100644 --- a/resources/libraries/robot/performance.robot +++ b/resources/libraries/robot/performance.robot @@ -30,78 +30,6 @@ | Documentation | Performance suite keywords *** Keywords *** -| Setup performance rate Variables -| | [Documentation] -| | ... | Setup performance linerates as Suite Variables. Variables are used -| | ... | as search boundaries in RFC2544 throughput search. -| | ... -| | ... | _NOTE:_ This KW sets following suite variables: -| | ... | - 10Ge_linerate_pps_64B - Maximum number of packet per second -| | ... | for 10GE with 64B L2 Frame. -| | ... | - 10Ge_linerate_pps_68B - Maximum number of packet per second -| | ... | for 10GE with 68B L2 Frame. -| | ... | - 10Ge_linerate_pps_72B - Maximum number of packet per second -| | ... | for 10GE with 72B L2 Frame. -| | ... | - 10Ge_linerate_pps_78B - Maximum number of packet per second -| | ... | for 10GE with 78B L2 Frame. -| | ... | - 10Ge_linerate_pps_1518B - Maximum number of packet per second -| | ... | for 10GE with 1518B L2 Frame. -| | ... | - 10Ge_linerate_pps_1522B - Maximum number of packet per second -| | ... | for 10GE with 1522B L2 Frame. -| | ... | - 10Ge_linerate_pps_1526B - Maximum number of packet per second -| | ... | for 10GE with 1526B L2 Frame. -| | ... | - 10Ge_linerate_pps_9000B - Maximum number of packet per second -| | ... | for 10GE with 9000B L2 Frame. -| | ... | - 10Ge_linerate_pps_9004B - Maximum number of packet per second -| | ... | for 10GE with 9004B L2 Frame. -| | ... | - 10Ge_linerate_pps_9008B - Maximum number of packet per second -| | ... | for 10GE with 9008B L2 Frame. -| | ... | - 10Ge_linerate_pps_IMIX_v4_1 - Maximum number of packet per second -| | ... | for 10GE with IMIX_v4_1 profile. -| | ... | - 40Ge_linerate_pps_64B - Maximum number of packet per second -| | ... | for 40GE with 64B L2 Frame. -| | ... | - 40Ge_linerate_pps_68B - Maximum number of packet per second -| | ... | for 40GE with 68B L2 Frame. -| | ... | - 40Ge_linerate_pps_72B - Maximum number of packet per second -| | ... | for 40GE with 72B L2 Frame. -| | ... | - 40Ge_linerate_pps_78B - Maximum number of packet per second -| | ... | for 40GE with 78B L2 Frame. -| | ... | - 40Ge_linerate_pps_1518B - Maximum number of packet per second -| | ... | for 40GE with 1518B L2 Frame. -| | ... | - 40Ge_linerate_pps_1522B - Maximum number of packet per second -| | ... | for 40GE with 1522B L2 Frame. -| | ... | - 40Ge_linerate_pps_1526B - Maximum number of packet per second -| | ... | for 40GE with 1526B L2 Frame. -| | ... | - 40Ge_linerate_pps_9000B - Maximum number of packet per second -| | ... | for 40GE with 9000B L2 Frame. -| | ... | - 40Ge_linerate_pps_9004B - Maximum number of packet per second -| | ... | for 40GE with 9004B L2 Frame. -| | ... | - 40Ge_linerate_pps_9008B - Maximum number of packet per second -| | ... | for 40GE with 9008B L2 Frame. -| | ... | - 40Ge_linerate_pps_IMIX_v4_1 - Maximum number of packet per second -| | ... | for 40GE with IMIX_v4_1 profile. -| | ... -| | Set Suite Variable | ${10Ge_linerate_pps_64B} | 14880952 -| | Set Suite Variable | ${10Ge_linerate_pps_68B} | 14204545 -| | Set Suite Variable | ${10Ge_linerate_pps_72B} | 13586956 -| | Set Suite Variable | ${10Ge_linerate_pps_78B} | 12755102 -| | Set Suite Variable | ${10Ge_linerate_pps_1518B} | 812743 -| | Set Suite Variable | ${10Ge_linerate_pps_1522B} | 810635 -| | Set Suite Variable | ${10Ge_linerate_pps_9000B} | 138580 -| | Set Suite Variable | ${10Ge_linerate_pps_9004B} | 138519 -| | Set Suite Variable | ${10Ge_linerate_pps_9008B} | 138458 -| | Set Suite Variable | ${10Ge_linerate_pps_IMIX_v4_1} | 3343736 -| | Set Suite Variable | ${40Ge_linerate_pps_64B} | 59523809 -| | Set Suite Variable | ${40Ge_linerate_pps_68B} | 56818181 -| | Set Suite Variable | ${40Ge_linerate_pps_72B} | 54347826 -| | Set Suite Variable | ${40Ge_linerate_pps_78B} | 51020408 -| | Set Suite Variable | ${40Ge_linerate_pps_1518B} | 3250975 -| | Set Suite Variable | ${40Ge_linerate_pps_1522B} | 3242542 -| | Set Suite Variable | ${40Ge_linerate_pps_9000B} | 554323 -| | Set Suite Variable | ${40Ge_linerate_pps_9004B} | 554078 -| | Set Suite Variable | ${40Ge_linerate_pps_9008B} | 553832 -| | Set Suite Variable | ${40Ge_linerate_pps_IMIX_v4_1} | 13374944 - | Calculate pps | | [Documentation] | | ... | Calculate pps for given rate and L2 frame size, @@ -118,6 +46,7 @@ | | ... | | ... | \| Calculate pps \| 10000000000 | 64 | | [Arguments] | ${bps} | ${framesize} +| | ${framesize}= | Get Frame Size | ${framesize} | | ${ret}= | Evaluate | (${bps}/((${framesize}+20)*8)).__trunc__() | | Return From Keyword | ${ret} @@ -388,6 +317,163 @@ | | ... | count=${count} | | All Vpp Interfaces Ready Wait | ${nodes} +| IPv4 forwarding with vhost initialized in a 3-node circular topology +| | [Documentation] +| | ... | Create vhost-user interfaces in VPP. Set UP state of all VPP +| | ... | interfaces in path on nodes in 3-node circular topology. Create 2 +| | ... | FIB tables on each DUT with multipath routing. Assign pair of +| | ... | Physical and Virtual interfaces on both nodes to each FIB table. +| | ... | Setup IPv4 addresses with /30 prefix on DUT-TG links and /30 prefix +| | ... | on DUT1-DUT2 link. Set routing on all DUT nodes in all FIB tables +| | ... | with prefix /24 and next hop of neighbour IPv4 address. Setup +| | ... | ARP on all VPP interfaces. +| | ... +| | ... | *Arguments:* +| | ... | - sock1 - Sock path for first Vhost-User interface. Type: string +| | ... | - sock2 - Sock path for second Vhost-User interface. Type: string +| | ... +| | ... | *Return:* +| | ... | - No value returned +| | ... +| | ... | *Example:* +| | ... +| | ... | \| IPv4 forwarding with vhost initialized in a 3-node circular \ +| | ... | topology \| /tmp/sock1 \| /tmp/sock2 \| +| | [Arguments] | ${sock1} | ${sock2} +| | VPP interfaces in path are up in a 3-node circular topology +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut1} +| | ... | ${sock1} +| | ... | ${sock2} +| | ${dut1_vif1}= | Set Variable | ${vhost_if1} +| | ${dut1_vif2}= | Set Variable | ${vhost_if2} +| | Set Interface State | ${dut1} | ${dut1_vif1} | up +| | Set Interface State | ${dut1} | ${dut1_vif2} | up +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut2} +| | ... | ${sock1} +| | ... | ${sock2} +| | ${dut2_vif1}= | Set Variable | ${vhost_if1} +| | ${dut2_vif2}= | Set Variable | ${vhost_if2} +| | Set Interface State | ${dut2} | ${dut2_vif1} | up +| | Set Interface State | ${dut2} | ${dut2_vif2} | up +| | ${dut1_vif1_idx}= | Get Interface SW Index | ${dut1} | ${dut1_vif1} +| | ${dut1_vif2_idx}= | Get Interface SW Index | ${dut1} | ${dut1_vif2} +| | ${dut1_if1_idx}= | Get Interface SW Index | ${dut1} | ${dut1_if1} +| | ${dut1_if2_idx}= | Get Interface SW Index | ${dut1} | ${dut1_if2} +| | ${dut2_vif1_idx}= | Get Interface SW Index | ${dut2} | ${dut2_vif1} +| | ${dut2_vif2_idx}= | Get Interface SW Index | ${dut2} | ${dut2_vif2} +| | ${dut2_if1_idx}= | Get Interface SW Index | ${dut2} | ${dut2_if1} +| | ${dut2_if2_idx}= | Get Interface SW Index | ${dut2} | ${dut2_if2} +| | Add fib table | ${dut1} | 20.20.20.0 | 24 | ${fib_table_1} +| | ... | via 4.4.4.2 sw_if_index ${dut1_vif1_idx} multipath +| | Add fib table | ${dut1} | 10.10.10.0 | 24 | ${fib_table_1} +| | ... | via 1.1.1.2 sw_if_index ${dut1_if1_idx} multipath +| | Add fib table | ${dut1} | 20.20.20.0 | 24 | ${fib_table_2} +| | ... | via 2.2.2.2 sw_if_index ${dut1_if2_idx} multipath +| | Add fib table | ${dut1} | 10.10.10.0 | 24 | ${fib_table_2} +| | ... | via 5.5.5.2 sw_if_index ${dut1_vif2_idx} multipath +| | Add fib table | ${dut2} | 10.10.10.0 | 24 | ${fib_table_1} +| | ... | via 2.2.2.1 sw_if_index ${dut2_if1_idx} multipath +| | Add fib table | ${dut2} | 20.20.20.0 | 24 | ${fib_table_1} +| | ... | via 4.4.4.1 sw_if_index ${dut2_vif1_idx} multipath +| | Add fib table | ${dut2} | 10.10.10.0 | 24 | ${fib_table_2} +| | ... | via 5.5.5.2 sw_if_index ${dut2_vif2_idx} multipath +| | Add fib table | ${dut2} | 20.20.20.0 | 24 | ${fib_table_2} +| | ... | via 3.3.3.2 sw_if_index ${dut2_if2_idx} multipath +| | Assign Interface To Fib Table | ${dut1} | ${dut1_if1} | ${fib_table_1} +| | Assign Interface To Fib Table | ${dut1} | ${dut1_vif1} | ${fib_table_1} +| | Assign Interface To Fib Table | ${dut1} | ${dut1_if2} | ${fib_table_2} +| | Assign Interface To Fib Table | ${dut1} | ${dut1_vif2} | ${fib_table_2} +| | Assign Interface To Fib Table | ${dut2} | ${dut2_if1} | ${fib_table_1} +| | Assign Interface To Fib Table | ${dut2} | ${dut2_vif1} | ${fib_table_1} +| | Assign Interface To Fib Table | ${dut2} | ${dut2_if2} | ${fib_table_2} +| | Assign Interface To Fib Table | ${dut2} | ${dut2_vif2} | ${fib_table_2} +| | IP addresses are set on interfaces | ${dut1} | ${dut1_if1} | 1.1.1.2 | 30 +| | IP addresses are set on interfaces | ${dut1} | ${dut1_if2} | 2.2.2.1 | 30 +| | IP addresses are set on interfaces | ${dut1} | ${dut1_vif1} | 4.4.4.1 | 30 +| | IP addresses are set on interfaces | ${dut1} | ${dut1_vif2} | 5.5.5.1 | 30 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_if1} | 2.2.2.2 | 30 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_if2} | 3.3.3.1 | 30 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_vif1} | 4.4.4.1 | 30 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_vif2} | 5.5.5.1 | 30 +| | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1} +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | ${dut1_vif1_mac}= | Get Vhost User Mac By Sw Index | ${dut1} +| | ... | ${dut1_vif1_idx} +| | ${dut1_vif2_mac}= | Get Vhost User Mac By Sw Index | ${dut1} +| | ... | ${dut1_vif2_idx} +| | ${dut2_vif1_mac}= | Get Vhost User Mac By Sw Index | ${dut2} +| | ... | ${dut2_vif1_idx} +| | ${dut2_vif2_mac}= | Get Vhost User Mac By Sw Index | ${dut2} +| | ... | ${dut2_vif2_idx} +| | Set Test Variable | ${dut1_vif1_mac} +| | Set Test Variable | ${dut1_vif2_mac} +| | Set Test Variable | ${dut2_vif1_mac} +| | Set Test Variable | ${dut2_vif2_mac} +| | Add arp on dut | ${dut1} | ${dut1_if1} | 1.1.1.1 | ${tg1_if1_mac} +| | ... | vrf=${fib_table_1} +| | Add arp on dut | ${dut1} | ${dut1_if2} | 2.2.2.2 | ${dut2_if1_mac} +| | ... | vrf=${fib_table_2} +| | Add arp on dut | ${dut1} | ${dut1_vif1} | 4.4.4.2 | 52:54:00:00:04:01 +| | ... | vrf=${fib_table_1} +| | Add arp on dut | ${dut1} | ${dut1_vif2} | 5.5.5.2 | 52:54:00:00:04:02 +| | ... | vrf=${fib_table_2} +| | Add arp on dut | ${dut2} | ${dut2_if1} | 2.2.2.1 | ${dut1_if2_mac} +| | ... | vrf=${fib_table_1} +| | Add arp on dut | ${dut2} | ${dut2_if2} | 3.3.3.2 | ${tg1_if2_mac} +| | ... | vrf=${fib_table_2} +| | Add arp on dut | ${dut2} | ${dut2_vif1} | 4.4.4.2 | 52:54:00:00:04:01 +| | ... | vrf=${fib_table_1} +| | Add arp on dut | ${dut2} | ${dut2_vif2} | 5.5.5.2 | 52:54:00:00:04:02 +| | ... | vrf=${fib_table_2} +| | Vpp Route Add | ${dut1} | 20.20.20.0 | 24 | 4.4.4.2 | ${dut1_vif1} +| | ... | vrf=${fib_table_1} +| | Vpp Route Add | ${dut1} | 10.10.10.0 | 24 | 1.1.1.1 | ${dut1_if1} +| | ... | vrf=${fib_table_1} +| | Vpp Route Add | ${dut1} | 20.20.20.0 | 24 | 2.2.2.2 | ${dut1_if2} +| | ... | vrf=${fib_table_2} +| | Vpp Route Add | ${dut1} | 10.10.10.0 | 24 | 5.5.5.2 | ${dut1_vif2} +| | ... | vrf=${fib_table_2} +| | Vpp Route Add | ${dut2} | 20.20.20.0 | 24 | 4.4.4.2 | ${dut2_vif1} +| | ... | vrf=${fib_table_1} +| | Vpp Route Add | ${dut2} | 10.10.10.0 | 24 | 2.2.2.1 | ${dut2_if1} +| | ... | vrf=${fib_table_1} +| | Vpp Route Add | ${dut2} | 20.20.20.0 | 24 | 3.3.3.2 | ${dut2_if2} +| | ... | vrf=${fib_table_2} +| | Vpp Route Add | ${dut2} | 10.10.10.0 | 24 | 5.5.5.2 | ${dut2_vif2} +| | ... | vrf=${fib_table_2} + +| IPv4 policer 2r3c-${t} initialized in a 3-node circular topology +| | [Documentation] +| | ... | Setup of 2r3c color-aware or color-blind policer with dst ip match +| | ... | on all DUT nodes in 3-node circular topology. Policer is applied on +| | ... | links TG - DUT1 and DUT2 - TG. +| | ... +| | ${dscp}= | DSCP AF22 +| | Policer Set Name | policer1 +| | Policer Set CIR | ${cir} +| | Policer Set EIR | ${eir} +| | Policer Set CB | ${cb} +| | Policer Set EB | ${eb} +| | Policer Set Rate Type pps +| | Policer Set Round Type Closest +| | Policer Set Type 2R3C 2698 +| | Policer Set Conform Action Transmit +| | Policer Set Exceed Action Mark and Transmit | ${dscp} +| | Policer Set Violate Action Transmit +| | Policer Enable Color Aware +| | Run Keyword If | ${t} == 'ca' | Policer Enable Color Aware +| | Policer Classify Set Precolor Exceed +| | Policer Set Node | ${dut1} +| | Policer Classify Set Interface | ${dut1_if1} +| | Policer Classify Set Match IP | 20.20.20.2 | ${False} +| | Policer Set Configuration +| | Policer Set Node | ${dut2} +| | Policer Classify Set Interface | ${dut2_if2} +| | Policer Classify Set Match IP | 10.10.10.2 | ${False} +| | Policer Set Configuration + | IPv6 forwarding initialized in a 3-node circular topology | | [Documentation] | | ... | Set UP state on VPP interfaces in path on nodes in 3-node circular @@ -449,9 +535,9 @@ | | Vpp Route Add | ${dut1} | 2001:1::0 | ${host_prefix} | 2001:3::2 | | ... | interface=${dut1_if1} | count=${count} | | Vpp Route Add | ${dut2} | 2001:1::0 | ${host_prefix} | 2001:4::1 -| | ... | interface=${dut2_if2} | count=${count} -| | Vpp Route Add | ${dut2} | 2001:2::0 | ${host_prefix} | 2001:5::2 | | ... | interface=${dut2_if1} | count=${count} +| | Vpp Route Add | ${dut2} | 2001:2::0 | ${host_prefix} | 2001:5::2 +| | ... | interface=${dut2_if2} | count=${count} | IPv6 iAcl whitelist initialized in a 3-node circular topology | | [Documentation] @@ -482,6 +568,56 @@ | | L2 setup xconnect on DUT | ${dut2} | ${dut2_if1} | ${dut2_if2} | | All Vpp Interfaces Ready Wait | ${nodes} +| L2 xconnect with VXLANoIPv4 initialized in a 3-node circular topology +| | [Documentation] +| | ... | Setup L2 xconnect topology with VXLANoIPv4 by cross connecting +| | ... | physical and vxlan interfaces on each DUT. All interfaces are brought +| | ... | up. IPv4 addresses with prefix /24 are configured on interfaces +| | ... | between DUTs. VXLAN sub-interfaces has same IPv4 address as +| | ... | interfaces. +| | ... +| | VPP interfaces in path are up in a 3-node circular topology +| | IP addresses are set on interfaces | ${dut1} | ${dut1_if2} | 172.16.0.1 +| | ... | 24 +| | IP addresses are set on interfaces | ${dut2} | ${dut2_if1} | 172.16.0.2 +| | ... | 24 +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | Add arp on dut | ${dut1} | ${dut1_if2} | 172.16.0.2 | ${dut2_if1_mac} +| | Add arp on dut | ${dut2} | ${dut2_if1} | 172.16.0.1 | ${dut1_if2_mac} +| | ${dut1s_vxlan}= | Create VXLAN interface | ${dut1} | 24 +| | ... | 172.16.0.1 | 172.16.0.2 +| | L2 setup xconnect on DUT | ${dut1} | ${dut1_if1} | ${dut1s_vxlan} +| | ${dut2s_vxlan}= | Create VXLAN interface | ${dut2} | 24 +| | ... | 172.16.0.2 | 172.16.0.1 +| | L2 setup xconnect on DUT | ${dut2} | ${dut2_if2} | ${dut2s_vxlan} + +| L2 xconnect with Vhost-User initialized in a 3-node circular topology +| | [Documentation] +| | ... | Create two Vhost-User interfaces on all defined VPP nodes. Cross +| | ... | connect each Vhost interface with one physical interface. +| | ... +| | ... | *Arguments:* +| | ... | - sock1 - Socket path for first Vhost-User interface. Type: string +| | ... | - sock2 - Socket path for second Vhost-User interface. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| L2 xconnect with Vhost-User initialized in a 3-node \ +| | ... | circular topology \| /tmp/sock1 \| /tmp/sock2 \| +| | [Arguments] | ${sock1} | ${sock2} +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut1} +| | ... | ${sock1} +| | ... | ${sock2} +| | L2 setup xconnect on DUT | ${dut1} | ${dut1_if1} | ${vhost_if1} +| | L2 setup xconnect on DUT | ${dut1} | ${dut1_if2} | ${vhost_if2} +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut2} +| | ... | ${sock1} +| | ... | ${sock2} +| | L2 setup xconnect on DUT | ${dut2} | ${dut2_if1} | ${vhost_if1} +| | L2 setup xconnect on DUT | ${dut2} | ${dut2_if2} | ${vhost_if2} +| | All Vpp Interfaces Ready Wait | ${nodes} + | L2 bridge domain initialized in a 3-node circular topology | | [Documentation] | | ... | Setup L2 DB topology by adding two interfaces on each DUT into BD @@ -492,6 +628,39 @@ | | Vpp l2bd forwarding setup | ${dut2} | ${dut2_if1} | ${dut2_if2} | | All Vpp Interfaces Ready Wait | ${nodes} +| L2 bridge domains with Vhost-User initialized in a 3-node circular topology +| | [Documentation] +| | ... | Create two Vhost-User interfaces on all defined VPP nodes. Add each +| | ... | Vhost-User interface into L2 bridge domains with learning enabled +| | ... | with physical inteface. +| | ... +| | ... | *Arguments:* +| | ... | - bd_id1 - Bridge domain ID. Type: integer +| | ... | - bd_id2 - Bridge domain ID. Type: integer +| | ... | - sock1 - Sock path for first Vhost-User interface. Type: string +| | ... | - sock2 - Sock path for second Vhost-User interface. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| L2 bridge domains with Vhost-User initialized in a 3-node \ +| | ... | circular topology \| 1 \| 2 \| /tmp/sock1 \| /tmp/sock2 \| +| | [Arguments] | ${bd_id1} | ${bd_id2} | ${sock1} | ${sock2} +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut1} +| | ... | ${sock1} +| | ... | ${sock2} +| | Interface is added to bridge domain | ${dut1} | ${dut1_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut1} | ${vhost_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut1} | ${dut1_if2} | ${bd_id2} +| | Interface is added to bridge domain | ${dut1} | ${vhost_if2} | ${bd_id2} +| | VPP Vhost interfaces for L2BD forwarding are setup | ${dut2} +| | ... | ${sock1} +| | ... | ${sock2} +| | Interface is added to bridge domain | ${dut2} | ${dut2_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut2} | ${vhost_if1} | ${bd_id1} +| | Interface is added to bridge domain | ${dut2} | ${dut2_if2} | ${bd_id2} +| | Interface is added to bridge domain | ${dut2} | ${vhost_if2} | ${bd_id2} +| | All Vpp Interfaces Ready Wait | ${nodes} + 2-node Performance Suite Setup with DUT's NIC model | | [Documentation] | | ... | Suite preparation phase that setup default startup configuration of @@ -509,7 +678,6 @@ | | [Arguments] | ${topology_type} | ${nic_model} | | Setup default startup configuration of VPP on all DUTs | | Show vpp version on all DUTs -| | Setup performance rate Variables | | Setup performance global Variables | | 2-node circular Topology Variables Setup with DUT interface model | | ... | ${nic_model} @@ -535,7 +703,6 @@ | | [Arguments] | ${topology_type} | ${nic_model} | | Setup default startup configuration of VPP on all DUTs | | Show vpp version on all DUTs -| | Setup performance rate Variables | | Setup performance global Variables | | 3-node circular Topology Variables Setup with DUT interface model | | ... | ${nic_model} @@ -578,7 +745,19 @@ | | Set Search Frame Size | ${framesize} | | Set Search Rate Type pps | | Linear Search | ${start_rate} | ${topology_type} -| | ${rate_per_stream} | ${latency}= | Verify Search Result +| | ${rate_per_stream} | ${lat}= | Verify Search Result +| | ${tmp}= | Create List | 100%NDR | ${lat} +| | ${latency}= | Create List | ${tmp} +| | ${rate_50p}= | Evaluate | int(${rate_per_stream}*0.5) +| | ${lat_50p}= | Measure latency pps | ${duration} | ${rate_50p} +| | ... | ${framesize} | ${topology_type} +| | ${tmp}= | Create List | 50%NDR | ${lat_50p} +| | Append To List | ${latency} | ${tmp} +| | ${rate_10p}= | Evaluate | int(${rate_per_stream}*0.1) +| | ${lat_10p}= | Measure latency pps | ${duration} | ${rate_10p} +| | ... | ${framesize} | ${topology_type} +| | ${tmp}= | Create List | 10%NDR | ${lat_10p} +| | Append To List | ${latency} | ${tmp} | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 | | ... | ${latency} | | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps @@ -653,7 +832,19 @@ | | Set Search Rate Type pps | | Set Binary Convergence Threshold | ${threshold} | | Binary Search | ${binary_min} | ${binary_max} | ${topology_type} -| | ${rate_per_stream} | ${latency}= | Verify Search Result +| | ${rate_per_stream} | ${lat}= | Verify Search Result +| | ${tmp}= | Create List | 100%NDR | ${lat} +| | ${latency}= | Create List | ${tmp} +| | ${rate_50p}= | Evaluate | int(${rate_per_stream}*0.5) +| | ${lat_50p}= | Measure latency pps | ${duration} | ${rate_50p} +| | ... | ${framesize} | ${topology_type} +| | ${tmp}= | Create List | 50%NDR | ${lat_50p} +| | Append To List | ${latency} | ${tmp} +| | ${rate_10p}= | Evaluate | int(${rate_per_stream}*0.1) +| | ${lat_10p}= | Measure latency pps | ${duration} | ${rate_10p} +| | ... | ${framesize} | ${topology_type} +| | ${tmp}= | Create List | 10%NDR | ${lat_10p} +| | Append To List | ${latency} | ${tmp} | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 | | ... | ${latency} | | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps @@ -732,7 +923,19 @@ | | Set Search Rate Type pps | | Set Binary Convergence Threshold | ${threshold} | | Combined Search | ${start_rate} | ${topology_type} -| | ${rate_per_stream} | ${latency}= | Verify Search Result +| | ${rate_per_stream} | ${lat}= | Verify Search Result +| | ${tmp}= | Create List | 100%NDR | ${lat} +| | ${latency}= | Create List | ${tmp} +| | ${rate_50p}= | Evaluate | int(${rate_per_stream}*0.5) +| | ${lat_50p}= | Measure latency pps | ${duration} | ${rate_50p} +| | ... | ${framesize} | ${topology_type} +| | ${tmp}= | Create List | 50%NDR | ${lat_50p} +| | Append To List | ${latency} | ${tmp} +| | ${rate_10p}= | Evaluate | int(${rate_per_stream}*0.1) +| | ${lat_10p}= | Measure latency pps | ${duration} | ${rate_10p} +| | ... | ${framesize} | ${topology_type} +| | ${tmp}= | Create List | 10%NDR | ${lat_10p} +| | Append To List | ${latency} | ${tmp} | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 | | ... | ${latency} | | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps @@ -802,7 +1005,7 @@ | | ... | *Example:* | | ... | | ... | \| Display result of NDR search \| 4400000 \| 64 \| 2 \ -| | ... | \| (0, 10/10/10) \| +| | ... | \| [100%NDR, [10/10/10, 1/2/3]] \| | | [Arguments] | ${rate_per_stream} | ${framesize} | ${nr_streams} | | ... | ${latency} | | ${framesize}= | Get Frame Size | ${framesize} @@ -813,9 +1016,9 @@ | | ... | append=yes | | Set Test Message | ${\n}FINAL_BANDWIDTH: ${bandwidth_total} Gbps (untagged) | | ... | append=yes -| | :FOR | ${idx} | ${lat} | IN ENUMERATE | @{latency} -| | | Set Test Message | ${\n}LATENCY_STREAM_${idx}: ${lat} usec (min/avg/max) -| | ... | append=yes +| | Set Test Message | ${\n}LATENCY usec [min/avg/max] | append=yes +| | :FOR | ${lat} | IN | @{latency} +| | | Set Test Message | ${\n}LAT_${lat[0]}: ${lat[1]} | append=yes | Display result of PDR search | | [Documentation] @@ -854,6 +1057,27 @@ | | Set Test Message | ${\n}LOSS_ACCEPTANCE: ${loss_acceptance} ${loss_acceptance_type} | | ... | append=yes +| Measure latency pps +| | [Documentation] +| | ... | Send traffic at specified rate. Measure min/avg/max latency +| | ... +| | ... | *Arguments:* +| | ... | - duration - Duration of traffic run [s]. Type: integer +| | ... | - rate - Rate for sending packets. Type: integer +| | ... | - framesize - L2 Frame Size [B]. Type: integer +| | ... | - topology_type - Topology type. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| Measure latency \| 10 \| 4.0 \| 64 \| 3-node-IPv4 +| | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} +| | Return From Keyword If | ${rate} <= 10000 | ${-1} +| | Clear all counters on all DUTs +| | Send traffic on tg | ${duration} | ${rate}pps | ${framesize} +| | ... | ${topology_type} | warmup_time=0 +| | Show statistics on all DUTs +| | Run keyword and return | Get latency + | Traffic should pass with no loss | | [Documentation] | | ... | Send traffic at specified rate. No packet loss is accepted at loss @@ -946,9 +1170,9 @@ | | ... | Start QEMU guest with two vhost-user interfaces and interconnecting | | ... | DPDK testpmd. Qemu Guest is using 3 cores pinned to physical cores 5, | | ... | 6, 7 and 2048M. Testpmd is using 3 cores (1 main core and 2 cores -| | ... | dedicated to io) socket-mem=1024, mem-channel=4, txq/rxq=2048, -| | ... | burst=64, disable-hw-vlan, total-num-mbufs, driver -| | ... | usr/lib/librte_pmd_virtio.so. +| | ... | dedicated to io) mem-channel=4, txq/rxq=256, burst=64, +| | ... | disable-hw-vlan, disable-rss, driver usr/lib/librte_pmd_virtio.so +| | ... | and fwd mode is io. | | ... | | ... | *Arguments:* | | ... | - dut_node - DUT node to start guest VM on. Type: dictionary @@ -974,9 +1198,54 @@ | | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 | | Dpdk Testpmd Start | ${vm} | eal_coremask=0x7 | | ... | eal_mem_channels=4 -| | ... | eal_socket_mem=1024 | | ... | pmd_fwd_mode=io | | ... | pmd_disable_hw_vlan=${True} +| | ... | pmd_disable_rss=${True} +| | Return From Keyword | ${vm} + +| Guest VM with dpdk-testpmd-mac connected via vhost-user is setup +| | [Documentation] +| | ... | Start QEMU guest with two vhost-user interfaces and interconnecting +| | ... | DPDK testpmd. Qemu Guest is using 3 cores pinned to physical cores 5, +| | ... | 6, 7 and 2048M. Testpmd is using 3 cores (1 main core and 2 cores +| | ... | dedicated to io) mem-channel=4, txq/rxq=256, burst=64, +| | ... | disable-hw-vlan, disable-rss, driver usr/lib/librte_pmd_virtio.so +| | ... | and fwd mode is mac rewrite. +| | ... +| | ... | *Arguments:* +| | ... | - dut_node - DUT node to start guest VM on. Type: dictionary +| | ... | - sock1 - Socket path for first Vhost-User interface. Type: string +| | ... | - sock2 - Socket path for second Vhost-User interface. Type: string +| | ... | - vm_name - QemuUtil instance name. Type: string +| | ... | - eth0_mac - MAC address of first Vhost interface. Type: string +| | ... | - eth1_mac - MAC address of second Vhost interface. Type: string +| | ... +| | ... | *Example:* +| | ... +| | ... | \| Guest VM with dpdk-testpmd for Vhost L2BD forwarding is setup \ +| | ... | \| ${nodes['DUT1']} \| /tmp/sock1 \| /tmp/sock2 \| DUT1_VM \ +| | ... | \| 00:00:00:00:00:01 \| 00:00:00:00:00:02 \| +| | [Arguments] | ${dut_node} | ${sock1} | ${sock2} | ${vm_name} +| | ... | ${eth0_mac} | ${eth1_mac} +| | Import Library | resources.libraries.python.QemuUtils +| | ... | WITH NAME | ${vm_name} +| | Run keyword | ${vm_name}.Qemu Add Vhost User If | ${sock1} +| | Run keyword | ${vm_name}.Qemu Add Vhost User If | ${sock2} +| | Run keyword | ${vm_name}.Qemu Set Node | ${dut_node} +| | Run keyword | ${vm_name}.Qemu Set Smp | 3 | 3 | 1 | 1 +| | Run keyword | ${vm_name}.Qemu Set Mem Size | 2048 +| | Run keyword | ${vm_name}.Qemu Set Huge Allocate +| | Run keyword | ${vm_name}.Qemu Set Disk Image +| | ... | /var/lib/vm/csit-nested-1.3.img +| | ${vm}= | Run keyword | ${vm_name}.Qemu Start +| | Run keyword | ${vm_name}.Qemu Set Affinity | 5 | 6 | 7 +| | Dpdk Testpmd Start | ${vm} | eal_coremask=0x7 +| | ... | eal_mem_channels=4 +| | ... | pmd_fwd_mode=mac +| | ... | pmd_eth_peer_0=0,${eth0_mac} +| | ... | pmd_eth_peer_1=1,${eth1_mac} +| | ... | pmd_disable_hw_vlan=${True} +| | ... | pmd_disable_rss=${True} | | Return From Keyword | ${vm} | Guest VM with Linux Bridge connected via vhost-user is setup @@ -1060,3 +1329,181 @@ | | | Run Keyword | ${vm_name}.Qemu Kill | | | Run Keyword | ${vm_name}.Qemu Clear Socks +| Lisp IPv4 forwarding initialized in a 3-node circular topology +| | [Documentation] | Custom setup of IPv4 addresses on all DUT nodes and TG \ +| | ... | Don`t set route. +| | ... +| | ... | *Arguments:* +| | ... | -${dut1_dut2_address} - Ip address from DUT1 to DUT2. Type: string +| | ... | -${dut1_tg_address} - Ip address from DUT1 to tg. Type: string +| | ... | -${dut2_dut1_address} - Ip address from DUT2 to DUT1. Type: string +| | ... | -${dut1_tg_address} - Ip address from DUT1 to tg. Type: string +| | ... | -${duts_prefix} - ip prefix. Type: int +| | ... +| | ... | *Return:* +| | ... | - No value returned +| | ... +| | ... | *Example:* +| | ... | \| Lisp IPv4 forwarding initialized in a 3-node circular topology \ +| | ... | \| ${dut1_dut2_address} \| ${dut1_tg_address} \ +| | ... | \| ${dut2_dut1_address} \| ${dut2_tg_address} \| ${duts_prefix} \| +| | ... +| | [Arguments] | ${dut1_dut2_address} | ${dut1_tg_address} +| | ... | ${dut2_dut1_address} | ${dut2_tg_address} +| | ... | ${duts_prefix} +| | Set Interface State | ${dut1} | ${dut1_if1} | up +| | Set Interface State | ${dut1} | ${dut1_if2} | up +| | Set Interface State | ${dut2} | ${dut2_if1} | up +| | Set Interface State | ${dut2} | ${dut2_if2} | up +| | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1} +| | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2} +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | dut1_v4.set_arp | ${dut1_if1} | 10.10.10.2 | ${tg1_if1_mac} +| | dut1_v4.set_arp | ${dut1_if2} | ${dut2_dut1_address} | ${dut2_if1_mac} +| | dut2_v4.set_arp | ${dut2_if1} | ${dut1_dut2_address} | ${dut1_if2_mac} +| | dut2_v4.set_arp | ${dut2_if2} | 20.20.20.2 | ${tg1_if2_mac} +| | dut1_v4.set_ip | ${dut1_if1} | ${dut1_tg_address} | ${duts_prefix} +| | dut1_v4.set_ip | ${dut1_if2} | ${dut1_dut2_address} | ${duts_prefix} +| | dut2_v4.set_ip | ${dut2_if1} | ${dut2_dut1_address} | ${duts_prefix} +| | dut2_v4.set_ip | ${dut2_if2} | ${dut2_tg_address} | ${duts_prefix} +| | All Vpp Interfaces Ready Wait | ${nodes} + +| Lisp IPv6 forwarding initialized in a 3-node circular topology +| | [Documentation] | Custom setup of IPv6 topology on all DUT nodes \ +| | ... | Don`t set route. +| | ... +| | ... | *Arguments:* +| | ... | -${dut1_dut2_address} - Ip address from DUT1 to DUT2. Type: string +| | ... | -${dut1_tg_address} - Ip address from DUT1 to tg. Type: string +| | ... | -${dut2_dut1_address} - Ip address from DUT2 to DUT1. Type: string +| | ... | -${dut1_tg_address} - Ip address from DUT1 to tg. Type: string +| | ... | -${duts_prefix} - ip prefix. Type: int +| | ... +| | ... | *Return:* +| | ... | - No value returned +| | ... +| | ... | *Example:* +| | ... | \| Lisp IPv6 forwarding initialized in a 3-node circular topology \ +| | ... | \| ${dut1_dut2_address} \| ${dut1_tg_address} \ +| | ... | \| ${dut2_dut1_address} \| ${dut2_tg_address} \| ${duts_prefix} \| +| | ... +| | [Arguments] | ${dut1_dut2_address} | ${dut1_tg_address} +| | ... | ${dut2_dut1_address} | ${dut2_tg_address} +| | ... | ${prefix} +| | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1} +| | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2} +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | VPP Set If IPv6 Addr | ${dut1} | ${dut1_if1} | ${dut1_tg_address} +| | ... | ${prefix} +| | VPP Set If IPv6 Addr | ${dut1} | ${dut1_if2} | ${dut1_dut2_address} +| | ... | ${prefix} +| | VPP Set If IPv6 Addr | ${dut2} | ${dut2_if1} | ${dut2_dut1_address} +| | ... | ${prefix} +| | VPP Set If IPv6 Addr | ${dut2} | ${dut2_if2} | ${dut2_tg_address} +| | ... | ${prefix} +| | Vpp nodes ra suppress link layer | ${nodes} +| | Add Ip Neighbor | ${dut1} | ${dut1_if1} | 2001:1::2 +| | ... | ${tg1_if1_mac} +| | Add Ip Neighbor | ${dut2} | ${dut2_if2} | 2001:2::2 +| | ... | ${tg1_if2_mac} +| | Add Ip Neighbor | ${dut1} | ${dut1_if2} | ${dut2_dut1_address} +| | ... | ${dut2_if1_mac} +| | Add Ip Neighbor | ${dut2} | ${dut2_if1} | ${dut1_dut2_address} +| | ... | ${dut1_if2_mac} + +| Lisp IPv4 over IPv6 forwarding initialized in a 3-node circular topology +| | [Documentation] | Custom setup of IPv4 over IPv6 topology on all DUT nodes \ +| | ... | Don`t set route. +| | ... +| | ... | *Arguments:* +| | ... | -${dut1_dut2_ip6_address} - IPv6 address from DUT1 to DUT2. +| | ... | Type: string +| | ... | -${dut1_tg_ip4_address} - IPv4 address from DUT1 to tg. Type: string +| | ... | -${dut2_dut1_ip6_address} - IPv6 address from DUT2 to DUT1. +| | ... | Type: string +| | ... | -${dut1_tg_ip4_address} - IPv4 address from DUT1 to tg. Type: string +| | ... | -${prefix4} - IPv4 prefix. Type: int +| | ... | -${prefix6} - IPv6 prefix. Type: int +| | ... +| | ... | *Return:* +| | ... | - No value returned +| | ... +| | ... | *Example:* +| | ... | \| Lisp IPv4 over IPv6 forwarding initialized in a 3-node circular topology \ +| | ... | \| ${dut1_dut2_ip6_address} \| ${dut1_tg_ip4_address} \ +| | ... | \| ${dut2_dut1_ip6_address} \| ${dut2_tg_ip4_address} \ +| | ... | \| ${prefix4} \| ${prefix6} \| +| | ... +| | [Arguments] | ${dut1_dut2_ip6_address} | ${dut1_tg_ip4_address} +| | ... | ${dut2_dut1_ip6_address} | ${dut2_tg_ip4_address} +| | ... | ${prefix4} | ${prefix6} +| | Set Interface State | ${dut1} | ${dut1_if1} | up +| | Set Interface State | ${dut1} | ${dut1_if2} | up +| | Set Interface State | ${dut2} | ${dut2_if1} | up +| | Set Interface State | ${dut2} | ${dut2_if2} | up +| | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1} +| | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2} +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | dut1_v4.set_ip | ${dut1_if1} | ${dut1_tg_ip4_address} | ${prefix4} +| | VPP Set If IPv6 Addr | ${dut1} | ${dut1_if2} | ${dut1_dut2_ip6_address} +| | ... | ${prefix6} +| | VPP Set If IPv6 Addr | ${dut2} | ${dut2_if1} | ${dut2_dut1_ip6_address} +| | ... | ${prefix6} +| | dut2_v4.set_ip | ${dut2_if2} | ${dut2_tg_ip4_address} | ${prefix4} +| | Vpp nodes ra suppress link layer | ${nodes} +| | dut1_v4.set_arp | ${dut1_if1} | 10.10.10.2 | ${tg1_if1_mac} +| | dut2_v4.set_arp | ${dut2_if2} | 20.20.20.2 | ${tg1_if2_mac} +| | Add Ip Neighbor | ${dut1} | ${dut1_if2} | ${dut2_dut1_ip6_address} +| | ... | ${dut2_if1_mac} +| | Add Ip Neighbor | ${dut2} | ${dut2_if1} | ${dut1_dut2_ip6_address} +| | ... | ${dut1_if2_mac} + +| Lisp IPv6 over IPv4 forwarding initialized in a 3-node circular topology +| | [Documentation] | Custom setup of IPv4 over IPv6 topology on all DUT nodes \ +| | ... | Don`t set route. +| | ... +| | ... | *Arguments:* +| | ... | -${dut1_dut2_ip4_address} - IPv4 address from DUT1 to DUT2. +| | ... | Type: string +| | ... | -${dut1_tg_ip6_address} - IPv6 address from DUT1 to tg. Type: string +| | ... | -${dut2_dut1_ip4_address} - IPv4 address from DUT2 to DUT1. +| | ... | Type: string +| | ... | -${dut1_tg_ip6_address} - IPv6 address from DUT1 to tg. Type: string +| | ... | -${prefix4} - IPv4 prefix. Type: int +| | ... | -${prefix6} - IPv6 prefix. Type: int +| | ... +| | ... | *Return:* +| | ... | - No value returned +| | ... +| | ... | *Example:* +| | ... | \| Lisp IPv6 over IPv4 forwarding initialized in a 3-node circular topology \ +| | ... | \| ${dut1_dut2_ip4_address} \| ${dut1_tg_ip6_address} \ +| | ... | \| ${dut2_dut1_ip4_address} \| ${dut2_tg_ip6_address} \ +| | ... | \| ${prefix6} \| ${prefix4} \| +| | ... +| | [Arguments] | ${dut1_dut2_ip4_address} | ${dut1_tg_ip6_address} +| | ... | ${dut2_dut1_ip4_address} | ${dut2_tg_ip6_address} +| | ... | ${prefix6} | ${prefix4} +| | Set Interface State | ${dut1} | ${dut1_if1} | up +| | Set Interface State | ${dut1} | ${dut1_if2} | up +| | Set Interface State | ${dut2} | ${dut2_if1} | up +| | Set Interface State | ${dut2} | ${dut2_if2} | up +| | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1} +| | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2} +| | ${dut1_if2_mac}= | Get Interface MAC | ${dut1} | ${dut1_if2} +| | ${dut2_if1_mac}= | Get Interface MAC | ${dut2} | ${dut2_if1} +| | VPP Set If IPv6 Addr | ${dut1} | ${dut1_if1} | ${dut1_tg_ip6_address} +| | ... | ${prefix6} +| | dut1_v4.set_ip | ${dut1_if2} | ${dut1_dut2_ip4_address} | ${prefix4} +| | dut2_v4.set_ip | ${dut2_if1} | ${dut2_dut1_ip4_address} | ${prefix4} +| | VPP Set If IPv6 Addr | ${dut2} | ${dut2_if2} | ${dut2_tg_ip6_address} +| | ... | ${prefix6} +| | Vpp nodes ra suppress link layer | ${nodes} +| | Add Ip Neighbor | ${dut1} | ${dut1_if1} | 2001:1::2 | ${tg1_if1_mac} +| | Add Ip Neighbor | ${dut2} | ${dut2_if2} | 2001:2::2 | ${tg1_if2_mac} +| | dut1_v4.set_arp | ${dut1_if2} | ${dut2_dut1_ip4_address} | ${dut2_if1_mac} +| | dut2_v4.set_arp | ${dut2_if1} | ${dut1_dut2_ip4_address} | ${dut1_if2_mac} +