X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=tests%2Fvpp%2Fperf%2Fcrypto%2F40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdrdisc.robot;h=5488e9bb11ec46a40c4251b468194fbf8deba61d;hp=cd56ceb4627fe28511b5af8eb94dde14a2e5a149;hb=6a6126b2f26607263e4543a1e0b5012ab2f0601b;hpb=2cc797fa23da02eefa19637521098ec41622189b diff --git a/tests/vpp/perf/crypto/40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdrdisc.robot b/tests/vpp/perf/crypto/40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdrdisc.robot index cd56ceb462..5488e9bb11 100644 --- a/tests/vpp/perf/crypto/40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdrdisc.robot +++ b/tests/vpp/perf/crypto/40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdrdisc.robot @@ -19,6 +19,7 @@ | ... | IP4FWD | IPSEC | IPSECHW | IPSECTUN | NIC_Intel-XL710 | TNL_1000 | ... | Suite Setup | Set up IPSec performance test suite | L3 | Intel-XL710 +| ... | HW_cryptodev | ... | Suite Teardown | Tear down 3-node performance topology | ... @@ -54,9 +55,9 @@ *** Variables *** # XL710-DA2 bandwidth limit ~49Gbps/2=24.5Gbps -| ${s_24.5G} | ${24500000000} +| ${s_24.5G}= | ${24500000000} # XL710-DA2 Mpps limit 37.5Mpps/2=18.75Mpps -| ${s_18.75Mpps} | ${18750000} +| ${s_18.75Mpps}= | ${18750000} | ${tg_if1_ip4}= | 192.168.10.2 | ${dut1_if1_ip4}= | 192.168.10.1 | ${dut1_if2_ip4}= | 172.168.1.1 @@ -69,20 +70,21 @@ | ${ipsec_overhead_gcm}= | ${54} | ${n_tunnels}= | ${1000} # Traffic profile: -| ${traffic_profile} | trex-sl-3n-ethip4-ip4dst${n_tunnels} +| ${traffic_profile}= | trex-sl-3n-ethip4-ip4dst${n_tunnels} *** Test Cases *** | tc01-64B-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 1 thread, 1 phy core, 1 receive queue per NIC port. +| | ... | configured with 1 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find NDR for 64 Byte frames\ -| | ... | using binary search start at 40GE linerate, step 100kpps. +| | ... | using binary search start at 40GE linerate, step 50kpps. | | ... -| | [Tags] | 64B | 1T1C | STHREAD | NDRDISC +| | [Tags] | 64B | 1C | NDRDISC | | ... +| | # FIXME: Move repeated lines into a keyword. | | ${framesize}= | Set Variable | ${64} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} @@ -90,18 +92,19 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add cryptodev to all DUTs | ${1} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find NDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} @@ -109,14 +112,14 @@ | tc02-64B-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-pdrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 1 thread, 1 phy core, 1 receive queue per NIC port. +| | ... | configured with 1 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find PDR for 64 Byte frames using binary search start at 40GE\ -| | ... | linerate, step 100kpps and loss tolerance of 0.5%. +| | ... | linerate, step 50kpps and loss tolerance of 0.5%. | | ... -| | [Tags] | 64B | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 1C | PDRDISC | SKIP_PATCH | | ... | | ${framesize}= | Set Variable | ${64} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} @@ -124,18 +127,19 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add cryptodev to all DUTs | ${1} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find PDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} | ${perf_pdr_loss_acceptance} @@ -144,14 +148,14 @@ | tc03-1518B-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 1 thread, 1 phy core, 1 receive queue per NIC port. +| | ... | configured with 1 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find NDR for 1518 Byte frames\ -| | ... | using binary search start at 40GE linerate, step 100kpps. +| | ... | using binary search start at 40GE linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 1T1C | STHREAD | NDRDISC +| | [Tags] | 1518B | 1C | NDRDISC | | ... | | ${framesize}= | Set Variable | ${1518} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | | ... | ${framesize + ${ipsec_overhead_gcm}} | | ${binary_min}= | Set Variable | ${min_rate} @@ -160,17 +164,18 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add cryptodev to all DUTs | ${1} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find NDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} @@ -178,14 +183,14 @@ | tc04-1518B-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-pdrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnel AES GCM in each direction,\ -| | ... | configured with 1 thread, 1 phy core, 1 receive queue per NIC port. +| | ... | configured with 1 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start at 40GE\ -| | ... | linerate, step 100kpps and loss tolerance of 0.5%. +| | ... | linerate, step 50kpps and loss tolerance of 0.5%. | | ... -| | [Tags] | 1518B | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 1C | PDRDISC | SKIP_PATCH | | ... | | ${framesize}= | Set Variable | ${1518} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | | ... | ${framesize + ${ipsec_overhead_gcm}} | | ${binary_min}= | Set Variable | ${min_rate} @@ -194,17 +199,18 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add cryptodev to all DUTs | ${1} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find PDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} | ${perf_pdr_loss_acceptance} @@ -213,16 +219,16 @@ | tc05-IMIX-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 1 thread, 1 phy core, 1 receive queue per NIC port. +| | ... | configured with 1 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find NDR for IMIX_v4_1 frames\ -| | ... | using binary search start at 40GE linerate, step 100kpps. +| | ... | using binary search start at 40GE linerate, step 50kpps. | | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) | | ... -| | [Tags] | IMIX | 1T1C | STHREAD | NDRDISC +| | [Tags] | IMIX | 1C | NDRDISC | | ... | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${imix_size}= | Get Frame Size | ${framesize} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | | ... | ${imix_size} + ${ipsec_overhead_gcm} | | ${binary_min}= | Set Variable | ${min_rate} @@ -231,17 +237,18 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add cryptodev to all DUTs | ${1} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find NDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} @@ -249,16 +256,16 @@ | tc06-IMIX-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-pdrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 1 thread, 1 phy core, 1 receive queue per NIC port. +| | ... | configured with 1 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find PDR for IMIX_v4_1 frames using binary search start at 40GE\ -| | ... | linerate, step 100kpps and loss tolerance of 0.5%. +| | ... | linerate, step 50kpps and loss tolerance of 0.5%. | | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) | | ... -| | [Tags] | IMIX | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 1C | PDRDISC | SKIP_PATCH | | ... | | ${framesize}= | Set Variable | IMIX_v4_1 | | ${imix_size}= | Get Frame Size | ${framesize} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Calculate pps | ${s_24.5G} | | ... | ${imix_size} + ${ipsec_overhead_gcm} | | ${binary_min}= | Set Variable | ${min_rate} @@ -267,17 +274,18 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add cryptodev to all DUTs | ${1} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find PDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} | ${perf_pdr_loss_acceptance} @@ -286,14 +294,14 @@ | tc07-64B-2t2c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 2 thread, 2 phy core, 1 receive queue per NIC port. +| | ... | configured with 2 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find NDR for 64 Byte frames\ -| | ... | using binary search start at 40GE linerate, step 100kpps. +| | ... | using binary search start at 40GE linerate, step 50kpps. | | ... -| | [Tags] | 64B | 2T2C | MTHREAD | NDRDISC +| | [Tags] | 64B | 2C | NDRDISC | | ... | | ${framesize}= | Set Variable | ${64} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} @@ -301,18 +309,19 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add cryptodev to all DUTs | ${2} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find NDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} @@ -320,14 +329,14 @@ | tc08-64B-2t2c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-pdrdisc | | [Documentation] | | ... | [Cfg] DUTs run 1000 IPsec tunnels AES GCM in each direction,\ -| | ... | configured with 2 thread, 2 phy core, 1 receive queue per NIC port. +| | ... | configured with 2 phy core, 1 receive queue per NIC port. | | ... | [Ver] Find PDR for 64 Byte frames using binary search start at 40GE\ -| | ... | linerate, step 100kpps and loss tolerance of 0.5%. +| | ... | linerate, step 50kpps and loss tolerance of 0.5%. | | ... -| | [Tags] | 64B | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 2C | PDRDISC | SKIP_PATCH | | ... | | ${framesize}= | Set Variable | ${64} -| | ${min_rate}= | Set Variable | ${10000} +| | ${min_rate}= | Set Variable | ${50000} | | ${max_rate}= | Set Variable | ${s_18.75Mpps} | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} @@ -335,18 +344,19 @@ | | ${encr_alg}= | Crypto Alg AES GCM 128 | | ${auth_alg}= | Integ Alg AES GCM 128 | | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology -| | And Generate keys for IPSec | ${encr_alg} | ${auth_alg} -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add cryptodev to all DUTs | ${2} | | And Add DPDK dev default RXD to all DUTs | 2048 | | And Add DPDK dev default TXD to all DUTs | 2048 | | And Apply startup configuration on all VPP DUTs +| | When Generate keys for IPSec | ${encr_alg} | ${auth_alg} | | And Initialize IPSec in 3-node circular topology | | And VPP IPsec Create Tunnel Interfaces | | ... | ${dut1} | ${dut2} | ${dut1_if2_ip4} | ${dut2_if1_ip4} | ${dut1_if2} | | ... | ${dut2_if1} | ${n_tunnels} | ${encr_alg} | ${encr_key} | ${auth_alg} | | ... | ${auth_key} | ${laddr_ip4} | ${raddr_ip4} | ${addr_range} +| | And Set interfaces in path in 3-node circular topology up | | Then Find PDR using binary search and pps | ${framesize} | | ... | ${binary_min} | ${binary_max} | ${traffic_profile} | | ... | ${min_rate} | ${max_rate} | ${threshold} | ${perf_pdr_loss_acceptance}