X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=tests%2Fvpp%2Fperf%2Fip4%2F10ge2p1x520-ethip4udp-ip4scale2000-udpsrcscale15-nat44-ndrpdrdisc.robot;h=b5980ca6a43b72273ba08ad06f23911e4ba06e33;hp=dcc74efacc44b8b7019e4e46dcbe804628e673fc;hb=6a6126b2f26607263e4543a1e0b5012ab2f0601b;hpb=66039913f070f4bb81e10f6ed503e0f2242ff70d diff --git a/tests/vpp/perf/ip4/10ge2p1x520-ethip4udp-ip4scale2000-udpsrcscale15-nat44-ndrpdrdisc.robot b/tests/vpp/perf/ip4/10ge2p1x520-ethip4udp-ip4scale2000-udpsrcscale15-nat44-ndrpdrdisc.robot index dcc74efacc..b5980ca6a4 100644 --- a/tests/vpp/perf/ip4/10ge2p1x520-ethip4udp-ip4scale2000-udpsrcscale15-nat44-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip4/10ge2p1x520-ethip4udp-ip4scale2000-udpsrcscale15-nat44-ndrpdrdisc.robot @@ -20,8 +20,10 @@ | ... | NIC_Intel-X520-DA2 | ETH | IP4FWD | FEATURE | NAT44 | SRC_USER_2000 | ... | SCALE | ... -| Suite Setup | Set up 3-node performance topology with DUT's NIC model -| ... | L3 | Intel-X520-DA2 +| Suite Setup | Run Keywords +| ... | Set up 3-node performance topology with DUT's NIC model | L3 +| ... | Intel-X520-DA2 +| ... | AND | Set up performance test suite with NAT | Suite Teardown | Tear down 3-node performance topology | ... | Test Setup | Set up performance test @@ -31,18 +33,6 @@ | ... | Documentation | *NAT44 performance test cases* | ... -| ... | *High level description* -| ... -| ... | - NDR and PDR tests -| ... | - 3-node topology, TG-DUT1-DUT2-TG, NAT44 is enabled between DUTs. -| ... | - Cores / threads: 1t1c, 2t2c, and 4t4c -| ... | - Framesize: 64B, 1518B, IMIX -| ... | - Packet: ETH / IP(src, dst) / UDP(src_port, dst_port) / payload -| ... | - scale: src: 1 user, 10 users, 100 users, ..., 4000 up to the memory -| ... | limit; 15 ports per user -| ... -| ... | *Low level description* -| ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. | ... | *[Enc] Packet Encapsulations:* Eth-IPv4-UDP for IPv4 routing. @@ -83,7 +73,7 @@ | | ${get_framesize}= | Get Frame Size | ${framesize} | | ... | | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology -| | And Add PCI devices to DUTs in 3-node single link topology +| | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs | | And Add NAT to all DUTs @@ -102,234 +92,234 @@ *** Test Cases *** | tc01-64B-1t1c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 1 phy core,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for 64 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 64B | 1T1C | STHREAD | NDRDISC +| | [Tags] | 64B | 1C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=1 | rxq=1 | framesize=${64} | min_rate=${100000} | search_type=NDR +| | wt=1 | rxq=1 | framesize=${64} | min_rate=${50000} | search_type=NDR | tc02-64B-1t1c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 1 phy core,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for 64 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 64B | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 1C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=1 | rxq=1 | framesize=${64} | min_rate=${100000} | search_type=PDR +| | wt=1 | rxq=1 | framesize=${64} | min_rate=${50000} | search_type=PDR | tc03-1518B-1t1c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 1 phy core,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for 1518 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 1T1C | STHREAD | NDRDISC +| | [Tags] | 1518B | 1C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=1 | rxq=1 | framesize=${1518} | min_rate=${100000} | search_type=NDR +| | wt=1 | rxq=1 | framesize=${1518} | min_rate=${50000} | search_type=NDR | tc04-1518B-1t1c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 1 phy core,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 1C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=1 | rxq=1 | framesize=${1518} | min_rate=${100000} | search_type=PDR +| | wt=1 | rxq=1 | framesize=${1518} | min_rate=${50000} | search_type=PDR | tc05-IMIX-1t1c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 1 phy core,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for IMIX frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | IMIX | 1T1C | STHREAD | NDRDISC +| | [Tags] | IMIX | 1C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${100000} | search_type=NDR +| | wt=1 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${50000} | search_type=NDR | tc06-IMIX-1t1c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 1 thread, 1 phy core,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 1 phy core,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for IMIX frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | IMIX | 1T1C | STHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 1C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${100000} | search_type=PDR +| | wt=1 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${50000} | search_type=PDR | tc07-64B-2t2c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 2 phy cores,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for 64 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 64B | 2T2C | MTHREAD | NDRDISC +| | [Tags] | 64B | 2C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=2 | rxq=1 | framesize=${64} | min_rate=${100000} | search_type=NDR +| | wt=2 | rxq=1 | framesize=${64} | min_rate=${50000} | search_type=NDR | tc08-64B-2t2c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 2 phy cores,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for 64 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 64B | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 2C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=2 | rxq=1 | framesize=${64} | min_rate=${100000} | search_type=PDR +| | wt=2 | rxq=1 | framesize=${64} | min_rate=${50000} | search_type=PDR | tc09-1518B-2t2c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 2 phy cores,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for 1518 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 2T2C | MTHREAD | NDRDISC +| | [Tags] | 1518B | 2C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=2 | rxq=1 | framesize=${1518} | min_rate=${100000} | search_type=NDR +| | wt=2 | rxq=1 | framesize=${1518} | min_rate=${50000} | search_type=NDR | tc10-1518B-2t2c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 2 phy cores,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 2C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=2 | rxq=1 | framesize=${1518} | min_rate=${100000} | search_type=PDR +| | wt=2 | rxq=1 | framesize=${1518} | min_rate=${50000} | search_type=PDR | tc11-IMIX-2t2c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 2 phy cores,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for IMIX frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | IMIX | 2T2C | MTHREAD | NDRDISC +| | [Tags] | IMIX | 2C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${100000} | search_type=NDR +| | wt=2 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${50000} | search_type=NDR | tc12-IMIX-2t2c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 2 threads, 2 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 2 phy cores,\ | | ... | 1 receive queue per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for IMIX frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | IMIX | 2T2C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 2C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${100000} | search_type=PDR +| | wt=2 | rxq=1 | framesize=IMIX_v4_1 | min_rate=${50000} | search_type=PDR | tc13-64B-4t4c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 4 phy cores,\ | | ... | 2 receive queues per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for 64 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 64B | 4T4C | MTHREAD | NDRDISC +| | [Tags] | 64B | 4C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=4 | rxq=2 | framesize=${64} | min_rate=${100000} | search_type=NDR +| | wt=4 | rxq=2 | framesize=${64} | min_rate=${50000} | search_type=NDR | tc14-64B-4t4c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 4 phy cores,\ | | ... | 2 receive queues per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for 64 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 64B | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 64B | 4C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=4 | rxq=2 | framesize=${64} | min_rate=${100000} | search_type=PDR +| | wt=4 | rxq=2 | framesize=${64} | min_rate=${50000} | search_type=PDR | tc15-1518B-4t4c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 4 phy cores,\ | | ... | 2 receive queues per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for 1518 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 4T4C | MTHREAD | NDRDISC +| | [Tags] | 1518B | 4C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=4 | rxq=2 | framesize=${1518} | min_rate=${100000} | search_type=NDR +| | wt=4 | rxq=2 | framesize=${1518} | min_rate=${50000} | search_type=NDR | tc16-1518B-4t4c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 4 phy cores,\ | | ... | 2 receive queues per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | 1518B | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | 1518B | 4C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=4 | rxq=2 | framesize=${1518} | min_rate=${100000} | search_type=PDR +| | wt=4 | rxq=2 | framesize=${1518} | min_rate=${50000} | search_type=PDR | tc17-IMIX-4t4c-ethip4udp-ip4scale2000-udpsrcscale15-snat-ndrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 4 phy cores,\ | | ... | 2 receive queues per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find NDR for IMIX frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | IMIX | 4T4C | MTHREAD | NDRDISC +| | [Tags] | IMIX | 4C | NDRDISC | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 | min_rate=${100000} | search_type=NDR +| | wt=4 | rxq=2 | framesize=IMIX_v4_1 | min_rate=${50000} | search_type=NDR | tc18-IMIX-4t4c-ethip4udp-ip4scale2000-udpsrcscale15-snat-pdrdisc | | [Documentation] -| | ... | [Cfg] DUT runs IPv4 routing config with 4 threads, 4 phy cores,\ +| | ... | [Cfg] DUT runs IPv4 routing config with 4 phy cores,\ | | ... | 2 receive queues per NIC port. NAT44 is configured between DUTs -\ | | ... | 2000 users and 15 ports (sessions) per user. | | ... | [Ver] Find PDR for IMIX frames using binary search start at 10GE\ -| | ... | linerate, step 100kpps. +| | ... | linerate, step 50kpps. | | ... -| | [Tags] | IMIX | 4T4C | MTHREAD | PDRDISC | SKIP_PATCH +| | [Tags] | IMIX | 4C | PDRDISC | SKIP_PATCH | | ... | | [Template] | Discover NDR or PDR for IPv4 routing with NAT44 -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 | min_rate=${100000} | search_type=PDR +| | wt=4 | rxq=2 | framesize=IMIX_v4_1 | min_rate=${50000} | search_type=PDR