1 # Copyright (c) 2018 Cisco and/or its affiliates.
2 # Licensed under the Apache License, Version 2.0 (the "License");
3 # you may not use this file except in compliance with the License.
4 # You may obtain a copy of the License at:
6 # http://www.apache.org/licenses/LICENSE-2.0
8 # Unless required by applicable law or agreed to in writing, software
9 # distributed under the License is distributed on an "AS IS" BASIS,
10 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
11 # See the License for the specific language governing permissions and
12 # limitations under the License.
15 | Resource | resources/libraries/robot/performance/performance_setup.robot
16 | Resource | resources/libraries/robot/dpdk/default.robot
17 | Library | resources.libraries.python.topology.Topology
18 | Library | resources.libraries.python.NodePath
19 | Library | resources.libraries.python.InterfaceUtil
20 | Library | resources.libraries.python.DPDK.DPDKTools
21 | Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDRDISC | 1NUMA
22 | ... | NIC_Intel-X520-DA2 | DPDK | IP4FWD | BASE | ETH
23 | Suite Setup | Set up DPDK 3-node performance topology with DUT's NIC model
24 | ... | L3 | Intel-X520-DA2
25 | Suite Teardown | Tear down DPDK 3-node performance topology
26 | Documentation | *RFC2544: Pkt throughput IPv4 routing test cases*
28 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
29 | ... | with single links between nodes.
30 | ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L3 IPv4 routing.
31 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 run the DPDK l3fwd application
32 | ... | DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
33 | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop
34 | ... | Rate) with zero packet loss tolerance or throughput PDR (Partial Drop
35 | ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage
36 | ... | of packets transmitted. NDR and PDR are discovered for different
37 | ... | Ethernet L2 frame sizes using either binary search or linear search
38 | ... | algorithms with configured starting rate and final step that determines
39 | ... | throughput measurement resolution. Test packets are generated by TG on
40 | ... | links to DUTs. TG traffic profile contains two L3 flow-groups
41 | ... | (flow-group per direction, 253 flows per flow-group) with all packets
42 | ... | containing Ethernet header, IPv4 header with IP protocol=61 and static
43 | ... | payload. MAC addresses are matching MAC addresses of the TG node
45 | ... | *[Ref] Applicable standard specifications:* RFC2544.
48 # X520-DA2 bandwidth limit
49 | ${s_limit} | ${10000000000}
51 | ${traffic_profile} | trex-sl-3n-ethip4-ip4dst253_l3fwd
54 | tc01-64B-1t1c-ethip4-ip4base-l3fwd-ndrdisc
56 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 1 phy core,\
57 | | ... | 1 receive queue per NIC port.
58 | | ... | [Ver] Find NDR for 64 Byte frames using binary search start\
59 | | ... | at 10GE linerate, step 100kpps.
61 | | [Tags] | 64B | 1C | NDRDISC
63 | | ${framesize}= | Set Variable | ${64}
64 | | ${min_rate}= | Set Variable | ${100000}
65 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
66 | | ${binary_min}= | Set Variable | ${min_rate}
67 | | ${binary_max}= | Set Variable | ${max_rate}
68 | | ${threshold}= | Set Variable | ${min_rate}
69 | | Given Start L3FWD on all DUTs | 1 | 1 | no
70 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
71 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
72 | | ... | ${threshold}
74 | tc02-64B-1t1c-ethip4-ip4base-l3fwd-pdrdisc
76 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 1 phy core,\
77 | | ... | 1 receive queue per NIC port.
78 | | ... | [Ver] Find PDR for 64 Byte frames using binary search start\
79 | | ... | at 10GE linerate, step 100kpps, LT=0.5%.
81 | | [Tags] | 64B | 1C | PDRDISC | SKIP_PATCH
83 | | ${framesize}= | Set Variable | ${64}
84 | | ${min_rate}= | Set Variable | ${100000}
85 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
86 | | ${binary_min}= | Set Variable | ${min_rate}
87 | | ${binary_max}= | Set Variable | ${max_rate}
88 | | ${threshold}= | Set Variable | ${min_rate}
89 | | Given Start L3FWD on all DUTs | 1 | 1 | no
90 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
91 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
92 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
93 | | ... | ${perf_pdr_loss_acceptance_type}
95 | tc03-1518B-1t1c-ethip4-ip4base-l3fwd-ndrdisc
97 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 1 phy core,\
98 | | ... | 1 receive queue per NIC port.
99 | | ... | [Ver] Find NDR for 1518 Byte frames using binary search start\
100 | | ... | at 10GE linerate, step 10kpps.
102 | | [Tags] | 1518B | 1C | NDRDISC
104 | | ${framesize}= | Set Variable | ${1518}
105 | | ${min_rate}= | Set Variable | ${10000}
106 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
107 | | ${binary_min}= | Set Variable | ${min_rate}
108 | | ${binary_max}= | Set Variable | ${max_rate}
109 | | ${threshold}= | Set Variable | ${min_rate}
110 | | Given Start L3FWD on all DUTs | 1 | 1 | no
111 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
112 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
113 | | ... | ${threshold}
115 | tc04-1518B-1t1c-ethip4-ip4base-l3fwd-pdrdisc
117 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 1 phy core,\
118 | | ... | 1 receive queue per NIC port.
119 | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start\
120 | | ... | at 10GE linerate, step 10kpps, LT=0.5%.
122 | | [Tags] | 1518B | 1C | PDRDISC | SKIP_PATCH
124 | | ${framesize}= | Set Variable | ${1518}
125 | | ${min_rate}= | Set Variable | ${10000}
126 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
127 | | ${binary_min}= | Set Variable | ${min_rate}
128 | | ${binary_max}= | Set Variable | ${max_rate}
129 | | ${threshold}= | Set Variable | ${min_rate}
130 | | Given Start L3FWD on all DUTs | 1 | 1 | no
131 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
132 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
133 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
134 | | ... | ${perf_pdr_loss_acceptance_type}
136 | tc05-9000B-1t1c-ethip4-ip4base-l3fwd-ndrdisc
138 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 1 phy core,\
139 | | ... | 1 receive queue per NIC port.
140 | | ... | [Ver] Find NDR for 9000 Byte frames using binary search start\
141 | | ... | at 10GE linerate, step 5kpps.
143 | | [Tags] | 9000B | 1C | NDRDISC
145 | | ${framesize}= | Set Variable | ${9000}
146 | | ${min_rate}= | Set Variable | ${10000}
147 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
148 | | ${binary_min}= | Set Variable | ${min_rate}
149 | | ${binary_max}= | Set Variable | ${max_rate}
150 | | ${threshold}= | Set Variable | ${min_rate}
151 | | Given Start L3FWD on all DUTs | 1 | 1 | yes
152 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
153 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
154 | | ... | ${threshold}
156 | tc06-9000B-1t1c-ethip4-ip4base-l3fwd-pdrdisc
158 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 1 phy core,\
159 | | ... | 1 receive queue per NIC port.
160 | | ... | [Ver] Find PDR for 9000 Byte frames using binary search start\
161 | | ... | at 10GE linerate, step 5kpps, LT=0.5%.
163 | | [Tags] | 9000B | 1C | PDRDISC | SKIP_PATCH
165 | | ${framesize}= | Set Variable | ${9000}
166 | | ${min_rate}= | Set Variable | ${10000}
167 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
168 | | ${binary_min}= | Set Variable | ${min_rate}
169 | | ${binary_max}= | Set Variable | ${max_rate}
170 | | ${threshold}= | Set Variable | ${min_rate}
171 | | Given Start L3FWD on all DUTs | 1 | 1 | yes
172 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
173 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
174 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
175 | | ... | ${perf_pdr_loss_acceptance_type}
177 | tc07-64B-2t2c-ethip4-ip4base-l3fwd-ndrdisc
179 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 2 phy cores,\
180 | | ... | 1 receive queue per NIC port.
181 | | ... | [Ver] Find NDR for 64 Byte frames using binary search start\
182 | | ... | at 10GE linerate, step 100kpps.
184 | | [Tags] | 64B | 2C | NDRDISC
186 | | ${framesize}= | Set Variable | ${64}
187 | | ${min_rate}= | Set Variable | ${100000}
188 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
189 | | ${binary_min}= | Set Variable | ${min_rate}
190 | | ${binary_max}= | Set Variable | ${max_rate}
191 | | ${threshold}= | Set Variable | ${min_rate}
192 | | Given Start L3FWD on all DUTs | 2 | 1 | no
193 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
194 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
195 | | ... | ${threshold}
197 | tc08-64B-2t2c-ethip4-ip4base-l3fwd-pdrdisc
199 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 2 phy cores,\
200 | | ... | 1 receive queue per NIC port.
201 | | ... | [Ver] Find PDR for 64 Byte frames using binary search start\
202 | | ... | at 10GE linerate, step 100kpps, LT=0.5%.
204 | | [Tags] | 64B | 2C | PDRDISC | SKIP_PATCH
206 | | ${framesize}= | Set Variable | ${64}
207 | | ${min_rate}= | Set Variable | ${100000}
208 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
209 | | ${binary_min}= | Set Variable | ${min_rate}
210 | | ${binary_max}= | Set Variable | ${max_rate}
211 | | ${threshold}= | Set Variable | ${min_rate}
212 | | Given Start L3FWD on all DUTs | 2 | 1 | no
213 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
214 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
215 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
216 | | ... | ${perf_pdr_loss_acceptance_type}
218 | tc09-1518B-2t2c-ethip4-ip4base-l3fwd-ndrdisc
220 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 2 phy cores,\
221 | | ... | 1 receive queue per NIC port.
222 | | ... | [Ver] Find NDR for 1518 Byte frames using binary search start\
223 | | ... | at 10GE linerate, step 10kpps.
225 | | [Tags] | 1518B | 2C | NDRDISC
227 | | ${framesize}= | Set Variable | ${1518}
228 | | ${min_rate}= | Set Variable | ${10000}
229 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
230 | | ${binary_min}= | Set Variable | ${min_rate}
231 | | ${binary_max}= | Set Variable | ${max_rate}
232 | | ${threshold}= | Set Variable | ${min_rate}
233 | | Given Start L3FWD on all DUTs | 2 | 1 | no
234 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
235 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
236 | | ... | ${threshold}
238 | tc10-1518B-2t2c-ethip4-ip4base-l3fwd-pdrdisc
240 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 2 phy cores,\
241 | | ... | 1 receive queue per NIC port.
242 | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start\
243 | | ... | at 10GE linerate, step 10kpps, LT=0.5%.
245 | | [Tags] | 1518B | 2C | PDRDISC | SKIP_PATCH
247 | | ${framesize}= | Set Variable | ${1518}
248 | | ${min_rate}= | Set Variable | ${10000}
249 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
250 | | ${binary_min}= | Set Variable | ${min_rate}
251 | | ${binary_max}= | Set Variable | ${max_rate}
252 | | ${threshold}= | Set Variable | ${min_rate}
253 | | Given Start L3FWD on all DUTs | 2 | 1 | no
254 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
255 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
256 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
257 | | ... | ${perf_pdr_loss_acceptance_type}
259 | tc11-9000B-2t2c-ethip4-ip4base-l3fwd-ndrdisc
261 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 2 phy cores,\
262 | | ... | 1 receive queue per NIC port.
263 | | ... | [Ver] Find NDR for 9000 Byte frames using binary search start\
264 | | ... | at 10GE linerate, step 5kpps.
266 | | [Tags] | 9000B | 2C | NDRDISC
268 | | ${framesize}= | Set Variable | ${9000}
269 | | ${min_rate}= | Set Variable | ${10000}
270 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
271 | | ${binary_min}= | Set Variable | ${min_rate}
272 | | ${binary_max}= | Set Variable | ${max_rate}
273 | | ${threshold}= | Set Variable | ${min_rate}
274 | | Given Start L3FWD on all DUTs | 2 | 1 | yes
275 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
276 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
277 | | ... | ${threshold}
279 | tc12-9000B-2t2c-ethip4-ip4base-l3fwd-pdrdisc
281 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 2 phy cores,\
282 | | ... | 1 receive queue per NIC port.
283 | | ... | [Ver] Find PDR for 9000 Byte frames using binary search start\
284 | | ... | at 10GE linerate, step 5kpps, LT=0.5%.
286 | | [Tags] | 9000B | 2C | PDRDISC | SKIP_PATCH
288 | | ${framesize}= | Set Variable | ${9000}
289 | | ${min_rate}= | Set Variable | ${10000}
290 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
291 | | ${binary_min}= | Set Variable | ${min_rate}
292 | | ${binary_max}= | Set Variable | ${max_rate}
293 | | ${threshold}= | Set Variable | ${min_rate}
294 | | Given Start L3FWD on all DUTs | 2 | 1 | yes
295 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
296 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
297 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
298 | | ... | ${perf_pdr_loss_acceptance_type}
300 | tc13-64B-4t4c-ethip4-ip4base-l3fwd-ndrdisc
302 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 4 phy cores,\
303 | | ... | 2 receive queues per NIC port.
304 | | ... | [Ver] Find NDR for 64 Byte frames using binary search start\
305 | | ... | at 10GE linerate, step 100kpps.
307 | | [Tags] | 64B | 4C | NDRDISC
309 | | ${framesize}= | Set Variable | ${64}
310 | | ${min_rate}= | Set Variable | ${100000}
311 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
312 | | ${binary_min}= | Set Variable | ${min_rate}
313 | | ${binary_max}= | Set Variable | ${max_rate}
314 | | ${threshold}= | Set Variable | ${min_rate}
315 | | Given Start L3FWD on all DUTs | 4 | 2 | no
316 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
317 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
318 | | ... | ${threshold}
320 | tc14-64B-4t4c-ethip4-ip4base-l3fwd-pdrdisc
322 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 4 phy cores,\
323 | | ... | 2 receive queues per NIC port.
324 | | ... | [Ver] Find PDR for 64 Byte frames using binary search start\
325 | | ... | at 10GE linerate, step 100kpps, LT=0.5%.
327 | | [Tags] | 64B | 4C | PDRDISC | SKIP_PATCH
329 | | ${framesize}= | Set Variable | ${64}
330 | | ${min_rate}= | Set Variable | ${100000}
331 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
332 | | ${binary_min}= | Set Variable | ${min_rate}
333 | | ${binary_max}= | Set Variable | ${max_rate}
334 | | ${threshold}= | Set Variable | ${min_rate}
335 | | Given Start L3FWD on all DUTs | 4 | 2 | no
336 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
337 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
338 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
339 | | ... | ${perf_pdr_loss_acceptance_type}
341 | tc15-1518B-4t4c-ethip4-ip4base-l3fwd-ndrdisc
343 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 4 phy cores,\
344 | | ... | 2 receive queues per NIC port.
345 | | ... | [Ver] Find NDR for 1518 Byte frames using binary search start\
346 | | ... | at 10GE linerate, step 10kpps.
348 | | [Tags] | 1518B | 4C | NDRDISC | SKIP_PATCH
350 | | ${framesize}= | Set Variable | ${1518}
351 | | ${min_rate}= | Set Variable | ${10000}
352 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
353 | | ${binary_min}= | Set Variable | ${min_rate}
354 | | ${binary_max}= | Set Variable | ${max_rate}
355 | | ${threshold}= | Set Variable | ${min_rate}
356 | | Given Start L3FWD on all DUTs | 4 | 2 | no
357 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
358 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
359 | | ... | ${threshold}
361 | tc16-1518B-4t4c-ethip4-ip4base-l3fwd-pdrdisc
363 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 4 phy cores,\
364 | | ... | 2 receive queues per NIC port.
365 | | ... | [Ver] Find PDR for 1518 Byte frames using binary search start\
366 | | ... | at 10GE linerate, step 10kpps, LT=0.5%.
368 | | [Tags] | 1518B | 4C | PDRDISC | SKIP_PATCH
370 | | ${framesize}= | Set Variable | ${1518}
371 | | ${min_rate}= | Set Variable | ${10000}
372 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
373 | | ${binary_min}= | Set Variable | ${min_rate}
374 | | ${binary_max}= | Set Variable | ${max_rate}
375 | | ${threshold}= | Set Variable | ${min_rate}
376 | | Given Start L3FWD on all DUTs | 4 | 2 | no
377 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
378 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
379 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
380 | | ... | ${perf_pdr_loss_acceptance_type}
382 | tc17-9000B-4t4c-ethip4-ip4base-l3fwd-ndrdisc
384 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 4 phy cores,\
385 | | ... | 2 receive queues per NIC port.
386 | | ... | [Ver] Find NDR for 9000 Byte frames using binary search start\
387 | | ... | at 10GE linerate, step 5kpps.
389 | | [Tags] | 9000B | 4C | NDRDISC | SKIP_PATCH
391 | | ${framesize}= | Set Variable | ${9000}
392 | | ${min_rate}= | Set Variable | ${10000}
393 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
394 | | ${binary_min}= | Set Variable | ${min_rate}
395 | | ${binary_max}= | Set Variable | ${max_rate}
396 | | ${threshold}= | Set Variable | ${min_rate}
397 | | Given Start L3FWD on all DUTs | 4 | 2 | yes
398 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
399 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
400 | | ... | ${threshold}
402 | tc18-9000B-4t4c-ethip4-ip4base-l3fwd-pdrdisc
404 | | ... | [Cfg] DUT runs L3 IPv4 routing config with 4 phy cores,\
405 | | ... | 2 receive queues per NIC port.
406 | | ... | [Ver] Find PDR for 9000 Byte frames using binary search start\
407 | | ... | at 10GE linerate, step 5kpps, LT=0.5%.
409 | | [Tags] | 9000B | 4C | PDRDISC | SKIP_PATCH
411 | | ${framesize}= | Set Variable | ${9000}
412 | | ${min_rate}= | Set Variable | ${10000}
413 | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize}
414 | | ${binary_min}= | Set Variable | ${min_rate}
415 | | ${binary_max}= | Set Variable | ${max_rate}
416 | | ${threshold}= | Set Variable | ${min_rate}
417 | | Given Start L3FWD on all DUTs | 4 | 2 | yes
418 | | Then Find PDR using binary search and pps | ${framesize} | ${binary_min}
419 | | ... | ${binary_max} | ${traffic_profile} | ${min_rate} | ${max_rate}
420 | | ... | ${threshold} | ${perf_pdr_loss_acceptance}
421 | | ... | ${perf_pdr_loss_acceptance_type}