4 All CSIT test cases are labelled with Robot Framework tags used to allow for
5 easy test case type identification, test case grouping and selection for
6 execution. Following sections list currently used CSIT TAGs and their
12 .. topic:: 3_NODE_DOUBLE_LINK_TOPO
14 3 nodes connected in a circular topology with two links interconnecting
17 .. topic:: 3_NODE_SINGLE_LINK_TOPO
19 3 nodes connected in a circular topology with at least one link
20 interconnecting devices.
27 Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch)
28 and csit-vpp-verify jobs (i.e. CSIT patch).
30 .. topic:: SKIP_VPP_PATCH
32 Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch).
39 DUTs and TGs are running on bare metal.
43 DUTs and TGs are running in virtual environment.
47 DUTs with VPP and capable of running Virtual Machine.
52 .. topic:: NIC_Intel-X520-DA2
56 .. topic:: NIC_Intel-XL710
60 .. topic:: NIC_Intel-X710
64 .. topic:: NIC_Cisco-VIC-1227
68 .. topic:: NIC_Cisco-VIC-1385
77 2x10,000 entries in single fib table
81 2x100,000 entries in single fib table
85 2x1,000,000 entries in single fib table
89 IPSec in tunnel mode - 1000 tunnels.
91 .. topic:: SRC_USER_10
93 Traffic flow with 10 unique IPs (users) in one direction.
95 .. topic:: SRC_USER_100
97 Traffic flow with 100 unique IPs (users) in one direction.
99 .. topic:: SRC_USER_1000
101 Traffic flow with 1000 unique IPs (users) in one direction.
103 .. topic:: SRC_USER_2000
105 Traffic flow with 2000 unique IPs (users) in one direction.
107 .. topic:: SRC_USER_4000
109 Traffic flow with 4000 unique IPs (users) in one direction.
111 Tags marking functional vs. performance of tests
112 ------------------------------------------------
116 All functional test cases.
120 All performance test cases.
122 Performance testing tags
123 ------------------------
127 Partial Drop Rate evaluation of single run result, with non-zero packet
128 loss tolerance (LT) expressed in percentage of packets transmitted.
132 Non Drop Rate evaluation of results. Loss acceptance of dropped packets is
133 set to zero lost packets.
137 Performance tests where TG verifies DUTs' throughput at ref-NDR (reference
138 Non Drop Rate) with zero packet loss tolerance.
140 .. topic:: NDRPDRDISC
142 Find performance of DUT based on RFC2544 with linear / binary / combined
143 search. (Previous LONG tests.)
145 Ethernet frame size tags for performance tests
146 ----------------------------------------------
150 64B frames used for test.
154 78B frames used for test.
158 IMIX frame sequence (28x 64B, 16x 570B, 4x 1518B) used for test.
162 1460B frames used for test.
166 1480B frames used for test.
170 1514B frames used for test.
174 1518B frames used for test.
178 9000B frames used for test.
185 Baseline test cases, no encapsulation, no feature(s) configured in tests.
189 IPv4 baseline test cases, no encapsulation, no feature(s) configured in
194 IPv6 baseline test cases, no encapsulation, no feature(s) configured in
199 L2XC baseline test cases, no encapsulation, no feature(s) configured in
204 L2BD baseline test cases, no encapsulation, no feature(s) configured in
213 Test cases where encapsulation is used. Use also encapsulation tag(s).
217 At least one feature is configured in test cases. Use also feature tag(s).
221 Functional test cases for TLDK.
226 .. topic:: L2BDMACSTAT
228 VPP L2 bridge-domain, L2 MAC static.
230 .. topic:: L2BDMACLRN
232 VPP L2 bridge-domain, L2 MAC learning.
236 VPP L2 point-to-point cross-connect.
240 VPP IPv4 routed forwarding.
244 VPP IPv6 routed forwarding.
257 .. topic:: MPLSUNRLAY
270 IPv4 overlay (IPv4 payload).
274 IPv6 overlay (IPv6 payload).
281 All test cases with base Ethernet (no encapsulation).
285 All test cases with dot1q.
289 All test cases with dot1ad.
293 All test cases with LISP.
297 All test cases with LISP-GPE.
301 All test cases with Vxlan.
305 All test cases with VXLAN-GPE.
309 All test cases with GRE.
313 All test cases with IPSEC.
320 All test cases which use physical interface(s).
324 All test cases which uses VHOST.
328 All test cases which uses VHOST with qemu queue size set to 256.
330 .. topic:: VHOST_1024
332 All test cases which uses VHOST with qemu queue size set to 1024.
336 All test cases which uses VM with optimised scheduler policy.
340 All test cases which uses TUN and TAP.
344 All test cases which uses AFPKT.
348 All test cases which uses Netmap.
352 All test cases which uses Memif.
367 SNAT configured and tested.
382 IPSec in transport mode.
386 IPSec in tunnel mode.
393 All test cases which use at least one virtual machine.
397 All test cases which use Linux container.
401 All test cases with specific APP use.
408 All test cases using single poll mode thread.
412 All test cases using more then one poll mode driver thread.
416 All test cases with packet processing on single socket.
420 All test cases with packet processing on two sockets.
424 All test cases with symmetric Multi-Threading (HyperThreading) enabled.
428 All test cases with symmetric Multi-Threading (HyperThreading) disabled.
432 1 worker thread pinned to 1 dedicated physical core. 1 receive queue per
433 interface. Main thread pinned to core 0.
437 2 worker threads pinned to 2 dedicated physical cores. 1 receive queue per
438 interface. Main thread pinned to core 0.
442 4 worker threads pinned to 4 dedicated physical cores. 2 receive queues per
443 interface. Main thread pinned to core 0.
447 6 worker threads pinned to 6 dedicated physical cores. 3 receive queues per
448 interface. Main thread pinned to core 0.
452 8 worker threads pinned to 8 dedicated physical cores. 4 receive queues per
453 interface. Main thread pinned to core 0.
460 Honeycomb functional test cases.
462 .. topic:: HC_PERSIST
464 Honeycomb persistence test cases.
466 .. topic:: HC_REST_ONLY
468 (Exclusion tag) Honeycomb test cases that cannot be run in Netconf mode
469 using ODL client for Restfconf -> Netconf translation.