4 All CSIT test cases are labelled with Robot Framework tags used to allow for
5 easy test case type identification, test case grouping and selection for
6 execution. Following sections list currently used CSIT TAGs and their
12 .. topic:: 3_NODE_DOUBLE_LINK_TOPO
14 3 nodes connected in a circular topology with two links interconnecting
17 .. topic:: 3_NODE_SINGLE_LINK_TOPO
19 3 nodes connected in a circular topology with at least one link
20 interconnecting devices.
27 Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch)
28 and csit-vpp-verify jobs (i.e. CSIT patch).
30 .. topic:: SKIP_VPP_PATCH
32 Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch).
39 DUTs and TGs are running on bare metal.
43 DUTs and TGs are running in virtual environment.
47 DUTs with VPP and capable of running Virtual Machine.
52 .. topic:: NIC_Intel-X520-DA2
56 .. topic:: NIC_Intel-XL710
60 .. topic:: NIC_Intel-X710
64 .. topic:: NIC_Cisco-VIC-1227
68 .. topic:: NIC_Cisco-VIC-1385
77 2x10,000 entries in single fib table
81 2x100,000 entries in single fib table
85 2x1,000,000 entries in single fib table
89 IPSec in tunnel mode - 1000 tunnels.
91 .. topic:: SRC_USER_10
93 Traffic flow with 10 unique IPs (users) in one direction.
95 .. topic:: SRC_USER_100
97 Traffic flow with 100 unique IPs (users) in one direction.
99 .. topic:: SRC_USER_1000
101 Traffic flow with 1000 unique IPs (users) in one direction.
103 .. topic:: SRC_USER_2000
105 Traffic flow with 2000 unique IPs (users) in one direction.
107 .. topic:: SRC_USER_4000
109 Traffic flow with 4000 unique IPs (users) in one direction.
111 Tags marking functional vs. performance of tests
112 ------------------------------------------------
116 All functional test cases.
120 All performance test cases.
122 Performance testing tags
123 ------------------------
127 Partial Drop Rate evaluation of single run result, with non-zero packet
128 loss tolerance (LT) expressed in percentage of packets transmitted.
132 Non Drop Rate evaluation of results. Loss acceptance of dropped packets is
133 set to zero lost packets.
137 Performance tests where TG verifies DUTs' throughput at ref-NDR (reference
138 Non Drop Rate) with zero packet loss tolerance.
140 .. topic:: NDRPDRDISC
142 Find performance of DUT based on RFC2544 with linear / binary / combined
143 search. (Previous LONG tests.)
145 Ethernet frame size tags for performance tests
146 ----------------------------------------------
150 64B frames used for test.
154 78B frames used for test.
158 IMIX frame sequence (28x 64B, 16x 570B, 4x 1518B) used for test.
162 1460B frames used for test.
166 1480B frames used for test.
170 1514B frames used for test.
174 1518B frames used for test.
178 9000B frames used for test.
185 Baseline test cases, no encapsulation, no feature(s) configured in tests.
189 IPv4 baseline test cases, no encapsulation, no feature(s) configured in
194 IPv6 baseline test cases, no encapsulation, no feature(s) configured in
199 L2XC baseline test cases, no encapsulation, no feature(s) configured in
204 L2BD baseline test cases, no encapsulation, no feature(s) configured in
213 Test cases where encapsulation is used. Use also encapsulation tag(s).
217 At least one feature is configured in test cases. Use also feature tag(s).
221 Functional test cases for TLDK.
226 .. topic:: L2BDMACSTAT
228 VPP L2 bridge-domain, L2 MAC static.
230 .. topic:: L2BDMACLRN
232 VPP L2 bridge-domain, L2 MAC learning.
236 VPP L2 point-to-point cross-connect.
240 VPP IPv4 routed forwarding.
244 VPP IPv6 routed forwarding.
257 .. topic:: MPLSUNRLAY
270 IPv4 overlay (IPv4 payload).
274 IPv6 overlay (IPv6 payload).
281 All test cases with base Ethernet (no encapsulation).
285 All test cases with dot1q.
289 All test cases with dot1ad.
293 All test cases with LISP.
297 All test cases with LISP-GPE.
301 All test cases with Vxlan.
305 All test cases with VXLAN-GPE.
309 All test cases with GRE.
313 All test cases with IPSEC.
320 All test cases which use physical interface(s).
324 All test cases which uses VHOST.
328 All test cases which uses TUN and TAP.
332 All test cases which uses AFPKT.
336 All test cases which uses Netmap.
340 All test cases which uses Memif.
355 SNAT configured and tested.
370 IPSec in transport mode.
374 IPSec in tunnel mode.
381 All test cases which use at least one virtual machine.
385 All test cases which use Linux container.
389 All test cases with specific APP use.
396 All test cases using single poll mode thread.
400 All test cases using more then one poll mode driver thread.
404 All test cases with packet processing on single socket.
408 All test cases with packet processing on two sockets.
412 All test cases with symmetric Multi-Threading (HyperThreading) enabled.
416 All test cases with symmetric Multi-Threading (HyperThreading) disabled.
420 1 worker thread pinned to 1 dedicated physical core. 1 receive queue per
421 interface. Main thread pinned to core 0.
425 2 worker threads pinned to 2 dedicated physical cores. 1 receive queue per
426 interface. Main thread pinned to core 0.
430 4 worker threads pinned to 4 dedicated physical cores. 2 receive queues per
431 interface. Main thread pinned to core 0.
435 6 worker threads pinned to 6 dedicated physical cores. 3 receive queues per
436 interface. Main thread pinned to core 0.
440 8 worker threads pinned to 8 dedicated physical cores. 4 receive queues per
441 interface. Main thread pinned to core 0.
448 Honeycomb functional test cases.
450 .. topic:: HC_PERSIST
452 Honeycomb persistence test cases.
454 .. topic:: HC_REST_ONLY
456 (Exclusion tag) Honeycomb test cases that cannot be run in Netconf mode
457 using ODL client for Restfconf -> Netconf translation.