4 All CSIT test cases are labelled with Robot Framework tags used to allow for
5 easy test case type identification, test case grouping and selection for
6 execution. Following sections list currently used CSIT TAGs and their
7 documentation based on the content of
8 `tag documentation rst file`_.
13 .. topic:: 3_NODE_DOUBLE_LINK_TOPO
15 3 nodes connected in a circular topology with two links interconnecting
18 .. topic:: 3_NODE_SINGLE_LINK_TOPO
20 3 nodes connected in a circular topology with at least one link
21 interconnecting devices.
28 Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch)
29 and csit-vpp-verify jobs (i.e. CSIT patch).
37 DUTs and TGs are running on bare metal.
41 DUTs and TGs are running in virtual environment.
45 DUTs with VPP and capable of running Virtual Machine.
51 .. topic:: NIC_Intel-X520-DA2
55 .. topic:: NIC_Intel-XL710
59 .. topic:: NIC_Intel-X710
63 .. topic:: NIC_Cisco-VIC-1227
67 .. topic:: NIC_Cisco-VIC-1385
77 2x10,000 entries in single fib table
81 2x100,000 entries in single fib table
85 2x1,000,000 entries in single fib table
88 Tags marking functional vs. performance of tests
89 ------------------------------------------------
93 All functional test cases.
97 All performance test cases.
100 Performance testing tags
101 ------------------------
105 Partial Drop Rate evaluation of single run result, with non-zero packet
106 loss tolerance (LT) expressed in percentage of packets transmitted.
110 Non Drop Rate evaluation of results. Loss acceptance of dropped packets is
111 set to zero lost packets.
115 Performance tests where TG verifies DUTs' throughput at ref-NDR (reference
116 Non Drop Rate) with zero packet loss tolerance.
118 .. topic:: NDRPDRDISC
120 Find performance of DUT based on RFC2544 with linear / binary / combined
121 search. (Previous LONG tests.)
123 Ethernet frame size tags for performance tests
124 ----------------------------------------------
128 64B frames used for test.
132 78B frames used for test.
136 IMIX frame sequence (28x 64B, 16x 570B, 4x 1518B) used for test.
140 1460B frames used for test.
144 1480B frames used for test.
148 1514B frames used for test.
152 1518B frames used for test.
156 9000B frames used for test.
163 Baseline test cases, no encapsulation, no feature(s) configured in tests.
167 IPv4 baseline test cases, no encapsulation, no feature(s) configured in
172 IPv6 baseline test cases, no encapsulation, no feature(s) configured in
177 L2XC baseline test cases, no encapsulation, no feature(s) configured in
182 L2BD baseline test cases, no encapsulation, no feature(s) configured in
191 Test cases where encapsulation is used. Use also encapsulation tag(s).
195 At least one feature is configured in test cases. Use also feature tag(s).
201 .. topic:: L2BDMACSTAT
203 VPP L2 bridge-domain, L2 MAC static.
205 .. topic:: L2BDMACLRN
207 VPP L2 bridge-domain, L2 MAC learning.
211 VPP L2 point-to-point cross-connect.
215 VPP IPv4 routed forwarding.
219 VPP IPv6 routed forwarding.
233 .. topic:: MPLSUNRLAY
247 IPv4 overlay (IPv4 payload).
251 IPv6 overlay (IPv6 payload).
259 All test cases with base Ethernet (no encapsulation).
263 All test cases with dot1q.
267 All test cases with dot1ad.
271 All test cases with LISP.
275 All test cases with LISP-GPE.
279 All test cases with Vxlan.
283 All test cases with VXLAN-GPE.
287 All test cases with GRE.
291 All test cases with IPSEC.
299 All test cases which use physical interface(s).
303 All test cases which uses VHOST.
307 All test cases which uses TUN and TAP.
311 All test cases which uses AFPKT.
315 All test cases which uses Netmap.
331 SNAT configured and tested.
347 IPSec in transport mode.
351 IPSec in tunnel mode.
359 All test cases which use at least one virtual machine.
363 All test cases which use Linux container.
367 All test cases with specific APP use.
375 All test cases using single poll mode thread.
379 All test cases using more then one poll mode driver thread.
383 All test cases with packet processing on single socket.
387 All test cases with packet processing on two sockets.
391 All test cases with symmetric Multi-Threading (HyperThreading) enabled.
395 All test cases with symmetric Multi-Threading (HyperThreading) disabled.
399 1 worker thread pinned to 1 dedicated physical core. 1 receive queue per
400 interface. Main thread pinned to core 0.
404 2 worker threads pinned to 2 dedicated physical cores. 1 receive queue per
405 interface. Main thread pinned to core 0.
409 4 worker threads pinned to 4 dedicated physical cores. 2 receive queues per
410 interface. Main thread pinned to core 0.
414 6 worker threads pinned to 6 dedicated physical cores. 3 receive queues per
415 interface. Main thread pinned to core 0.
419 8 worker threads pinned to 8 dedicated physical cores. 4 receive queues per
420 interface. Main thread pinned to core 0.