7 CSIT VPP functional tests are executed on virtualized topologies created using
8 :abbr:`VIRL (Virtual Internet Routing Lab)` simulation platform contributed by
9 Cisco. VIRL runs on physical baremetal servers hosted by LF FD.io project.
10 Based on the packet path thru server SUTs, two distinct logical topology types
11 are used for VPP DUT data plane testing:
13 #. NIC-to-NIC switching topologies.
14 #. VM service switching topologies.
19 The simplest logical topology for software data plane application like
20 VPP is NIC-to-NIC switching. Tested topologies for 2-Node and 3-Node
21 testbeds are shown in figures below.
29 \graphicspath{{../_tmp/src/vpp_performance_tests/}}
30 \includegraphics[width=0.90\textwidth]{logical-2n-nic2nic}
31 \label{fig:logical-2n-nic2nic}
36 .. figure:: ../vpp_performance_tests/logical-2n-nic2nic.svg
37 :alt: logical-2n-nic2nic
47 \graphicspath{{../_tmp/src/vpp_performance_tests/}}
48 \includegraphics[width=0.90\textwidth]{logical-3n-nic2nic}
49 \label{fig:logical-3n-nic2nic}
54 .. figure:: ../vpp_performance_tests/logical-3n-nic2nic.svg
55 :alt: logical-3n-nic2nic
58 SUT1 and SUT2 are two VMs (Ubuntu or Centos, depending on the test suite), TG
59 is a Traffic Generator (TG, another Ubuntu VM). SUTs run VPP SW application in
60 Linux user-mode as a Device Under Test (DUT) within the VM. TG runs Scapy SW
61 application as a packet Traffic Generator. Logical connectivity between SUTs
62 and to TG is provided using virtual NICs using VMs' virtio driver.
64 Virtual testbeds are created on-demand whenever a verification job is started
65 (e.g. triggered by the gerrit patch submission) and destroyed upon completion
66 of all functional tests. Each node is a Virtual Machine and each connection
67 that is drawn on the diagram is available for use in any test case. During the
68 test execution, all nodes are reachable thru the Management network connected
69 to every node via dedicated virtual NICs and virtual links (not shown above
75 VM service switching topology test cases require VPP DUT to communicate
76 with Virtual Machines (VMs) over vhost-user virtual interfaces. A nested VM is
77 created on SUT1 and/or SUT2 for the duration of these particular test cases
78 only. DUT (VPP) test topology with VM is shown in the figure below.
86 \graphicspath{{../_tmp/src/vpp_performance_tests/}}
87 \includegraphics[width=0.90\textwidth]{logical-2n-vm-vhost}
88 \label{fig:logical-2n-vm-vhost}
93 .. figure:: ../vpp_performance_tests/logical-2n-vm-vhost.svg
94 :alt: logical-2n-vm-vhost
104 \graphicspath{{../_tmp/src/vpp_performance_tests/}}
105 \includegraphics[width=0.90\textwidth]{logical-3n-vm-vhost}
106 \label{fig:logical-3n-vm-vhost}
111 .. figure:: ../vpp_performance_tests/logical-3n-vm-vhost.svg
112 :alt: logical-3n-vm-vhost
115 Functional Tests Coverage
116 -------------------------
118 Following VPP functional test areas are covered in the |csit-release| with
119 results listed in this report:
121 - **DHCP - Client and Proxy** - Dynamic Host Control Protocol Client and Proxy
123 - **GRE Overlay Tunnels** - Generic Routing Encapsulation for IPv4.
124 - **L2BD Ethernet Switching** - L2 Bridge-Domain switched-forwarding for
125 untagged Ethernet, dot1q and dot1ad tagged.
126 - **L2XC Ethernet Switching** - L2 Cross-Connect switched-forwarding for
127 untagged Ethernet, dot1q and dot1ad tagged.
128 - **LISP Overlay Tunnels** - Locator/ID Separation Protocol overlay tunnels and
129 locator/id mapping control.
130 - **Softwire Tunnels** - IPv4-in-IPv6 softwire tunnels.
131 - **Cop Address Security** - address white-list and black-list filtering for
133 - **IPSec - Tunnels and Transport** - IPSec tunnel and transport modes.
134 - **IPv6 Routed-Forwarding** - IPv6 routed-forwarding, NS/ND, RA, ICMPv6.
135 - **uRPF Source Security** - unicast Reverse Path Forwarding security.
136 - **Tap Interface** - baseline Linux tap interface tests.
137 - **Telemetry - IPFIX and SPAN** - IPFIX netflow statistics and SPAN port
139 - **VRF Routed-Forwarding** - multi-context IPVPN routed-forwarding for IPv4,
141 - **iACL Security** - ingress Access Control List security for IPv4, IPv6, MAC.
142 - **IPv4 Routed-Forwarding** - IPv4 routed-forwarding, RPF, ARP, Proxy ARP,
144 - **QoS Policer Metering** - ingress packet rate measuring and marking for IPv4,
146 - **VLAN Tag Translation** - L2 VLAN tag translation 2to2, 2to1, 1to2, 1to1.
147 - **VXLAN Overlay Tunnels** - VXLAN tunneling for L2-over-IP, for IPv4, IPv6.
149 Functional Tests Naming
150 -----------------------
152 |csit-release| follows a common structured naming convention for all performance
153 and system functional tests, introduced in CSIT-17.01.
155 The naming should be intuitive for majority of the tests. Complete description
156 of CSIT test naming convention is provided on :ref:`csit_test_naming`.