CSIT 1701 report files and script
[csit.git] / docs / report / vpp_functional_tests_virl / overview.rst
diff --git a/docs/report/vpp_functional_tests_virl/overview.rst b/docs/report/vpp_functional_tests_virl/overview.rst
new file mode 100644 (file)
index 0000000..cf7a5d2
--- /dev/null
@@ -0,0 +1,118 @@
+Overview\r
+========\r
+\r
+VPP Functional Test Topologies in VIRL\r
+--------------------------------------\r
+\r
+CSIT VPP functional tests are executed on virtualized topologies created using\r
+Virtual Internet Routing Lab (VIRL) simulation platform contributed by Cisco.\r
+VIRL runs on physical baremetal servers hosted by LF FD.io project.  Majority\r
+of the tests are executed in the three node logical test topology - Traffic\r
+Generator (TG) node and two Systems Under Test (SUT) nodes connected in a\r
+loop. Some tests use two node logical test topology - TG node and SUT node.\r
+Both logical test topologies are shown in the figures below:::\r
+\r
+    +------------------------+           +------------------------+\r
+    |                        |           |                        |\r
+    |  +------------------+  |           |  +------------------+  |\r
+    |  |                  <----------------->                  |  |\r
+    |  |                  |  |           |  |                  |  |\r
+    |  |       DUT1       <----------------->       DUT2       |  |\r
+    |  +--^--^------------+  |           |  +------------^--^--+  |\r
+    |     |  |               |           |               |  |     |\r
+    |     |  |         SUT1  |           |  SUT2         |  |     |\r
+    +------------------------+           +------------------------+\r
+          |  |                                           |  |\r
+          |  |                                           |  |\r
+          |  |               +-----------+               |  |\r
+          |  +--------------->           <---------------+  |\r
+          |                  |    TG     |                  |\r
+          +------------------>           <------------------+\r
+                             +-----------+\r
+\r
+                       +------------------------+\r
+                       |                        |\r
+                       |  +------------------+  |\r
+          +--------------->                  <--------------+\r
+          |            |  |                  |  |           |\r
+          |  |------------>       DUT1       <-----------+  |\r
+          |  |         |  +--^--^------------+  |        |  |\r
+          |  |         |                        |        |  |\r
+          |  |         |                  SUT1  |        |  |\r
+          |  |         +------------------------+        |  |\r
+          |  |                                           |  |\r
+          |  |                                           |  |\r
+          |  |               +-----------+               |  |\r
+          |  +--------------->           <---------------+  |\r
+          |                  |    TG     |                  |\r
+          +------------------>           <------------------+\r
+                             +-----------+\r
+\r
+Virtual testbeds are created dynamically whenever a verification job is\r
+started triggered by the patch submission to gerrit and destroyed upon\r
+completion of all functional tests. During test execution, all nodes are\r
+reachable thru the MGMT network connected to every node via dedicated NICs and\r
+links (not shown above for clarity). Each node is a Virtual Machine and each\r
+connection that is drawn on the diagram is available for use in any test case.\r
+\r
+For test cases that require DUT (VPP) to communicate with VM over vhost-user\r
+interfaces, a nested VM is created on SUT1 and/or SUT2 for the duration of\r
+that particular test case only. DUT (VPP) test topology with VM is shown in\r
+the figure below including the applicable packet flow thru the VM (marked with\r
+``*``).::\r
+\r
+    +------------------------+           +------------------------+\r
+    |      +----------+      |           |      +----------+      |\r
+    |      |    VM    |      |           |      |    VM    |      |\r
+    |      |  ******  |      |           |      |  ******  |      |\r
+    |      +--^----^--+      |           |      +--^----^--+      |\r
+    |        *|    |*        |           |        *|    |*        |\r
+    |  +------v----v------+  |           |  +------v----v------+  |\r
+    |  |      *    *      |**|***********|**|      *    *      |  |\r
+    |  |  *****    *******<----------------->*******    *****  |  |\r
+    |  |  *    DUT1       |  |           |  |       DUT2    *  |  |\r
+    |  +--^---------------+  |           |  +---------------^--+  |\r
+    |    *|                  |           |                  |*    |\r
+    |    *|            SUT1  |           |  SUT2            |*    |\r
+    +------------------------+           +------------------^-----+\r
+         *|                                                 |*\r
+         *|                                                 |*\r
+         *|                  +-----------+                  |*\r
+         *|                  |           |                  |*\r
+         *+------------------>    TG     <------------------+*\r
+         ******************* |           |********************\r
+                             +-----------+\r
+\r
+VPP Functional Tests Overview\r
+-----------------------------\r
+\r
+Following VPP functional test areas are included in the CSIT |release| with\r
+results listed in this report:\r
+\r
+- **DHCP - Client and Proxy** - Dynamic Host Control Protocol Client and Proxy\r
+  for IPv4, IPv6.\r
+- **GRE Overlay Tunnels** - Generic Routing Encapsulation for IPv4.\r
+- **L2BD Ethernet Switching** - L2 Bridge-Domain switched-forwarding for\r
+  untagged Ethernet, dot1q and dot1ad tagged.\r
+- **L2XC Ethernet Switching** - L2 Cross-Connect switched-forwarding for\r
+  untagged Ethernet, dot1q and dot1ad tagged.\r
+- **LISP Overlay Tunnels** - Locator/ID Separation Protocol overlay tunnels and\r
+  locator/id mapping control.\r
+- **Softwire Tunnels** - IPv4-in-IPv6 softwire tunnels.\r
+- **Cop Address Security** - address white-list and black-list filtering for\r
+  IPv4, IPv6.\r
+- **IPSec - Tunnels and Transport** - IPSec tunnel and transport modes.\r
+- **IPv6 Routed-Forwarding** - IPv6 routed-forwarding, NS/ND, RA, ICMPv6.\r
+- **uRPF Source Security** - unicast Reverse Path Forwarding security.\r
+- **Tap Interface** - baseline Linux tap interface tests.\r
+- **Telemetry - IPFIX and SPAN** - IPFIX netflow statistics and SPAN port\r
+  mirroring.\r
+- **VRF Routed-Forwarding** - multi-context IPVPN routed-forwarding for IPv4,\r
+  IPv6.\r
+- **iACL Security** - ingress Access Control List security for IPv4, IPv6, MAC.\r
+- **IPv4 Routed-Forwarding** - IPv4 routed-forwarding, RPF, ARP, Proxy ARP,\r
+  ICMPv4.\r
+- **QoS Policer Metering** - ingress packet rate measuring and marking for IPv4,\r
+  IPv6.\r
+- **VLAN Tag Translation** - L2 VLAN tag translation 2to2, 2to1, 1to2, 1to1.\r
+- **VXLAN Overlay Tunnels** - VXLAN tunneling for L2-over-IP, for IPv4, IPv6.\r