Report 1804: SRv6 and func part update

Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst
index 1eb3b97..e8fb102 100644 (file)
--- a/docs/report/vpp_functional_tests/csit_release_notes.rst
+++ b/docs/report/vpp_functional_tests/csit_release_notes.rst
@@ -4,14 +4,12 @@ CSIT Release Notes
 Changes in CSIT |release|
 -------------------------
 
-#. VPP functional test framework changes:
-
-   - improved stability of tests with nested-VM and QEMU;
-
 #. Code updates and optimizations in CSIT functional framework:
 
-   - IPSecSW tests - Software based IPSec encryption with CBC-SHA1 and
-     CBC-SHA ciphers, in combination with IPv4 routed-forwarding;
+   - VPP install test - VPP installation have been moved to separate test in
+   test suite setup phase to clearly indicate any issue with VPP installation;
+
+   - VPP verify test - test to check VPP responsiveness after installation;
 
 Known Issues
 ------------

diff --git a/docs/report/vpp_functional_tests/test_environment.rst b/docs/report/vpp_functional_tests/test_environment.rst
index 5b29b2d..6a70336 100644 (file)
--- a/docs/report/vpp_functional_tests/test_environment.rst
+++ b/docs/report/vpp_functional_tests/test_environment.rst
@@ -240,30 +240,47 @@ Example of DUT nodes configuration:::
     | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend\r
     |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)\r
     ||/ Name           Version       Architecture Description\r
-    +++-==============-=============-============-=============================================\r
-    ii  vpp            17.07-release amd64        Vector Packet Processing--executables\r
-    ii  vpp-dbg        17.07-release amd64        Vector Packet Processing--debug symbols\r
-    ii  vpp-dev        17.07-release amd64        Vector Packet Processing--development support\r
-    ii  vpp-dpdk-dev   17.07-release amd64        Vector Packet Processing--development support\r
-    ii  vpp-dpdk-dkms  17.07-release amd64        DPDK 2.1 igb_uio_driver\r
-    ii  vpp-lib        17.07-release amd64        Vector Packet Processing--runtime libraries\r
-    ii  vpp-plugins    17.07-release amd64        Vector Packet Processing--runtime plugins\r
+    +++-==============-=============-============-=================================================\r
+    ii  vpp            18.04-release amd64        Vector Packet Processing--executables\r
+    ii  vpp-dbg        18.04-release amd64        Vector Packet Processing--debug symbols\r
+    ii  vpp-dev        18.04-release amd64        Vector Packet Processing--development support\r
+    ii  vpp-dpdk-dkms  18.02-vpp1    amd64        DPDK Development Package for VPP - Kernel Modules\r
+    ii  vpp-lib        18.04-release amd64        Vector Packet Processing--runtime libraries\r
+    ii  vpp-plugins    18.04-release amd64        Vector Packet Processing--runtime plugins\r
 \r
 **VPP Startup Configuration**\r
 \r
-VPP startup configuration is common for all test cases.\r
+VPP startup configuration is common for all test cases except test cases related\r
+to SW Crypto device.\r
+\r
+**Default**\r
 \r
 ::\r
 \r
     $ cat /etc/vpp/startup.conf\r
     unix {\r
       nodaemon\r
-      log /tmp/vpp.log\r
+      log /var/log/vpp/vpp.log\r
       full-coredump\r
+      cli-listen /run/vpp/cli.sock\r
+      gid vpp\r
     }\r
 \r
     api-trace {\r
+    ## This stanza controls binary API tracing. Unless there is a very strong reason,\r
+    ## please leave this feature enabled.\r
       on\r
+    ## Additional parameters:\r
+    ##\r
+    ## To set the number of binary API trace records in the circular buffer, configure nitems\r
+    ##\r
+    ## nitems <nnn>\r
+    ##\r
+    ## To save the api message table decode tables, configure a filename. Results in /tmp/<filename>\r
+    ## Very handy for understanding api message changes between versions, identifying missing\r
+    ## plugins, and so forth.\r
+    ##\r
+    ## save-api-table <filename>\r
     }\r
 \r
     api-segment {\r
@@ -306,7 +323,7 @@ VPP startup configuration is common for all test cases.
         # scheduler-priority 50\r
     }\r
 \r
-    dpdk {\r
+    # dpdk {\r
         ## Change default settings for all intefaces\r
         # dev default {\r
             ## Number of receive queues, enables RSS\r
@@ -337,9 +354,19 @@ VPP startup configuration is common for all test cases.
         #      num-rx-queues 2\r
         # }\r
 \r
-        ## Change UIO driver used by VPP, Options are: uio_pci_generic, vfio-pci\r
-        ## and igb_uio (default)\r
-        # uio-driver uio_pci_generic\r
+        ## Specify bonded interface and its slaves via PCI addresses\r
+        ##\r
+        ## Bonded interface in XOR load balance mode (mode 2) with L3 and L4 headers\r
+        # vdev eth_bond0,mode=2,slave=0000:02:00.0,slave=0000:03:00.0,xmit_policy=l34\r
+        # vdev eth_bond1,mode=2,slave=0000:02:00.1,slave=0000:03:00.1,xmit_policy=l34\r
+        ##\r
+        ## Bonded interface in Active-Back up mode (mode 1)\r
+        # vdev eth_bond0,mode=1,slave=0000:02:00.0,slave=0000:03:00.0\r
+        # vdev eth_bond1,mode=1,slave=0000:02:00.1,slave=0000:03:00.1\r
+\r
+        ## Change UIO driver used by VPP, Options are: igb_uio, vfio-pci,\r
+        ## uio_pci_generic or auto (default)\r
+        # uio-driver vfio-pci\r
 \r
         ## Disable mutli-segment buffers, improves performance but\r
         ## disables Jumbo MTU support\r
@@ -347,12 +374,57 @@ VPP startup configuration is common for all test cases.
 \r
         ## Increase number of buffers allocated, needed only in scenarios with\r
         ## large number of interfaces and worker threads. Value is per CPU socket.\r
-        ## Default is 32768\r
+        ## Default is 16384\r
         # num-mbufs 128000\r
 \r
         ## Change hugepages allocation per-socket, needed only if there is need for\r
         ## larger number of mbufs. Default is 256M on each detected CPU socket\r
         # socket-mem 2048,2048\r
+\r
+        ## Disables UDP / TCP TX checksum offload. Typically needed for use\r
+        ## faster vector PMDs (together with no-multi-seg)\r
+        # no-tx-checksum-offload\r
+    # }\r
+\r
+\r
+    # plugins {\r
+        ## Adjusting the plugin path depending on where the VPP plugins are\r
+        #      path /home/bms/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins\r
+\r
+        ## Disable all plugins by default and then selectively enable specific plugins\r
+        # plugin default { disable }\r
+        # plugin dpdk_plugin.so { enable }\r
+        # plugin acl_plugin.so { enable }\r
+\r
+        ## Enable all plugins by default and then selectively disable specific plugins\r
+        # plugin dpdk_plugin.so { disable }\r
+        # plugin acl_plugin.so { disable }\r
+    # }\r
+\r
+        ## Alternate syntax to choose plugin path\r
+        # plugin_path /home/bms/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins\r
+\r
+**SW Crypto Device**\r
+\r
+::\r
+\r
+    $ cat /etc/vpp/startup.conf\r
+    unix\r
+    {\r
+      cli-listen /run/vpp/cli.sock\r
+      gid vpp\r
+      nodaemon\r
+      full-coredump\r
+      log /tmp/vpp.log\r
+    }\r
+    api-segment\r
+    {\r
+      gid vpp\r
+    }\r
+    dpdk\r
+    {\r
+      vdev cryptodev_aesni_gcm_pmd,socket_id=0\r
+      vdev cryptodev_aesni_mb_pmd,socket_id=0\r
     }\r
 \r
 TG Configuration\r

diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 8fd8a3b..f4036eb 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -4,43 +4,38 @@ CSIT Release Notes
 Changes in CSIT |release|\r
 -------------------------\r
 \r
-#. Added VPP performance tests\r
+#. **Added VPP performance tests**\r
 \r
-   - **Container Service Chain Topologies Orchestrated by K8s with VPP Memif**\r
+   - **MRR tests** : New MRR tests measure the packet forwarding rate\r
+       under the maximum load offered by traffic generator over a set\r
+       trial duration, regardless of packet loss. Maximum load for\r
+       specified Ethernet frame size is set to the bi-directional link\r
+       rate. MRR tests are used for continuous performance trending and\r
+       for comparison between releases.\r
 \r
-     - Added tests with VPP vswitch in container connecting a number of VPP-\r
-       in-container service chain topologies with L2 Cross-Connect and L2\r
-       Bridge-Domain configurations, orchestrated by Kubernetes. Added\r
-       following forwarding topologies: i) "Parallel" with packets flowing from\r
-       NIC via VPP to container and back to VPP and NIC; ii) "Chained" (a.k.a.\r
-       "Snake") with packets flowing via VPP to container, back to VPP, to next\r
-       container, back to VPP and so on until the last container in a chain,\r
-       then back to VPP and NIC; iii) "Horizontal" with packets flowing via VPP\r
-       to container, then via "horizontal" memif to next container, and so on\r
-       until the last container, then back to VPP and NIC;\r
+   - **Service Chaining with SRv6** : SRv6 (Segment Routing IPv6) proxy tests\r
+       verifying performance of Endpoint to SR-unaware appliance via\r
+       masquerading (End.AM), dynamic proxy (End.AD) or static proxy (End.AS)\r
+       functions.\r
 \r
-   - **MRR tests**\r
+#. **Presentation and Analytics Layer (PAL)**\r
 \r
-     - <placeholder>;\r
+     - Added continuous performance measuring, trending and anomaly\r
+       detection. Includes new PAL code and Jenkins jobs for Performance\r
+       Trending (PT) and Performance Analysis (PA) producing performance\r
+       trending dashboard and trendline graphs with summary and drill-\r
+       down views across all specified tests that can be reviewed and\r
+       inspected regularly by FD.io developers and users community.\r
 \r
-   - **SRv6**\r
+#. **Test Framework Optimizations**\r
 \r
-     - Initial SRv6 (Segment Routing IPv6) tests verifying performance of\r
-       IPv6 and SRH (Segment Routing Header) encapsulation, decapsulation,\r
-       lookups and rewrites based on configured End and End.DX6 SRv6 egress\r
-       functions;\r
+     - **Performance tests efficiency** : Qemu build/install\r
+     optimizations, warmup phase handling, vpp restart handling.\r
+     Resulted in improved stability and reduced total execution time by\r
+     30% for single pkt size e.g. 64B/78B.\r
 \r
-#. Presentation and Analytics Layer\r
-\r
-     - Added throughput speedup analysis for multi-core and multi-thread\r
-       VPP tests into Presentation and Analytics Layer (PAL) for automated\r
-       CSIT test results analysis;\r
-\r
-#. Other changes\r
-\r
-     - **Framework optimizations**\r
-\r
-       - Performance test duration improvements and stability;\r
+     - **General code housekeeping** : ongoing RF keywords\r
+     optimizations, removal of redundant RF keywords.\r
 \r
 Performance Changes\r
 -------------------\r
@@ -98,6 +93,8 @@ pretty ASCII formats:
 Known Issues\r
 ------------\r
 \r
+<to be updated before rls1804 release>\r
+\r
 Here is the list of known issues in CSIT |release| for VPP performance tests:\r
 \r
 +---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r