Report 1904.2: Configuration
[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst
index 411cd1d..e60e50b 100644 (file)
@@ -1,44 +1,44 @@
 Release Notes
 =============
 
-Changes in |csit-release|
--------------------------
+..
+    Changes in |csit-release|
+    -------------------------
 
-#. VPP PERFORMANCE TESTS
+    #. VPP PERFORMANCE TESTS
 
-   - **Service density 2n-skx tests**: Network Function Virtualization (NFV)
-     service density tests focus on measuring total per server throughput at
-     varied NFV service *packing* densities with vswitch providing host
-     dataplane. The goal is to compare and contrast performance of a shared
-     vswitch for different network topologies and virtualization technologies,
-     and their impact on vswitch performance and efficiency in a range of NFV
-     service configurations.
+       - **Service density 2n-skx tests**: Network Function Virtualization (NFV)
+         service density tests focus on measuring total per server throughput at
+         varied NFV service *packing* densities with vswitch providing host
+         dataplane. The goal is to compare and contrast performance of a shared
+         vswitch for different network topologies and virtualization technologies,
+         and their impact on vswitch performance and efficiency in a range of NFV
+         service configurations.
 
-   - **Experimental Soak Tests**: Added performamce soak tests framework
-     code for extended time duration tests and throughput discovery
-     at given PLR and at give total test time e.g. minutes, hours,
-     days, weeks, months, years. See updated
-     :ref:`test_methodology` section for more details.
+       - **Experimental Soak Tests**: Added performamce soak tests framework
+         code for extended time duration tests and throughput discovery
+         at given PLR and at give total test time e.g. minutes, hours,
+         days, weeks, months, years. See updated
+         :ref:`test_methodology` section for more details.
 
-#. TEST FRAMEWORK
+    #. TEST FRAMEWORK
 
-   - **Container code optimizations**: Optimized container library allows to
-     run containre_memif tests faster.
+       - **Container code optimizations**: Optimized container library allows to
+         run containre_memif tests faster.
 
-   - **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to
-     PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away
-     from VAT.
+       - **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to
+         PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away
+         from VAT.
 
-   - **General Code Housekeeping**: Ongoing RF keywords optimizations,
-     removal of redundant RF keywords.
+       - **General Code Housekeeping**: Ongoing RF keywords optimizations,
+         removal of redundant RF keywords.
 
-#. PRESENTATION AND ANALYTICS LAYER
+    #. PRESENTATION AND ANALYTICS LAYER
 
-   - **Graphs Layout Improvements**: Improved performance graphs layout
-     for better readibility and maintenance: test grouping, axis
-     labels, descriptions, other informative decoration.
+       - **Graphs Layout Improvements**: Improved performance graphs layout
+         for better readibility and maintenance: test grouping, axis
+         labels, descriptions, other informative decoration.
 
-..
     #. MISCELLANEOUS
 
        - **3n-dnv Tests (3rd Party)**: Published performance tests for 3n-
@@ -48,9 +48,13 @@ Changes in |csit-release|
          for Packet Latency were published as there are no results for Packet
          Latency available.
 
-.. raw:: latex
+.. note::
 
-    \clearpage
+    |csit-release| report was generated with a single run of selected
+    64B frame performance tests on 3n-skx test bed
+    in order to spot-check the main data plane paths.
+    NFV service density and soak tests were not run and do not feature in
+    this report.
 
 .. _vpp_known_issues:
 
@@ -65,21 +69,9 @@ List of known issues in |csit-release| for VPP performance tests:
 | 1  | `CSIT-570                               | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue.                         |
 |    | <https://jira.fd.io/browse/CSIT-570>`_  | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds.                           |
 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 2  | `VPP-1562                               | Link bonding (mode LACP, transmit policy l34) test are failing due to VPP crashing producing core dump.                         |
-|    | <https://jira.fd.io/browse/VPP-1562>`_  |                                                                                                                                 |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 3  | `CSIT-1427                              | Scale HW IPsec are failing due to issue with selecting ipsec backend in VPP.                                                    |
-|    | <https://jira.fd.io/browse/CSIT-1427>`_ |                                                                                                                                 |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 4  | `VPP-1563                               | AVF L2patch tests are failing for all packet size and core combination. Reason: null-node blackholed packets in show error.     |
+| 2  | `VPP-1563                               | AVF L2patch tests are failing for all packet size and core combination. Reason: null-node blackholed packets in show error.     |
 |    | <https://jira.fd.io/browse/VPP-1563>`_  |                                                                                                                                 |
 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 5  | `CSIT-1234                              | VPP IPSecHW/IPSecsW scale interface mode, low NDR and PDR 64B throughput in 3n-hsw testbeds, in CSIT-19.01 vs. CSIT-18.10.      |
-|    | <https://jira.fd.io/browse/CSIT-1234>`_ |                                                                                                                                 |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 6  | `CSIT-1428                              | VM vhost tests with RXQ 2 and more are failing and reporting incorrect measurements due to RXQ configuration issue.             |
-|    | <https://jira.fd.io/browse/CSIT-1428>`_ |                                                                                                                                 |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 7  | `CSIT-1431                              | AVF 4 cores tests are sporadically failing.                                                                                     |
-|    | <https://jira.fd.io/browse/CSIT-1431>`_ |                                                                                                                                 |
+| 3  | `CSIT-1465                              | 4c VPP VM vhost tests failiing on 3n-skx                                                                                        |
+|    | <https://jira.fd.io/browse/CSIT-1465>`_ |                                                                                                                                 |
 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+