Release Notes
=============
-Changes in |csit-release|
--------------------------
+..
+ Changes in |csit-release|
+ -------------------------
-#. VPP PERFORMANCE TESTS
+ #. VPP PERFORMANCE TESTS
- - **Experimental Soak Tests**: Added performamce soak tests framework
- code for extended time duration tests and throughput discovery
- at given PLR and at give total test time e.g. minutes, hours,
- days, weeks, months, years. See updated
- :ref:`test_methodology` section for more details.
+ - **Service density 2n-skx tests**: Network Function Virtualization (NFV)
+ service density tests focus on measuring total per server throughput at
+ varied NFV service *packing* densities with vswitch providing host
+ dataplane. The goal is to compare and contrast performance of a shared
+ vswitch for different network topologies and virtualization technologies,
+ and their impact on vswitch performance and efficiency in a range of NFV
+ service configurations.
-#. TEST FRAMEWORK
+ - **Experimental Soak Tests**: Added performamce soak tests framework
+ code for extended time duration tests and throughput discovery
+ at given PLR and at give total test time e.g. minutes, hours,
+ days, weeks, months, years. See updated
+ :ref:`test_methodology` section for more details.
- - **Container code optimizations**: Optimized container library allows to
- run containre_memif tests faster.
+ #. TEST FRAMEWORK
- - **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to
- PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away
- from VAT.
+ - **Container code optimizations**: Optimized container library allows to
+ run containre_memif tests faster.
- - **General Code Housekeeping**: Ongoing RF keywords optimizations,
- removal of redundant RF keywords.
+ - **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to
+ PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away
+ from VAT.
-#. PRESENTATION AND ANALYTICS LAYER
+ - **General Code Housekeeping**: Ongoing RF keywords optimizations,
+ removal of redundant RF keywords.
- - **Graphs Layout Improvements**: Improved performance graphs layout
- for better readibility and maintenance: test grouping, axis
- labels, descriptions, other informative decoration.
+ #. PRESENTATION AND ANALYTICS LAYER
-#. MISCELLANEOUS
+ - **Graphs Layout Improvements**: Improved performance graphs layout
+ for better readibility and maintenance: test grouping, axis
+ labels, descriptions, other informative decoration.
- - **2n-dnv Tests (3rd Party)**: Published performance tests for 2n-
- dnv (2-Node Atom Denverton) from 3rd party testbeds running FD.io
- |csit-release| automated testing code.
- Only graphs for Packet Throughput and Speedup Multi-core and not
- for Packet Latency were published as there are no results for Packet
- Latency available.
+ #. MISCELLANEOUS
-.. note::
-
- The Report rls1901.1 was generated with only 1 run of performance tests,
- ie. the data are not statistically significant.
- The NFV tests were not run so this section has been removed from the
- report.
+ - **3n-dnv Tests (3rd Party)**: Published performance tests for 3n-
+ dnv (3-Node Atom Denverton) from 3rd party testbeds running FD.io
+ |csit-release| automated testing code.
+ Only graphs for Packet Throughput and Speedup Multi-core and not
+ for Packet Latency were published as there are no results for Packet
+ Latency available.
-.. raw:: latex
+.. note::
- \clearpage
+ |csit-release| report was generated with a single run of selected
+ 64B frame performance tests on 3n-skx test bed
+ in order to spot-check the main data plane paths.
+ NFV service density and soak tests were not run and do not feature in
+ this report.
.. _vpp_known_issues:
| 2 | `VPP-1563 | AVF L2patch tests are failing for all packet size and core combination. Reason: null-node blackholed packets in show error. |
| | <https://jira.fd.io/browse/VPP-1563>`_ | |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 3 | `CSIT-1234 | VPP IPSecHW/IPSecsW scale interface mode, low NDR and PDR 64B throughput in 3n-hsw testbeds, in CSIT-19.01 vs. CSIT-18.10. |
-| | <https://jira.fd.io/browse/CSIT-1234>`_ | |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 4 | `CSIT-1431 | AVF 4 cores tests are sporadically failing. Under investigation. |
-| | <https://jira.fd.io/browse/CSIT-1431>`_ | |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 5 | `CSIT-1465 | 4c VPP VM vhost tests failing on 3n-skx. Under investigation. |
+| 3 | `CSIT-1465 | 4c VPP VM vhost tests failiing on 3n-skx |
| | <https://jira.fd.io/browse/CSIT-1465>`_ | |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 6 | `CSIT-1466 | IPSecHW scale tests failing due to VPP reset. Fixed in one of subsequent VPP patches. Confirmed by running tests with VPP |
-| | <https://jira.fd.io/browse/CSIT-1466>`_ | build 19.01.1-8~g50a392f~b56. |
-+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
Code Review / csit.git / blobdiff