fix(report): update the text part of release notes

[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst

diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 2b9c796..aac1241 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -8,39 +8,18 @@ Changes in |csit-release|
 
 #. VPP PERFORMANCE TESTS
 
-   - **Regressions with DPDK drivers**: Change from DPDK v21.08 to DPDK
-     v21.11 introduced regression across all tests using dpdk
-     drivers (with dpdk_plugin loaded). Compared to previous VPP
-     release performance drop varies in the range of -15% to -6%,
-     depending on test. It is related to updated MTU checks within
-     DPDK code and associated VPP code changes. See
-     `VPP v2202 release notes <https://s3-docs.fd.io/vpp/22.02/aboutvpp/releasenotes/v22.02.html>`_
-     and :ref:`vpp_known_issues`.
-
-   - **Number of CSIT 9000B frame tests failing**: tests with higher
-     encapsulation overhead are failing due to exceeding default
-     Ethernet Maximum Frame Size value that has been reduced by MTU
-     related VPP code changes. See
-     `VPP v2202 release notes <https://s3-docs.fd.io/vpp/22.02/aboutvpp/releasenotes/v22.02.html>`_
-     and :ref:`vpp_known_issues`.
-
-   - **Intel Xeon Ice Lake**: Performance test data for these platforms
-     is now provided by testbeds newly installed in FD.io CSIT labs.
-     For details about the physical setup see
-     :ref:`physical_testbeds_2n_icx` and
-     :ref:`physical_testbeds_3n_icx`.
-
-   - **Arm Ampere Altra**: Performance test data for these platforms
-     is now provided by testbeds newly installed in FD.io CSIT labs.
-     For details about the physical setup see
-     :ref:`physical_testbeds_3n_alt`.
-
    - **Reduction of tests**: Removed certain test variations executed
      iteratively for the report (as well as in daily and weekly
      trending) due to physical testbeds overload.
 
 #. TEST FRAMEWORK
 
+   - **Removed ASTF PPS tests**: They provide no real benefit
+     compared to TPUT tests. The ip4base variants renamed to TPUT.
+
+   - **Changed TCP TPUT profiles**: The previous ones were found to be faulty.
+     The new ones do not use bursts of packets to avoid CSIT-1830 and CSIT-1846.
+
    - **CSIT test environment** version has been updated to ver. 10, see
      :ref:`test_environment_versioning`.
 
@@ -172,6 +151,22 @@ Root Cause Analysis for Performance Changes
 
 List of RCAs in |csit-release| for VPP performance changes:
 
-+----+-----------------------------------------+--------------------------------------------------------------+
-|  # | JiraID                                  | Issue Description                                            |
-+====+=========================================+==============================================================+
++----+-----------------------------------------+-------------------------------------------------------------------------------------+
+|  # | JiraID                                  | Issue Description                                                                   |
++====+=========================================+=====================================================================================+
+|  1 | `CSIT-1851                              | trending regression: various icelake tests around 2202-04-15                        |
+|    | <https://jira.fd.io/browse/CSIT-1851>`_ | Somewhat expected consequence of a VPP usability fix,                               |
+|    |                                         | the previous VPP compiler version was too new for the OS used.                      |
++----+-----------------------------------------+-------------------------------------------------------------------------------------+
+|  2 | `VPP-2030                               | regression: ip6base on ICX around 2022-03-23                                        |
+|    | <https://jira.fd.io/browse/VPP-2030>`_  | "Loads blocked due to overlapping with a preceding store that cannot be forwarded." |
+|    |                                         | started happening in ip6-lookup graph node.                                         |
++----+-----------------------------------------+-------------------------------------------------------------------------------------+
+|  3 | `CSIT-1852                              | 2n-zn2 mellanox performance cap                                                     |
+|    | <https://jira.fd.io/browse/CSIT-1852>`_ | Old issue, only now distinguished from CSIT-1751.                                   |
+|    |                                         | This testbed+nic combination is capped below 28 Mpps, cause not identified yet.     |
++----+-----------------------------------------+-------------------------------------------------------------------------------------+
+|  4 | `CSIT-1853                              | trending regression: nat44ed cps around 2202-04-01                                  |
+|    | <https://jira.fd.io/browse/CSIT-1853>`_ | VPP change added more computation to slow path (in order to support multiple VRFs). |
+|    |                                         | Not clear if the VPP implementation is optimized enough.                            |
++----+-----------------------------------------+-------------------------------------------------------------------------------------+