Code Review / csit.git / blobdiff
? search:
summary | shortlog | log | commit | commitdiff | review | tree
raw | inline | side by side
fix(report): update RCA
[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 9109089..20f7710 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -77,21 +77,27 @@ ___
 |  2 | `CSIT-1864                              | 2n-clx: half of the packets lost on PDR tests.                                                            |
 |    | <https://jira.fd.io/browse/CSIT-1864>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  3 | `CSIT-1871                              | 3n-snr: 25Ge Interface goes down randomly.                                                                |
+|  3 | `CSIT-1868                              | 2n-clx: ALL ldpreload-nginx tests fails when trying to start nginx.                                       |
+|    | <https://jira.fd.io/browse/CSIT-1868>`_ |                                                                                                           |
++----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
+|  4 | `CSIT-1871                              | 3n-snr: 25GE interface between SUT and TG/TRex goes down randomly.                                        |
 |    | <https://jira.fd.io/browse/CSIT-1871>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  4 | `CSIT-1877                              | 3n-alt, 3n-tsh: VM tests failing to boot VM.                                                              |
+|  5 | `CSIT-1877                              | 3n-alt, 3n-tsh: VM tests failing to boot VM.                                                              |
 |    | <https://jira.fd.io/browse/CSIT-1877>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  5 | `CSIT-1883                              | 3n-snr: All hwasync wireguard tests failing when trying to verify device.                                 |
+|  6 | `CSIT-1883                              | 3n-snr: All hwasync wireguard tests failing when trying to verify device.                                 |
 |    | <https://jira.fd.io/browse/CSIT-1883>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  6 | `CSIT-1884                              | 2n-clx, 2n-icx: All NDR PDR IMIX over 1M sessions BIDIR tests failing to create enough sessions.          |
+|  7 | `CSIT-1884                              | 2n-clx, 2n-icx: All NAT44DET NDR PDR IMIX over 1M sessions BIDIR tests failing to create enough sessions. |
 |    | <https://jira.fd.io/browse/CSIT-1884>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  7 | `CSIT-1885                              | 3n-icx: 9000b ip4 NDRPDR AVF tests are failing to forward traffic.                                        |
+|  8 | `CSIT-1885                              | 3n-icx: 9000b ip4 ip6 l2 NDRPDR AVF tests are failing to forward traffic.                                 |
 |    | <https://jira.fd.io/browse/CSIT-1885>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
+|  9 | `CSIT-1886                              | 3n-icx: Wireguard tests with 100 and more tunnels are failing PDR criteria.                               |
+|    | <https://jira.fd.io/browse/CSIT-1886>`_ |                                                                                                           |
++----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
 
 Previous
 ________
@@ -137,7 +143,7 @@ Issues reported in previous releases which still affect the current results.
 | 10 | `CSIT-1827                              | 3n-icx, 3n-skx: all AVF crypto tests sporadically fail. 1518B with no traffic, IMIX with excessive        |
 |    | <https://jira.fd.io/browse/CSIT-1827>`_ | packet loss.                                                                                              |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-| 11 | `CSIT-1835                              | 3n-icx: vppecho BPS tests failing on timeout when checking hoststack finished.                            |
+| 11 | `CSIT-1835                              | 3n-icx: QUIC vppecho BPS tests failing on timeout when checking hoststack finished.                       |
 |    | <https://jira.fd.io/browse/CSIT-1835>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
 | 12 | `CSIT-1849                              | 2n-skx, 2n-clx, 2n-icx: UDP 16m TPUT tests fail to create all sessions.                                   |
@@ -170,18 +176,14 @@ Root Cause Analysis for Performance Changes
 
 List of RCAs in |csit-release| for VPP performance changes:
 
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
-|  # | JiraID                                  | Issue Description                                                                   |
-+====+=========================================+=====================================================================================+
-|  1 | `VPP-2030                               | regression: ip6base on ICX around 2022-03-23                                        |
-|    | <https://jira.fd.io/browse/VPP-2030>`_  | "Loads blocked due to overlapping with a preceding store that cannot be forwarded." |
-|    |                                         | started happening in ip6-lookup graph node.                                         |
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
-|  2 | `CSIT-1852                              | 2n-zn2 mellanox performance cap                                                     |
-|    | <https://jira.fd.io/browse/CSIT-1852>`_ | Old issue, only now distinguished from CSIT-1751.                                   |
-|    |                                         | This testbed+nic combination is capped below 28 Mpps, cause not identified yet.     |
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
-|  3 | `CSIT-1853                              | trending regression: nat44ed cps around 2202-04-01                                  |
-|    | <https://jira.fd.io/browse/CSIT-1853>`_ | VPP change added more computation to slow path (in order to support multiple VRFs). |
-|    |                                         | Not clear if the VPP implementation is optimized enough.                            |
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
++----+-----------------------------------------+--------------------------------------------------------------------+
+|  # | JiraID                                  | Issue Description                                                  |
++====+=========================================+====================================================================+
+|  1 | `CSIT-1887                              | rls2210 RCA: ASTF tests                                            |
+|    | <https://jira.fd.io/browse/CSIT-1887>`_ | TRex upgrade decreased TRex performance. NAT results not affected, |
+|    |                                         | except on Denverton due to interference from VPP-2010.             |
++----+-----------------------------------------+--------------------------------------------------------------------+
+|  2 | `CSIT-1888                              | rls2210 RCA: testbed differences, especially for ipsec             |
+|    | <https://jira.fd.io/browse/CSIT-1888>`_ | Not caused by VPP code nor CSIT code.                              |
+|    |                                         | Most probable cause is clang-14 behavior.                          |
++----+-----------------------------------------+--------------------------------------------------------------------+
Integration tests