Code Review / csit.git / blobdiff
? search:
summary | shortlog | log | commit | commitdiff | review | tree
raw | inline | side by side
Report: Remove DNV testbeds
[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 9109089..685ca75 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -9,8 +9,7 @@ Changes in |csit-release|
 #. VPP PERFORMANCE TESTS
 
    - **Added new performance testbed 3n-snr** (3 Node SnowRidge, with Intel
-     Atom processors), to later replace 3n-dnv and 2n-dnv (3 and 2 Node
-     Denverton) testbeds.
+     Atom processors).
 
    - **Added GTPU HW offload tests** using VPP GTPU hardware offload
      with Intel e810 4p25ge NICs (3n-icx testbeds only). These tests
@@ -71,13 +70,13 @@ ___
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
 |  # | JiraID                                  | Issue Description                                                                                         |
 +====+=========================================+===========================================================================================================+
-|  1 | `CSIT-1850                              | 2n-dnv: sporadic 1518B tput tests failing to establish required sessions.                                 |
-|    | <https://jira.fd.io/browse/CSIT-1850>`_ |                                                                                                           |
-+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  2 | `CSIT-1864                              | 2n-clx: half of the packets lost on PDR tests.                                                            |
+|  1 | `CSIT-1864                              | 2n-clx: half of the packets lost on PDR tests.                                                            |
 |    | <https://jira.fd.io/browse/CSIT-1864>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  3 | `CSIT-1871                              | 3n-snr: 25Ge Interface goes down randomly.                                                                |
+|  2 | `CSIT-1868                              | 2n-clx: ALL ldpreload-nginx tests fails when trying to start nginx.                                       |
+|    | <https://jira.fd.io/browse/CSIT-1868>`_ |                                                                                                           |
++----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
+|  3 | `CSIT-1871                              | 3n-snr: 25GE interface between SUT and TG/TRex goes down randomly.                                        |
 |    | <https://jira.fd.io/browse/CSIT-1871>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
 |  4 | `CSIT-1877                              | 3n-alt, 3n-tsh: VM tests failing to boot VM.                                                              |
@@ -86,12 +85,15 @@ ___
 |  5 | `CSIT-1883                              | 3n-snr: All hwasync wireguard tests failing when trying to verify device.                                 |
 |    | <https://jira.fd.io/browse/CSIT-1883>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  6 | `CSIT-1884                              | 2n-clx, 2n-icx: All NDR PDR IMIX over 1M sessions BIDIR tests failing to create enough sessions.          |
+|  6 | `CSIT-1884                              | 2n-clx, 2n-icx: All NAT44DET NDR PDR IMIX over 1M sessions BIDIR tests failing to create enough sessions. |
 |    | <https://jira.fd.io/browse/CSIT-1884>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-|  7 | `CSIT-1885                              | 3n-icx: 9000b ip4 NDRPDR AVF tests are failing to forward traffic.                                        |
+|  7 | `CSIT-1885                              | 3n-icx: 9000b ip4 ip6 l2 NDRPDR AVF tests are failing to forward traffic.                                 |
 |    | <https://jira.fd.io/browse/CSIT-1885>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
+|  8 | `CSIT-1886                              | 3n-icx: Wireguard tests with 100 and more tunnels are failing PDR criteria.                               |
+|    | <https://jira.fd.io/browse/CSIT-1886>`_ |                                                                                                           |
++----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
 
 Previous
 ________
@@ -137,7 +139,7 @@ Issues reported in previous releases which still affect the current results.
 | 10 | `CSIT-1827                              | 3n-icx, 3n-skx: all AVF crypto tests sporadically fail. 1518B with no traffic, IMIX with excessive        |
 |    | <https://jira.fd.io/browse/CSIT-1827>`_ | packet loss.                                                                                              |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-| 11 | `CSIT-1835                              | 3n-icx: vppecho BPS tests failing on timeout when checking hoststack finished.                            |
+| 11 | `CSIT-1835                              | 3n-icx: QUIC vppecho BPS tests failing on timeout when checking hoststack finished.                       |
 |    | <https://jira.fd.io/browse/CSIT-1835>`_ |                                                                                                           |
 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
 | 12 | `CSIT-1849                              | 2n-skx, 2n-clx, 2n-icx: UDP 16m TPUT tests fail to create all sessions.                                   |
@@ -170,18 +172,18 @@ Root Cause Analysis for Performance Changes
 
 List of RCAs in |csit-release| for VPP performance changes:
 
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
-|  # | JiraID                                  | Issue Description                                                                   |
-+====+=========================================+=====================================================================================+
-|  1 | `VPP-2030                               | regression: ip6base on ICX around 2022-03-23                                        |
-|    | <https://jira.fd.io/browse/VPP-2030>`_  | "Loads blocked due to overlapping with a preceding store that cannot be forwarded." |
-|    |                                         | started happening in ip6-lookup graph node.                                         |
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
-|  2 | `CSIT-1852                              | 2n-zn2 mellanox performance cap                                                     |
-|    | <https://jira.fd.io/browse/CSIT-1852>`_ | Old issue, only now distinguished from CSIT-1751.                                   |
-|    |                                         | This testbed+nic combination is capped below 28 Mpps, cause not identified yet.     |
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
-|  3 | `CSIT-1853                              | trending regression: nat44ed cps around 2202-04-01                                  |
-|    | <https://jira.fd.io/browse/CSIT-1853>`_ | VPP change added more computation to slow path (in order to support multiple VRFs). |
-|    |                                         | Not clear if the VPP implementation is optimized enough.                            |
-+----+-----------------------------------------+-------------------------------------------------------------------------------------+
++----+-----------------------------------------+--------------------------------------------------------------------+
+|  # | JiraID                                  | Issue Description                                                  |
++====+=========================================+====================================================================+
+|  1 | `CSIT-1887                              | rls2210 RCA: ASTF tests                                            |
+|    | <https://jira.fd.io/browse/CSIT-1887>`_ | TRex upgrade decreased TRex performance. NAT results not affected, |
+|    |                                         | except on Denverton due to interference from VPP-2010.             |
++----+-----------------------------------------+--------------------------------------------------------------------+
+|  2 | `CSIT-1888                              | rls2210 RCA: testbed differences, especially for ipsec             |
+|    | <https://jira.fd.io/browse/CSIT-1888>`_ | Not caused by VPP code nor CSIT code.                              |
+|    |                                         | Most probable cause is clang-14 behavior.                          |
++----+-----------------------------------------+--------------------------------------------------------------------+
+|  3 | `CSIT-1889                              | rls2210 RCA: policy-outbound-nocrypto                              |
+|    | <https://jira.fd.io/browse/CSIT-1889>`_ | When VPP added spd fast path matching (Gerrit 36097),              |
+|    |                                         | it decreased MRR of the corresponding tests, at least on 3-alt.    |
++----+-----------------------------------------+--------------------------------------------------------------------+
Integration tests