report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

diff --git a/docs/report/dpdk_performance_tests/csit_release_notes.rst b/docs/report/dpdk_performance_tests/csit_release_notes.rst
index 6810d35..2f88519 100644 (file)
--- a/docs/report/dpdk_performance_tests/csit_release_notes.rst
+++ b/docs/report/dpdk_performance_tests/csit_release_notes.rst
@@ -4,16 +4,15 @@ Release Notes
 Changes in |csit-release|
 -------------------------
 
 Changes in |csit-release|
 -------------------------
 

+#. TEST FRAMEWORK

 
 

-#. DPDK PERFORMANCE TESTS
+   - **Upgrade to Ubuntu 20.04 LTS**: Re-installed base operating system
+     to Ubuntu 20.04.2 LTS. Upgrade included also baseline Docker
+     containers used for spawning topology.

 
 

-   - CSIT test environment is versioned, see
+   - **CSIT test environment** version has been updated to ver. 7, see

      :ref:`test_environment_versioning`.
 
      :ref:`test_environment_versioning`.
 

-   - **Upgrade to Ubuntu 20.04 LTS**: Reinstall base operating system to Ubuntu
-     20.04.2 LTS. Upgrade includes also baseline Docker containers used for
-     spawning topology.
-

 #. DPDK RELEASE VERSION CHANGE
 
    - |csit-release| tested |dpdk-release|, as used by |vpp-release|.
 #. DPDK RELEASE VERSION CHANGE
 
    - |csit-release| tested |dpdk-release|, as used by |vpp-release|.

diff --git a/docs/report/introduction/methodology_ipsec.rst b/docs/report/introduction/methodology_ipsec.rst
index 6cfa69c..2e6a324 100644 (file)
--- a/docs/report/introduction/methodology_ipsec.rst
+++ b/docs/report/introduction/methodology_ipsec.rst
@@ -47,3 +47,18 @@ dpdk_cryptodev
 | crypto_ipsecmb    | async/crypto worker | AES[128]-CBC     | SHA[256|512]   | 1, 4, 1k tunnels |
 +-------------------+---------------------+------------------+----------------+------------------+
 
 | crypto_ipsecmb    | async/crypto worker | AES[128]-CBC     | SHA[256|512]   | 1, 4, 1k tunnels |
 +-------------------+---------------------+------------------+----------------+------------------+
 

+IPsec with Async Crypto Feature Workers
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+*TODO Description to be added*
+
+IPsec Uni-Directional Tests
+^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+*TODO Description to be added*
+
+
+IPsec Deep SPD Policy Tests
+^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+*TODO Description to be added*

diff --git a/docs/report/introduction/methodology_tunnel_encapsulations.rst b/docs/report/introduction/methodology_tunnel_encapsulations.rst
index c61df17..64c6f1f 100644 (file)
--- a/docs/report/introduction/methodology_tunnel_encapsulations.rst
+++ b/docs/report/introduction/methodology_tunnel_encapsulations.rst
@@ -36,3 +36,8 @@ VPP is tested in the following IPv6 tunnel baseline configurations:
 
 In all cases listed above low number of IPv4, IPv6 flows (253 or 254 per
 direction) is routed by VPP.
 
 In all cases listed above low number of IPv4, IPv6 flows (253 or 254 per
 direction) is routed by VPP.

+
+GTPU Tunnels
+~~~~~~~~~~~~
+
+*TODO Description to be added*

diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index a077791..4f448c2 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -8,34 +8,76 @@ Changes in |csit-release|
 
 #. VPP PERFORMANCE TESTS
 
 
 #. VPP PERFORMANCE TESTS
 

-   - CSIT test environment is versioned, see
-     :ref:`test_environment_versioning`.
+   - **AF_XDP**: Added af_xdp driver support for all test cases. Test
+     results will be added in sub-sequent CSIT-2106 report.

 
 

-   - **Upgrade to Ubuntu 20.04 LTS**: Reinstall base operating system to
-     Ubuntu 20.04.2 LTS. Upgrade includes also baseline Docker
-     containers used for spawning topology.
+   - **GTPU tunnel**: Added GTPU HW Offload IPv4 routing tests.

 
 

-   - Initial test data for Intel Xeon Ice Lake platforms. Current
-     CSIT-2106 report data for Intel Xeon Ice Lake comes from an
-     external source (Intel labs running CSIT code on 8360Y D Stepping
-     and 6338N processors). For detail about the physical setup
-     see :ref:`tested_physical_topologies`. Tested VPP and CSIT
-     versions are pre-release, VPP 21.06-rc0~779-gd640ae52f.
+   - **Intel Xeon Ice Lake**: Added initial test data for these
+     platforms. Current CSIT-2106 report data for Intel Xeon Ice Lake
+     comes from an external source (Intel labs running CSIT code on
+     "8360Y D Stepping" and "6338N" processors). For details about the
+     physical setup see :ref:`tested_physical_topologies`. Tested
+     VPP and CSIT versions are pre-release, VPP
+     21.06-rc0~779-gd640ae52f.
+
+   - **MLRsearch improvements**: Added support for multiple packet
+     throughput rates in a single search, each rate is associated
+     with a distinct Packet Loss Ratio (PLR) criterion. Previously
+     only Non Drop Rate (NDR) (PLR=0) and single Partial Drop Rate
+     (PDR) (PLR<0.5%) were supported. Implemented number of
+     optimizations improving rate discovery efficiency.
+
+   - **Reduction of tests**: Removed obsolete VPP use cases and
+     superfluous test combinations from continuous and report test
+     executions, including:
+
+     - All vts tests, obsolete use cases.
+     - dot1q tests apart from dot1q-l2bd, superfluous combinations.
+     - -100flows, -100kflows in all acl tests.
+     - nat44 tests
+
+       - -pps tests, replaced by -tput tests.
+       - h1-p1-s1 single session tests, unessential combination.
+       - h4096-p63-s258048 tests, unessential scale combination.
+
+     - ipsec tests
+
+       - ethip4ipsectptlispgpe.
+       - policy-aes128gcm.
+       - policy-aes128cbc-hmac256sha.
+       - policy-aes128cbc-hmac512sha.
+       - int-aes128cbc-hmac256sha.
+       - scale of
+
+         - 400tnlsw.
+         - 5000tnlsw.
+         - 20000tnlsw.
+         - 60000tnlsw.

 
 

-   - **AF_XDP**: Added af_xdp driver testing for all testcases.
+#. TEST FRAMEWORK

 
 

-   - **GTPU tunnel**: Added GTPU HW Offload IPv4 routing tests.
+   - **Telemetry retouch**: Refactored telemetry retrieval from DUTs and
+     SUTs. Included VPP perfmon plugin telemetry with all perfmon
+     bundles available in VPP release.

 
 

-   - **Telemetry retouch**: Redesign telemetry retrieval from DUT.
-     Include VPP perfmon plugin telemetry.
+   - **Upgrade to Ubuntu 20.04 LTS**: Re-installed base operating system
+     to Ubuntu 20.04.2 LTS. Upgrade included also baseline Docker
+     containers used for spawning topology.

 
 

-#. TEST FRAMEWORK
+   - **CSIT test environment** version has been updated to ver. 7, see
+     :ref:`test_environment_versioning`.
+
+   - **CSIT in AWS environment**: Added CSIT support for AWS c5n
+     instances environment. Test results will be added in sub-sequent
+     CSIT-2106 report.

 
    - **CSIT PAPI support**: Due to issues with PAPI performance, VAT is
 
    - **CSIT PAPI support**: Due to issues with PAPI performance, VAT is

-     still used in CSIT for all VPP scale tests. See known issues below.
+     still used in CSIT for all VPP scale tests. See known issues
+     below.

 
 

-   - **General Code Housekeeping**: Ongoing code optimizations,
-     speed ups and bug fixes.
+   - **General Code Housekeeping**: Ongoing code optimizations and bug
+     fixes. 

 
 #. PRESENTATION AND ANALYTICS LAYER
 
 
 #. PRESENTATION AND ANALYTICS LAYER