X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcsit_release_notes.rst;h=644214c90c4e1ebede29a4069295dfa23ba956cb;hb=84ac7494ff6a2fcf3687b0866c5e69ec02f972b2;hp=0128c629063b595e6b2e545ec8b09a8f4a233dd2;hpb=a68514255a58ae6c982e40c47247abf64e58f3f4;p=csit.git diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 0128c62906..644214c90c 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -8,52 +8,46 @@ Changes in |csit-release| #. VPP PERFORMANCE TESTS - - **Added new performance testbed 3n-snr** (3 Node SnowRidge, with Intel - Atom processors). + - **Enhanced and added VPP hoststack tests** to daily and weekly + trending including: Quic VPP Echo, UDP+TCP LD_PRELOAD iPerf3, + LD_PRELOAD NGINX. - - **Added GTPU HW offload tests** using VPP GTPU hardware offload - with Intel e810 4p25ge NICs (3n-icx testbeds only). These tests - were already there in CSIT-2206, but were yielding invalid - results due to using TRex v2.97 that was incompatible with e810 - NICs used for those tests. + - **Added Nvidia/Mellanox DPDK tests** to daily and weekly trending + and report, in addition to RDMA_CORE ones that were already + there. - - **Added Wireguard tests** using VPP software crypto (3n-icx, 3n-snr - testbeds) and using built-in hardware crypto QAT device (3n-snr testbed - only). + - **Jumbo frames tests** got fixed and re-added number of to report + coverage tests. - - **Reduction of tests**: Removed certain test variations executed - iteratively for the report (as well as in daily and weekly - trending) due to physical testbeds overload. + - **Intel Xeon SKX performance testbeds** got decommissioned and + removed from FD.io performance lab. #. TEST FRAMEWORK - - CSIT-2210 executes all VPP v22.10 performance tests using vpp ubuntu2204 - images, due to CSIT execution environment change as noted below. This - applies to all performance testbeds except Denverton. Consequently, VPP - v22.06 has not been re-tested in CSIT-2210 environment, as no ubuntu204 - images are available for that VPP version. Performance comparison - between VPP v22.10 (current version) vs VPP v22.06 (previous version) - may be impacted by VPP build environment change (ubuntu2004 to ubuntu - 2204) change and CSIT environment change. See :ref:`vpp_rca` for - details. + - **CSIT test environment** version has not changed from ver. 11 used + in previous release, see :ref:`test_environment_versioning`. - - **CSIT test environment** version has been updated to ver. 11, see - :ref:`test_environment_versioning`. - - - **TCP TPUT profiles** had to be changed, as newer TRex versions - are not deterministic enough when deciding when to send an ACK. - - - **CSIT PAPI support**: Due to issues with PAPI performance, and - deprecation of VAT, VPP CLI is used in CSIT for many VPP scale - tests. See :ref:`vpp_known_issues`. + - **CSIT PAPI optimizations for scale** got applied improving PAPI + programming speed especially for large scale tests. VAT has been + now completely deprecated from CSIT. - **General Code Housekeeping**: Ongoing code optimizations and bug fixes. #. PRESENTATION AND ANALYTICS LAYER - - **C-Dash** `performance dashboard `_ got updated UI and - updated backend increasing its performance and robustness. + - `Performance dashboard `_ got updated with + addition of VPP telemetry trending across all VPP tests. A number + of code and AWS resource usage optimizations got applied to the + data processing pipeline and UI frontend and backend. + + - Examples of release iterative data visualisation: + + - `Packet throughput 2n-icx-e810cq-ip4-base-scale-pdr `_ + - `Speedup Multi-Core throughput graph for 2n-icx-e810cq-ip4-base-pdr `_ + - `MRR, NDR and PDR comparison for 2n-icx-e810cq-ip4-base `_ + - `Normalized throughput architecture comparison for 2n-[icx|clx]-e810cq-ip4-base-pdr `_ + - `NICs comparison for 2n-icx-ip4-base-pdr `_ .. raw:: latex @@ -64,6 +58,8 @@ Changes in |csit-release| Known Issues ------------ +Editing Note: below listed known issues need to be updated to reflect the current state as tracked on `CSIT TestFailuresTracking wiki `_. + New ___