- - CSIT test environment is versioned, see
- :ref:`test_environment_versioning`.
-
- - To identify performance changes due to VPP code changes from
- v20.05.0 to v20.09.0, both have been tested in CSIT environment
- ver. 5 and compared against each other. All substantial
- progressions has been marked up with RCA analysis. See
- :ref:`vpp_compare_current_vs_previous_release` and
- :ref:`vpp_known_issues`.
-
- - **GENEVE tests**: Added VPP performance tests for GENEVE tunnels.
-
- - See :ref:`geneve_methodology` for more details.
-
- - **NAT44 tests**: Adapted existing and added new tests.
-
- - Refactored NAT44 deterministic mode (nat44det) tests to use separate
- det44 vpp plugin and to use the same scheme of inside and outside
- addresses and ports, as used in new NAT44 endpoint-dependent mode tests.
-
- - Added new NAT44 endpoint-depended mode uni-directional (nat44ed-udir)
- tests that measure packet throughput in one direction with usage of TRex
- in stateless mode.
-
- - Added new NAT44 endpoint-dependent mode CPS tests that measure
- connections per second with usage of TRex in stateful mode.
- UPD packet size is 64 bytes. Size of TCP control packets
- is not configurable, please ignore the -64b- part of test names.
-
- - Added new NAT44 endpoint-dependent mode PPS tests that measure
- packets per second (control and data together) with usage of TRex
- in stateful mode. UPD packet size is 64 bytes. Size of TCP
- data packets is governed by the default MSS value, so most data packets
- are 1460 bytes long, please ignore the -64b- part of test names.
-
- - See :ref:`nat44_methodology` for more details.
-
- - **IPSec async mode tests**: Added VPP performance tests for async crypto
- engine.
-
- - **AMD 2n-zn2 testbed**: New physical testbed type installed in
- FD.io CSIT, with VPP and DPDK performance data added to CSIT
- trending and this report.
-
- - **AMD 2n-tx2 testbed**: New physical testbed type installed in
- FD.io CSIT, with VPP and DPDK performance data added to CSIT
- trending and this report.
+ - **Regressions with DPDK drivers**: Change from DPDK v21.08 to DPDK
+ v21.11 introduced regression across all tests using dpdk
+ drivers (with dpdk_plugin loaded). Compared to previous VPP
+ release performance drop varies in the range of -15% to -6%,
+ depending on test. It is related to updated MTU checks within
+ DPDK code and associated VPP code changes. See
+ `VPP v2202 release notes <https://s3-docs.fd.io/vpp/22.02/aboutvpp/releasenotes/v22.02.html>`_
+ and :ref:`vpp_known_issues`.
+
+ - **Number of CSIT 9000B frame tests failing**: tests with higher
+ encapsulation overhead are failing due to exceeding default
+ Ethernet Maximum Frame Size value that has been reduced by MTU
+ related VPP code changes. See
+ `VPP v2202 release notes <https://s3-docs.fd.io/vpp/22.02/aboutvpp/releasenotes/v22.02.html>`_
+ and :ref:`vpp_known_issues`.
+
+ - **Intel Xeon Ice Lake**: Performance test data for these platforms
+ is now provided by testbeds newly installed in FD.io CSIT labs.
+ For details about the physical setup see
+ :ref:`physical_testbeds_2n_icx` and
+ :ref:`physical_testbeds_3n_icx`.
+
+ - **Arm Ampere Altra**: Performance test data for these platforms
+ is now provided by testbeds newly installed in FD.io CSIT labs.
+ For details about the physical setup see
+ :ref:`physical_testbeds_3n_alt`.
+
+ - **Reduction of tests**: Removed certain test variations executed
+ iteratively for the report (as well as in daily and weekly
+ trending) due to physical testbeds overload.