1 .. _vpp_performance_tests_release_notes:
6 Changes in |csit-release|
7 -------------------------
9 #. VPP PERFORMANCE TESTS
11 - CSIT test environment is versioned, see
12 :ref:`test_environment_versioning`.
14 - **Upgrade to Ubuntu 20.04 LTS**: Reinstall base operating system to
15 Ubuntu 20.04.2 LTS. Upgrade includes also baseline Docker
16 containers used for spawning topology.
18 - Initial test data for Intel Xeon Ice Lake platforms. Current
19 CSIT-2106 report data for Intel Xeon Ice Lake comes from an
20 external source (Intel labs running CSIT code on 8360Y D Stepping
21 and 6338N processors). For detail about the physical setup
22 see :ref:`tested_physical_topologies`. Tested VPP and CSIT
23 versions are pre-release, VPP 21.06-rc0~779-gd640ae52f.
25 - **AF_XDP**: Added af_xdp driver testing for all testcases.
27 - **GTPU tunnel**: Added GTPU HW Offload IPv4 routing tests.
29 - **Telemetry retouch**: Redesign telemetry retrieval from DUT.
30 Include VPP perfmon plugin telemetry.
34 - **CSIT PAPI support**: Due to issues with PAPI performance, VAT is
35 still used in CSIT for all VPP scale tests. See known issues below.
37 - **General Code Housekeeping**: Ongoing code optimizations,
38 speed ups and bug fixes.
40 #. PRESENTATION AND ANALYTICS LAYER
42 - **Graphs improvements**: Updated Packet Latency graphs,
43 see :ref:`latency_methodology`.
54 List of known issues in |csit-release| for VPP performance tests:
56 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
57 | # | JiraID | Issue Description |
58 +====+=========================================+===========================================================================================================+
59 | 1 | `CSIT-1782 | Multicore AVF tests are failing when trying to create interface. |
60 | | <https://jira.fd.io/browse/CSIT-1782>`_ | |
61 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
62 | 2 | `CSIT-1763 | Adapt ramp-up phase of nat44 tests for different frame sizes. |
63 | | <https://jira.fd.io/browse/CSIT-1763>`_ | Currently ramp-up phase rate and duration values are correctly set for tests with 64B frame size. |
64 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
65 | 3 | `CSIT-1671 | All CSIT scale tests can not use PAPI due to much slower performance compared to VAT/CLI (it takes much |
66 | | <https://jira.fd.io/browse/CSIT-1671>`_ | longer to program VPP). This needs to be addressed on the PAPI side. |
67 | +-----------------------------------------+ The usual PAPI library spends too much time parsing arguments, so even with async processing (hundreds of |
68 | | `VPP-1763 | commands in flight over socket), the VPP configuration for large scale tests (millions of messages) takes |
69 | | <https://jira.fd.io/browse/VPP-1763>`_ | too long. |
70 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
72 Root Cause Analysis for Performance Changes
73 -------------------------------------------
75 List of RCAs in |csit-release| for VPP performance changes:
77 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
78 | # | JiraID | Issue Description |
79 +====+=========================================+===========================================================================================================+
80 | 1 | `VPP-1972 | One VPP change has decreased performance of NAT44ed processing, both slow path and fast path. |
81 | | <https://jira.fd.io/browse/VPP-1972>`_ | |
82 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+