4 Changes in |csit-release|
5 -------------------------
7 #. VPP PERFORMANCE TESTS
9 - CSIT test environment is versioned, see
10 :ref:`test_environment_versioning`.
12 - **Upgrade to Ubuntu 20.04 LTS**: Reinstall base operating system to Ubuntu
13 20.04.2 LTS. Upgrade includes also baseline Docker containers used for
16 - **AF_XDP**: Added af_xdp driver testing for all testcases.
18 - **GTPU tunnel**: Added GTPU HW Offload IPv4 routing tests.
20 - **Telemetry retouch**: Redesign telemetry retrieval from DUT. Include
21 VPP perfmon plugin telemetry.
25 - **CSIT PAPI support**: Due to issues with PAPI performance, VAT is
26 still used in CSIT for all VPP scale tests. See known issues below.
28 - **General Code Housekeeping**: Ongoing code optimizations,
29 speed ups and bug fixes.
31 #. PRESENTATION AND ANALYTICS LAYER
33 - **Graphs improvements**: Updated Packet Latency graphs,
34 see :ref:`latency_methodology`.
45 List of known issues in |csit-release| for VPP performance tests:
47 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
48 | # | JiraID | Issue Description |
49 +====+=========================================+===========================================================================================================+
50 | 1 | `VPP-662 | 9000B packets not supported by NICs VIC1227 and VIC1387. |
51 | | <https://jira.fd.io/browse/VPP-662>`_ | |
52 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
53 | 2 | `CSIT-1763 | Adapt ramp-up phase of nat44 tests for different frame sizes. |
54 | | <https://jira.fd.io/browse/CSIT-1763>`_ | Currently ramp-up phase rate and duration values are correctly set for tests with 64B frame size. |
55 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
56 | 3 | `CSIT-1671 | All CSIT scale tests can not use PAPI due to much slower performance compared to VAT/CLI (it takes much |
57 | | <https://jira.fd.io/browse/CSIT-1671>`_ | longer to program VPP). This needs to be addressed on the PAPI side. |
58 | +-----------------------------------------+ The usual PAPI library spends too much time parsing arguments, so even with async processing (hundreds of |
59 | | `VPP-1763 | commands in flight over socket), the VPP configuration for large scale tests (millions of messages) takes |
60 | | <https://jira.fd.io/browse/VPP-1763>`_ | too long. |
61 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
63 Root Cause Analysis for Performance Changes
64 -------------------------------------------
66 List of RCAs in |csit-release| for VPP performance changes:
68 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
69 | # | JiraID | Issue Description |
70 +====+=========================================+===========================================================================================================+
71 | 1 | `VPP-1972 | One VPP change has decreased performance of NAT44ed processing, both slow path and fast path. |
72 | | <https://jira.fd.io/browse/VPP-1972>`_ | |
73 +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+