- CSIT test environment is versioned, see
:ref:`test_environment_versioning`.
- CSIT test environment is versioned, see
:ref:`test_environment_versioning`.
- - To identify performance changes due to VPP code changes from
- v20.05.0 to v20.09.0, both have been tested in CSIT environment
- ver. 5 and compared against each other. All substantial
- progressions has been marked up with RCA analysis. See
- :ref:`vpp_compare_current_vs_previous_release` and
- :ref:`vpp_known_issues`.
+ - **GENEVE tests**: Added VPP performance tests for GENEVE tunnels.
+ See :ref:`geneve_methodology` for more details.
- - Refactored NAT44 deterministic mode (nat44det) tests to use separate
- det44 vpp plugin and to use the same scheme of inside and outside
- addresses and ports, as used in new NAT44 endpoint-dependent mode tests.
+ - **GSO tests**: Added VPP performance tests for GSOtap and GSOvirtio.
+ All tested topologies are compared with GSO enabled and disabled.
+ In |csit-release| there is only 1t1c tests running.
+ See :ref:`gso_methodology` for more details.
- - Added new NAT44 endpoint-dependent mode CPS tests that measure
- connections per second with usage of TRex in stateful mode.
- UPD packet size is 64 bytes. Size of TCP control packets
- is not configurable, please ignore the -64b- part of test names.
+ - **NAT44 tests**: Added new test type, pure throughput tests.
+ They are similar to PPS tests, but they employ ramp-up trials
+ to ensure all sessions are created (and not timing out)
+ for performance trials.
- - Added new NAT44 endpoint-dependent mode PPS tests that measure
- packets per second (control and data together) with usage of TRex
- in stateful mode. UPD packet size is 64 bytes. Size of TCP
- data packets is governed by the default MSS value, so most data packets
- are 1460 bytes long, please ignore the -64b- part of test names.
+ - **Jumbo for ipsec**: Test cases with 9000 byte frames are re-enabled
+ in ipsec suites.
FD.io CSIT, with VPP and DPDK performance data added to CSIT
trending and this report.
FD.io CSIT, with VPP and DPDK performance data added to CSIT
trending and this report.
- **CSIT PAPI support**: Due to issues with PAPI performance, VAT is
still used in CSIT for all VPP scale tests. See known issues below.
- **CSIT PAPI support**: Due to issues with PAPI performance, VAT is
still used in CSIT for all VPP scale tests. See known issues below.
- - **General Code Housekeeping**: Ongoing RF keywords optimizations,
- removal of redundant RF keywords and aligning of suite/test
- setup/teardowns.
-
- - **Intel E810CQ 100G NIC**: Added configuration for Intel E810CQ 100G NIC.
- No tests run for this NIC as it is not present in FD.io CSIT lab yet.
+ - **General Code Housekeeping**: Ongoing code optimizations,
+ speed ups and bug fixes.
- - **Graphs improvements**: Added possibility to use Gbps on Y-axis in
- Packet Throughput and Speedup Multi-Core graphs, added unidirectional
- mode to the Latency graphs.
+ - **Graphs improvements**: Updated Packet Latency graphs,
+ see :ref:`latency_methodology`.
| | `VPP-1763 | commands in flight over socket), the VPP configuration for large scale tests (millions of messages) takes |
| | <https://jira.fd.io/browse/VPP-1763>`_ | too long. |
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
| | `VPP-1763 | commands in flight over socket), the VPP configuration for large scale tests (millions of messages) takes |
| | <https://jira.fd.io/browse/VPP-1763>`_ | too long. |
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-| 5 | `CSIT-1771 | IPv4 IPSEC 9000B packet tests had been failing when chained buffers were not supported. |
-| | <https://jira.fd.io/browse/CSIT-1771>`_ | This has been fixed on VPP side, but CSIT still needs to re-enable jumbo tests. |
-+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
-| 6 | `VPP-1934 | [i40e] Interfaces are not brought up from carrier-down. |
+| 5 | `VPP-1934 | [i40e] Interfaces are not brought up from carrier-down. |
| | <https://jira.fd.io/browse/VPP-1934>`_ | In case of i40e -based interface (e.g Intel x700 series NIC) is bound to kernel driver (i40e) and is in |
| | | state "no-carrier" (<NO-CARRIER,BROADCAST,MULTICAST,UP>) because previously it was disabled via |
| | | "I40E_AQ_PHY_LINK_ENABLED" call, then VPP during initialization of AVF interface is not re-enabling |
| | | interface link via i40e driver to up. |
| | | CSIT implemented `workaround for AVF interface <https://gerrit.fd.io/r/c/csit/+/29086>`_ until fixed. |
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
| | <https://jira.fd.io/browse/VPP-1934>`_ | In case of i40e -based interface (e.g Intel x700 series NIC) is bound to kernel driver (i40e) and is in |
| | | state "no-carrier" (<NO-CARRIER,BROADCAST,MULTICAST,UP>) because previously it was disabled via |
| | | "I40E_AQ_PHY_LINK_ENABLED" call, then VPP during initialization of AVF interface is not re-enabling |
| | | interface link via i40e driver to up. |
| | | CSIT implemented `workaround for AVF interface <https://gerrit.fd.io/r/c/csit/+/29086>`_ until fixed. |
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
| # | JiraID | Issue Description |
+====+=========================================+===========================================================================================================+
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
| # | JiraID | Issue Description |
+====+=========================================+===========================================================================================================+
Code Review / csit.git / blobdiff