executing |csit-release| tests. For details about the physical
setup see :ref:`tested_physical_topologies`.
- - **AWS EC2 c5n**: Performance test data for AWS c5n instances has
- been added to report for ip4, ip6 and ipsec tests.
-
- **Reduction of tests**: Removed certain test variations executed
iteratively for the report (as well as in daily and weekly
trending) due to physical testbeds overload.
#. TEST FRAMEWORK
- - **CSIT test environment** version has been updated to ver. 8, see
+ - **CSIT test environment** version has been updated to ver. 9, see
:ref:`test_environment_versioning`.
- - **CSIT in AWS environment**: Completed CSIT automation support for
- AWS c5n instances environment, including weekly performance
- trending tests execution.
-
- **CSIT PAPI support**: Due to issues with PAPI performance, and
deprecation of VAT, CLI is used in CSIT for many VPP scale tests.
See known issues below.
| # | JiraID | Issue Description |
+====+=========================================+===========================================================================================================+
| 3 | `CSIT-1782 | Multicore AVF tests are failing when trying to create interface. |
-| | <https://jira.fd.io/browse/CSIT-1782>`_ | Frequency is reduced by s CSIT workaround, but occasional failures do still happen. |
+| | <https://jira.fd.io/browse/CSIT-1782>`_ | Frequency is reduced by CSIT workaround, but occasional failures do still happen. |
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
| 4 | `CSIT-1671 | All CSIT scale tests can not use PAPI due to much slower performance compared to VAT/CLI (it takes much |
| | <https://jira.fd.io/browse/CSIT-1671>`_ | longer to program VPP). This needs to be addressed on the PAPI side. |
| 5 | `CSIT-1789 | IPSEC SW async scheduler tests show bad behavior. |
| | <https://jira.fd.io/browse/CSIT-1789>`_ | VPP code is not behaving correctly when crypto workers are the bottleneck. |
| +-----------------------------------------+ |
-| 5 | `VPP-1998 | |
+| | `VPP-1998 | |
| | <https://jira.fd.io/browse/VPP-1998>`_ | |
+----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+
| 6 | `CSIT-1785 | NAT44ED tests failing to establish all TCP sessions. |