X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcsit_release_notes.rst;h=5aa84c0fe30aaa6cbf415bfcafbe16efb2aac220;hb=a9541f264b36f0f391e8a2fdc3f1bd26caef7609;hp=2aeb09f11e4d1a8d0cad7625dd3a547aa9de4292;hpb=e21d4caec46f1778ea18b07e5ed7ff904240809c;p=csit.git diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 2aeb09f11e..5aa84c0fe3 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -13,22 +13,15 @@ Changes in |csit-release| executing |csit-release| tests. For details about the physical setup see :ref:`tested_physical_topologies`. - - **AWS EC2 c5n**: Performance test data for AWS c5n instances has - been added to report for ip4, ip6 and ipsec tests. - - **Reduction of tests**: Removed certain test variations executed iteratively for the report (as well as in daily and weekly trending) due to physical testbeds overload. #. TEST FRAMEWORK - - **CSIT test environment** version has been updated to ver. 8, see + - **CSIT test environment** version has been updated to ver. 9, see :ref:`test_environment_versioning`. - - **CSIT in AWS environment**: Completed CSIT automation support for - AWS c5n instances environment, including weekly performance - trending tests execution. - - **CSIT PAPI support**: Due to issues with PAPI performance, and deprecation of VAT, CLI is used in CSIT for many VPP scale tests. See known issues below. @@ -74,7 +67,7 @@ Issues reported in previous releases which still affect the current results. | # | JiraID | Issue Description | +====+=========================================+===========================================================================================================+ | 3 | `CSIT-1782 | Multicore AVF tests are failing when trying to create interface. | -| | `_ | Frequency is reduced by s CSIT workaround, but occasional failures do still happen. | +| | `_ | Frequency is reduced by CSIT workaround, but occasional failures do still happen. | +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+ | 4 | `CSIT-1671 | All CSIT scale tests can not use PAPI due to much slower performance compared to VAT/CLI (it takes much | | | `_ | longer to program VPP). This needs to be addressed on the PAPI side. | @@ -85,7 +78,7 @@ Issues reported in previous releases which still affect the current results. | 5 | `CSIT-1789 | IPSEC SW async scheduler tests show bad behavior. | | | `_ | VPP code is not behaving correctly when crypto workers are the bottleneck. | | +-----------------------------------------+ | -| 5 | `VPP-1998 | | +| | `VPP-1998 | | | | `_ | | +----+-----------------------------------------+-----------------------------------------------------------------------------------------------------------+ | 6 | `CSIT-1785 | NAT44ED tests failing to establish all TCP sessions. |