X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcsit_release_notes.rst;h=8fd8a3b63440db4ec8880d62089d3f972a00805a;hb=1261ada9edd22c784a7763d861c5acf87ccd1ae1;hp=e7c61e665c24a1553d6f14a6bca835d13eb96968;hpb=a1728c4f56cc44b9acb45614c20fc0a546ee3161;p=csit.git diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index e7c61e665c..8fd8a3b634 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -19,10 +19,9 @@ Changes in CSIT |release| to container, then via "horizontal" memif to next container, and so on until the last container, then back to VPP and NIC; - - **VPP TCP/IP stack** + - **MRR tests** - - Added tests for VPP TCP/IP stack using VPP built-in HTTP server. - WRK traffic generator is used as a client-side; + - ; - **SRv6** @@ -31,11 +30,6 @@ Changes in CSIT |release| lookups and rewrites based on configured End and End.DX6 SRv6 egress functions; - - **IPSecSW** - - - SW computed IPSec encryption with AES-GCM, CBC-SHA1 ciphers, in - combination with IPv4 routed-forwarding; - #. Presentation and Analytics Layer - Added throughput speedup analysis for multi-core and multi-thread @@ -46,20 +40,7 @@ Changes in CSIT |release| - **Framework optimizations** - - Ability to run CSIT framework on ARM architecture; - - - Overall stability improvements; - - - **NDR and PDR throughput binary search change** - - - Increased binary search resolution by reducing final step from - 100kpps to 50kpps; - - - **VPP plugin loaded as needed by tests** - - - From this release only plugins required by tests are loaded at - VPP initialization time. Previously all plugins were loaded for - all tests; + - Performance test duration improvements and stability; Performance Changes ------------------- @@ -132,23 +113,15 @@ Here is the list of known issues in CSIT |release| for VPP performance tests: | 3 | Lower than expected NDR throughput with | CSIT-571 | Suspected NIC firmware or DPDK driver issue affecting NDR and | | | xl710 and x710 NICs, compared to x520 NICs. | | PDR throughput. Applies to XL710 and X710 NICs. | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 4 | QAT IPSec scale with 1000 tunnels (interfaces) | VPP-1121 | VPP crashes during configuration of 1000 IPsec tunnels. | -| | in 2t2c config, all tests are failing. | | 1t1c tests are not affected | -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 5 | rls1801 plugin related performance regression | CSIT-925 | With all plugins loaded NDR, PDR and MaxRates vary | +| 4 | rls1801 plugin related performance regression | CSIT-925 | With all plugins loaded NDR, PDR and MaxRates vary | | | | | intermittently from 3% to 5% across multiple test executions. | | | | | Requires plugin code bisecting. | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 6 | rls1801 generic small performance regression | CSIT-926 | Generic performance regression of discovered NDR, PDR and | +| 5 | rls1801 generic small performance regression | CSIT-926 | Generic performance regression of discovered NDR, PDR and | | | ip4base, l2xcbase, l2bdbase | | MaxRates of -3%..-1% vs. rls1710, affects ip4base, l2xcbase, | | | | | l2bdbase test suites. Not detected by CSIT performance trending | | | | | scheme as it was masked out by another issue CSIT-925. | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 7 | rls1801 substantial NDR performance regression | CSIT-927 | Much lower NDR for vhostvr1024 tests, with mean values | -| | for vhost-user vring size of 1024 | | regression of -17%..-42% vs. rls1710, but also very high | -| | | | standard deviation of up to 1.46 Mpps => poor repeatibility. | -| | | | Making mean values not fully representative. | -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 8 | rls1801 substantial NDR/PDR regression for | CSIT-928 | NDR regression of -7%..-15%, PDR regression of -3%..-15% | +| 6 | rls1801 substantial NDR/PDR regression for | CSIT-928 | NDR regression of -7%..-15%, PDR regression of -3%..-15% | | | IPSec tunnel scale with HW QAT crypto-dev | | compared to rls1710. | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+