X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcsit_release_notes.rst;h=e7c61e665c24a1553d6f14a6bca835d13eb96968;hp=17003bc85ac6aaddca84136062a505b94f2c8b77;hb=e3554783146e2c4f2b6b5084c8afc707787d6922;hpb=cddac498bafc7a6092dade5e183e5c7a95cff64d diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 17003bc85a..e7c61e665c 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -101,6 +101,19 @@ Measured improvements are in line with VPP code optimizations listed in `VPP-18.01 release notes `_. +MRR Throughput Changes +~~~~~~~~~~~~~~~~~~~~~~ + +MRR changes between releases are available in a CSV and +pretty ASCII formats: + + - `csv format for 1t1c <../_static/vpp/performance-changes-mrr-1t1c-full.csv>`_, + - `csv format for 2t2c <../_static/vpp/performance-changes-mrr-2t2c-full.csv>`_, + - `csv format for 4t4c <../_static/vpp/performance-changes-mrr-4t4c-full.csv>`_, + - `pretty ASCII format for 1t1c <../_static/vpp/performance-changes-mrr-1t1c-full.txt>`_, + - `pretty ASCII format for 2t2c <../_static/vpp/performance-changes-mrr-2t2c-full.txt>`_, + - `pretty ASCII format for 4t4c <../_static/vpp/performance-changes-mrr-4t4c-full.txt>`_. + Known Issues ------------ @@ -122,4 +135,20 @@ Here is the list of known issues in CSIT |release| for VPP performance tests: | 4 | QAT IPSec scale with 1000 tunnels (interfaces) | VPP-1121 | VPP crashes during configuration of 1000 IPsec tunnels. | | | in 2t2c config, all tests are failing. | | 1t1c tests are not affected | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ - +| 5 | rls1801 plugin related performance regression | CSIT-925 | With all plugins loaded NDR, PDR and MaxRates vary | +| | | | intermittently from 3% to 5% across multiple test executions. | +| | | | Requires plugin code bisecting. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+ +| 6 | rls1801 generic small performance regression | CSIT-926 | Generic performance regression of discovered NDR, PDR and | +| | ip4base, l2xcbase, l2bdbase | | MaxRates of -3%..-1% vs. rls1710, affects ip4base, l2xcbase, | +| | | | l2bdbase test suites. Not detected by CSIT performance trending | +| | | | scheme as it was masked out by another issue CSIT-925. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+ +| 7 | rls1801 substantial NDR performance regression | CSIT-927 | Much lower NDR for vhostvr1024 tests, with mean values | +| | for vhost-user vring size of 1024 | | regression of -17%..-42% vs. rls1710, but also very high | +| | | | standard deviation of up to 1.46 Mpps => poor repeatibility. | +| | | | Making mean values not fully representative. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+ +| 8 | rls1801 substantial NDR/PDR regression for | CSIT-928 | NDR regression of -7%..-15%, PDR regression of -3%..-15% | +| | IPSec tunnel scale with HW QAT crypto-dev | | compared to rls1710. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+