From: Maciek Konstantynowicz Date: Tue, 20 Feb 2018 13:12:10 +0000 (+0000) Subject: rls1801: updated known issues in rls notes for vpp performance. X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=commitdiff_plain;h=5ad08ca51034048ab1965f993b2dde966ef934c8;ds=sidebyside rls1801: updated known issues in rls notes for vpp performance. Change-Id: I8f4a08933dc27db8f4f2134cdd9ddadbcd790577 Signed-off-by: Maciek Konstantynowicz --- diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 17003bc85a..7c21a3e7f9 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -122,4 +122,20 @@ Here is the list of known issues in CSIT |release| for VPP performance tests: | 4 | QAT IPSec scale with 1000 tunnels (interfaces) | VPP-1121 | VPP crashes during configuration of 1000 IPsec tunnels. | | | in 2t2c config, all tests are failing. | | 1t1c tests are not affected | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ - +| 5 | rls1801 plugin related performance regression | CSIT-925 | With all plugins loaded NDR, PDR and MaxRates vary | +| | | | intermittently from 3% to 5% across multiple test executions. | +| | | | Requires plugin code bisecting. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+ +| 6 | rls1801 generic small performance regression | CSIT-926 | Generic performance regression of discovered NDR, PDR and | +| | ip4base, l2xcbase, l2bdbase | | MaxRates of -3%..-1% vs. rls1710, affects ip4base, l2xcbase, | +| | | | l2bdbase test suites. Not detected by CSIT performance trending | +| | | | scheme as it was masked out by another issue CSIT-925. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+ +| 7 | rls1801 substantial NDR performance regression | CSIT-927 | Much lower NDR for vhostvr1024 tests, with mean values | +| | for vhost-user vring size of 1024 | | regression of -17%..-42% vs. rls1710, but also very high | +| | | | standard deviation of up to 1.46 Mpps => poor repeatibility. | +| | | | Making mean values not fully representative. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+ +| 8 | rls1801 substantial NDR/PDR regression for | CSIT-928 | NDR regression of -7%..-15%, PDR regression of -3%..-15% | +| | IPSec tunnel scale with HW QAT crypto-dev | | compared to rls1710. | ++---+-------------------------------------------------+------------+-----------------------------------------------------------------+