X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcsit_release_notes.rst;h=0914d9f4da30478f4c754eaa2180068f76d72f8c;hp=3ce11bdae5c07acc123878048fe95f0ef1bdba0d;hb=202f199be94d87144384f3ea9c6d50e9766b0d73;hpb=5e7be479eacd4d1085cab152c35dcb6433a146ed diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 3ce11bdae5..0914d9f4da 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -6,14 +6,14 @@ Changes in CSIT |release| #. **Added VPP performance tests** - - **MRR tests** : New MRR tests measure the packet forwarding rate + - *MRR tests :* New MRR tests measure the packet forwarding rate under the maximum load offered by traffic generator over a set trial duration, regardless of packet loss. Maximum load for specified Ethernet frame size is set to the bi-directional link rate. MRR tests are used for continuous performance trending and for comparison between releases. - - **Service Chaining with SRv6** : SRv6 (Segment Routing IPv6) proxy tests + - *Service Chaining with SRv6 :* SRv6 (Segment Routing IPv6) proxy tests verifying performance of Endpoint to SR-unaware appliance via masquerading (End.AM), dynamic proxy (End.AD) or static proxy (End.AS) functions. @@ -29,12 +29,12 @@ Changes in CSIT |release| #. **Test Framework Optimizations** - - **Performance tests efficiency** : Qemu build/install + - *Performance tests efficiency :* Qemu build/install optimizations, warmup phase handling, vpp restart handling. Resulted in improved stability and reduced total execution time by 30% for single pkt size e.g. 64B/78B. - - **General code housekeeping** : ongoing RF keywords + - *General code housekeeping :* ongoing RF keywords optimizations, removal of redundant RF keywords. Performance Changes @@ -86,6 +86,24 @@ pretty ASCII formats: - `pretty ASCII format for 2t2c <../_static/vpp/performance-changes-mrr-2t2c-full.txt>`_, - `pretty ASCII format for 4t4c <../_static/vpp/performance-changes-mrr-4t4c-full.txt>`_. +Throughput Trending +------------------- + +In addition to reporting throughput changes between VPP releases, CSIT provides +continuous performance trending for VPP master branch: + +#. `VPP Performance Dashboard `_ +- per VPP test case throughput trend, trend compliance and summary of detected +anomalies. + +#. `Trending Methodology `_ +- throughput test metrics, trend calculations and anomaly classification +(progression, regression, outlier). + +#. `Trendline Graphs `_ +- per VPP build MRR throughput measurements against the trendline with anomaly +highlights, with associated CSIT test jobs. + Known Issues ------------