rls1804 report: updates to perf rls notes, methodology.

[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst

diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 8fd8a3b..74517c3 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -4,43 +4,38 @@ CSIT Release Notes
 Changes in CSIT |release|\r
 -------------------------\r
 \r
 Changes in CSIT |release|\r
 -------------------------\r
 \r

-#. Added VPP performance tests\r
+#. **Added VPP performance tests**\r

 \r
 \r

-   - **Container Service Chain Topologies Orchestrated by K8s with VPP Memif**\r
+   - **MRR tests** : New MRR tests measure the packet forwarding rate\r
+       under the maximum load offered by traffic generator over a set\r
+       trial duration, regardless of packet loss. Maximum load for\r
+       specified Ethernet frame size is set to the bi-directional link\r
+       rate. MRR tests are used for continuous performance trending and\r
+       for comparison between releases.\r

 \r
 \r

-     - Added tests with VPP vswitch in container connecting a number of VPP-\r
-       in-container service chain topologies with L2 Cross-Connect and L2\r
-       Bridge-Domain configurations, orchestrated by Kubernetes. Added\r
-       following forwarding topologies: i) "Parallel" with packets flowing from\r
-       NIC via VPP to container and back to VPP and NIC; ii) "Chained" (a.k.a.\r
-       "Snake") with packets flowing via VPP to container, back to VPP, to next\r
-       container, back to VPP and so on until the last container in a chain,\r
-       then back to VPP and NIC; iii) "Horizontal" with packets flowing via VPP\r
-       to container, then via "horizontal" memif to next container, and so on\r
-       until the last container, then back to VPP and NIC;\r
+   - **SRv6** : Initial SRv6 (Segment Routing IPv6) tests verifying\r
+       performance of IPv6 and SRH (Segment Routing Header)\r
+       encapsulation, decapsulation, lookups and rewrites based on\r
+       configured End and End.DX6 SRv6 egress functions.\r

 \r
 \r

-   - **MRR tests**\r
+#. **Presentation and Analytics Layer (PAL)**\r

 \r
 \r

-     - <placeholder>;\r
+     - Added continuous performance measuring, trending and anomaly\r
+       detection. Includes new PAL code and Jenkins jobs for Performance\r
+       Trending (PT) and Performance Analysis (PA) producing performance\r
+       trending dashboard and trendline graphs with summary and drill-\r
+       down views across all specified tests that can be reviewed and\r
+       inspected regularly by FD.io developers and users community.\r

 \r
 \r

-   - **SRv6**\r
+#. **Test Framework Optimizations**\r

 \r
 \r

-     - Initial SRv6 (Segment Routing IPv6) tests verifying performance of\r
-       IPv6 and SRH (Segment Routing Header) encapsulation, decapsulation,\r
-       lookups and rewrites based on configured End and End.DX6 SRv6 egress\r
-       functions;\r
+     - **Performance tests efficiency** : Qemu build/install\r
+     optimizations, warmup phase handling, vpp restart handling.\r
+     Resulted in improved stability and reduced total execution time by\r
+     30% for single pkt size e.g. 64B/78B.\r

 \r
 \r

-#. Presentation and Analytics Layer\r
-\r
-     - Added throughput speedup analysis for multi-core and multi-thread\r
-       VPP tests into Presentation and Analytics Layer (PAL) for automated\r
-       CSIT test results analysis;\r
-\r
-#. Other changes\r
-\r
-     - **Framework optimizations**\r
-\r
-       - Performance test duration improvements and stability;\r
+     - **General code housekeeping** : ongoing RF keywords\r
+     optimizations, removal of redundant RF keywords.\r

 \r
 Performance Changes\r
 -------------------\r
 \r
 Performance Changes\r
 -------------------\r


@@ -98,6 +93,8 @@ pretty ASCII formats:
 Known Issues\r
 ------------\r
 \r
 Known Issues\r
 ------------\r
 \r

+<to be updated before rls1804 release>\r
+\r

 Here is the list of known issues in CSIT |release| for VPP performance tests:\r
 \r
 +---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
 Here is the list of known issues in CSIT |release| for VPP performance tests:\r
 \r
 +---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r