Report: Data, plots, datetime

[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst

diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 8fd8a3b..d7c2bbc 100644 (file)
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -4,43 +4,38 @@ CSIT Release Notes
 Changes in CSIT |release|\r
 -------------------------\r
 \r
-#. Added VPP performance tests\r
+#. **Added VPP performance tests**\r
 \r
-   - **Container Service Chain Topologies Orchestrated by K8s with VPP Memif**\r
+   - **MRR tests** : New MRR tests measure the packet forwarding rate\r
+       under the maximum load offered by traffic generator over a set\r
+       trial duration, regardless of packet loss. Maximum load for\r
+       specified Ethernet frame size is set to the bi-directional link\r
+       rate. MRR tests are used for continuous performance trending and\r
+       for comparison between releases.\r
 \r
-     - Added tests with VPP vswitch in container connecting a number of VPP-\r
-       in-container service chain topologies with L2 Cross-Connect and L2\r
-       Bridge-Domain configurations, orchestrated by Kubernetes. Added\r
-       following forwarding topologies: i) "Parallel" with packets flowing from\r
-       NIC via VPP to container and back to VPP and NIC; ii) "Chained" (a.k.a.\r
-       "Snake") with packets flowing via VPP to container, back to VPP, to next\r
-       container, back to VPP and so on until the last container in a chain,\r
-       then back to VPP and NIC; iii) "Horizontal" with packets flowing via VPP\r
-       to container, then via "horizontal" memif to next container, and so on\r
-       until the last container, then back to VPP and NIC;\r
+   - **Service Chaining with SRv6** : SRv6 (Segment Routing IPv6) proxy tests\r
+       verifying performance of Endpoint to SR-unaware appliance via\r
+       masquerading (End.AM), dynamic proxy (End.AD) or static proxy (End.AS)\r
+       functions.\r
 \r
-   - **MRR tests**\r
+#. **Presentation and Analytics Layer (PAL)**\r
 \r
-     - <placeholder>;\r
+     - Added continuous performance measuring, trending and anomaly\r
+       detection. Includes new PAL code and Jenkins jobs for Performance\r
+       Trending (PT) and Performance Analysis (PA) producing performance\r
+       trending dashboard and trendline graphs with summary and drill-\r
+       down views across all specified tests that can be reviewed and\r
+       inspected regularly by FD.io developers and users community.\r
 \r
-   - **SRv6**\r
+#. **Test Framework Optimizations**\r
 \r
-     - Initial SRv6 (Segment Routing IPv6) tests verifying performance of\r
-       IPv6 and SRH (Segment Routing Header) encapsulation, decapsulation,\r
-       lookups and rewrites based on configured End and End.DX6 SRv6 egress\r
-       functions;\r
+     - **Performance tests efficiency** : Qemu build/install\r
+     optimizations, warmup phase handling, vpp restart handling.\r
+     Resulted in improved stability and reduced total execution time by\r
+     30% for single pkt size e.g. 64B/78B.\r
 \r
-#. Presentation and Analytics Layer\r
-\r
-     - Added throughput speedup analysis for multi-core and multi-thread\r
-       VPP tests into Presentation and Analytics Layer (PAL) for automated\r
-       CSIT test results analysis;\r
-\r
-#. Other changes\r
-\r
-     - **Framework optimizations**\r
-\r
-       - Performance test duration improvements and stability;\r
+     - **General code housekeeping** : ongoing RF keywords\r
+     optimizations, removal of redundant RF keywords.\r
 \r
 Performance Changes\r
 -------------------\r
@@ -78,10 +73,6 @@ pretty ASCII formats:
   - `pretty ASCII format for 1t1c <../_static/vpp/performance-changes-pdr-1t1c-full.txt>`_,\r
   - `pretty ASCII format for 2t2c <../_static/vpp/performance-changes-pdr-2t2c-full.txt>`_.\r
 \r
-Measured improvements are in line with VPP code optimizations listed in\r
-`VPP-18.01 release notes\r
-<https://docs.fd.io/vpp/18.01/release_notes_1801.html>`_.\r
-\r
 MRR Throughput Changes\r
 ~~~~~~~~~~~~~~~~~~~~~~\r
 \r
@@ -98,6 +89,8 @@ pretty ASCII formats:
 Known Issues\r
 ------------\r
 \r
+<to be updated before rls1804 release>\r
+\r
 Here is the list of known issues in CSIT |release| for VPP performance tests:\r
 \r
 +---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r