Changes in CSIT |release|\r
-------------------------\r
\r
-#. Added VPP performance tests\r
+#. **Added VPP performance tests**\r
\r
- - **Container Service Chain Topologies Orchestrated by K8s with VPP Memif**\r
+ - **MRR tests** : New MRR tests measure the packet forwarding rate\r
+ under the maximum load offered by traffic generator over a set\r
+ trial duration, regardless of packet loss. Maximum load for\r
+ specified Ethernet frame size is set to the bi-directional link\r
+ rate. MRR tests are used for continuous performance trending and\r
+ for comparison between releases.\r
\r
- - Added tests with VPP vswitch in container connecting a number of VPP-\r
- in-container service chain topologies with L2 Cross-Connect and L2\r
- Bridge-Domain configurations, orchestrated by Kubernetes. Added\r
- following forwarding topologies: i) "Parallel" with packets flowing from\r
- NIC via VPP to container and back to VPP and NIC; ii) "Chained" (a.k.a.\r
- "Snake") with packets flowing via VPP to container, back to VPP, to next\r
- container, back to VPP and so on until the last container in a chain,\r
- then back to VPP and NIC; iii) "Horizontal" with packets flowing via VPP\r
- to container, then via "horizontal" memif to next container, and so on\r
- until the last container, then back to VPP and NIC;\r
+ - **Service Chaining with SRv6** : SRv6 (Segment Routing IPv6) proxy tests\r
+ verifying performance of Endpoint to SR-unaware appliance via\r
+ masquerading (End.AM), dynamic proxy (End.AD) or static proxy (End.AS)\r
+ functions.\r
\r
- - **MRR tests**\r
+#. **Presentation and Analytics Layer (PAL)**\r
\r
- - <placeholder>;\r
+ - Added continuous performance measuring, trending and anomaly\r
+ detection. Includes new PAL code and Jenkins jobs for Performance\r
+ Trending (PT) and Performance Analysis (PA) producing performance\r
+ trending dashboard and trendline graphs with summary and drill-\r
+ down views across all specified tests that can be reviewed and\r
+ inspected regularly by FD.io developers and users community.\r
\r
- - **SRv6**\r
+#. **Test Framework Optimizations**\r
\r
- - Initial SRv6 (Segment Routing IPv6) tests verifying performance of\r
- IPv6 and SRH (Segment Routing Header) encapsulation, decapsulation,\r
- lookups and rewrites based on configured End and End.DX6 SRv6 egress\r
- functions;\r
+ - **Performance tests efficiency** : Qemu build/install\r
+ optimizations, warmup phase handling, vpp restart handling.\r
+ Resulted in improved stability and reduced total execution time by\r
+ 30% for single pkt size e.g. 64B/78B.\r
\r
-#. Presentation and Analytics Layer\r
-\r
- - Added throughput speedup analysis for multi-core and multi-thread\r
- VPP tests into Presentation and Analytics Layer (PAL) for automated\r
- CSIT test results analysis;\r
-\r
-#. Other changes\r
-\r
- - **Framework optimizations**\r
-\r
- - Performance test duration improvements and stability;\r
+ - **General code housekeeping** : ongoing RF keywords\r
+ optimizations, removal of redundant RF keywords.\r
\r
Performance Changes\r
-------------------\r
- `pretty ASCII format for 1t1c <../_static/vpp/performance-changes-pdr-1t1c-full.txt>`_,\r
- `pretty ASCII format for 2t2c <../_static/vpp/performance-changes-pdr-2t2c-full.txt>`_.\r
\r
-Measured improvements are in line with VPP code optimizations listed in\r
-`VPP-18.01 release notes\r
-<https://docs.fd.io/vpp/18.01/release_notes_1801.html>`_.\r
-\r
MRR Throughput Changes\r
~~~~~~~~~~~~~~~~~~~~~~\r
\r
Known Issues\r
------------\r
\r
+<to be updated before rls1804 release>\r
+\r
Here is the list of known issues in CSIT |release| for VPP performance tests:\r
\r
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r