X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcsit_release_notes.rst;h=74517c30643d995d0ca499919bf7bb7f18c147f3;hp=8fd8a3b63440db4ec8880d62089d3f972a00805a;hb=7c3ca2753db85af1b71f4c35bcef4f826f60b5f0;hpb=c6aea4422456d455efd0c7ffce94aa0bc0a4dcbf diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 8fd8a3b634..74517c3064 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -4,43 +4,38 @@ CSIT Release Notes Changes in CSIT |release| ------------------------- -#. Added VPP performance tests +#. **Added VPP performance tests** - - **Container Service Chain Topologies Orchestrated by K8s with VPP Memif** + - **MRR tests** : New MRR tests measure the packet forwarding rate + under the maximum load offered by traffic generator over a set + trial duration, regardless of packet loss. Maximum load for + specified Ethernet frame size is set to the bi-directional link + rate. MRR tests are used for continuous performance trending and + for comparison between releases. - - Added tests with VPP vswitch in container connecting a number of VPP- - in-container service chain topologies with L2 Cross-Connect and L2 - Bridge-Domain configurations, orchestrated by Kubernetes. Added - following forwarding topologies: i) "Parallel" with packets flowing from - NIC via VPP to container and back to VPP and NIC; ii) "Chained" (a.k.a. - "Snake") with packets flowing via VPP to container, back to VPP, to next - container, back to VPP and so on until the last container in a chain, - then back to VPP and NIC; iii) "Horizontal" with packets flowing via VPP - to container, then via "horizontal" memif to next container, and so on - until the last container, then back to VPP and NIC; + - **SRv6** : Initial SRv6 (Segment Routing IPv6) tests verifying + performance of IPv6 and SRH (Segment Routing Header) + encapsulation, decapsulation, lookups and rewrites based on + configured End and End.DX6 SRv6 egress functions. - - **MRR tests** +#. **Presentation and Analytics Layer (PAL)** - - ; + - Added continuous performance measuring, trending and anomaly + detection. Includes new PAL code and Jenkins jobs for Performance + Trending (PT) and Performance Analysis (PA) producing performance + trending dashboard and trendline graphs with summary and drill- + down views across all specified tests that can be reviewed and + inspected regularly by FD.io developers and users community. - - **SRv6** +#. **Test Framework Optimizations** - - Initial SRv6 (Segment Routing IPv6) tests verifying performance of - IPv6 and SRH (Segment Routing Header) encapsulation, decapsulation, - lookups and rewrites based on configured End and End.DX6 SRv6 egress - functions; + - **Performance tests efficiency** : Qemu build/install + optimizations, warmup phase handling, vpp restart handling. + Resulted in improved stability and reduced total execution time by + 30% for single pkt size e.g. 64B/78B. -#. Presentation and Analytics Layer - - - Added throughput speedup analysis for multi-core and multi-thread - VPP tests into Presentation and Analytics Layer (PAL) for automated - CSIT test results analysis; - -#. Other changes - - - **Framework optimizations** - - - Performance test duration improvements and stability; + - **General code housekeeping** : ongoing RF keywords + optimizations, removal of redundant RF keywords. Performance Changes ------------------- @@ -98,6 +93,8 @@ pretty ASCII formats: Known Issues ------------ + + Here is the list of known issues in CSIT |release| for VPP performance tests: +---+-------------------------------------------------+------------+-----------------------------------------------------------------+