X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fpacket_throughput_graphs%2Findex.rst;h=aa03a669f10af452699cb79958ded771c7865c1f;hb=refs%2Fchanges%2F01%2F13801%2F14;hp=4abdf8eeb91938e314987b01b7e986219a239ccd;hpb=55c99e66ca90a80f50e897b5b1c8db6063bb2448;p=csit.git diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst index 4abdf8eeb9..aa03a669f1 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst @@ -1,12 +1,53 @@ -Packet Throughput Graphs -======================== +Packet Throughput +================= + +Plotted results are generated by multiple executions of the same CSIT +performance tests across three physical testbeds within LF FD.io labs. +To provide a descriptive summary view, Box-and-Whisker plots are used to +display variation in measured throughput values, without making any +assumptions of the underlying statistical distribution. + +For each plotted test case, Box-and-Whisker plots show the quartiles +(Min, 1st quartile / 25th percentile, 2nd quartile / 50th percentile / +mean, 3rd quartile / 75th percentile, Max) across collected data set +(data set size stated in the note below). Outliers are plotted as +individual points. Min and max values are plotted as bottom and top +Whiskers respectively. 2nd and 3rd quartiles are plotted as bottom and +top edge of the box. If multiple samples match only two values, and all +samples fall between them, then no whiskers are plotted. If all samples +have the same value, only a horizontal line is plotted. + +*Title of each graph* is a regex (regular expression) matching all +throughput test cases plotted on this graph, *X-axis labels* are indices +of individual test suites executed by +FD.io test executor vpp performance jobs that created result output +files used as data sources for the graph, *Y-axis labels* are measured Packets +Per Second [pps] values, and the *Graph legend* lists the plotted test suites +and their indices. + + +.. note:: + + Test results have been generated by + `FD.io test executor vpp performance job 3n-hsw`_, + `FD.io test executor vpp performance job 3n-skx`_ and + `FD.io test executor vpp performance job 2n-skx`_ with Robot Framework + result files csit-vpp-perf-|srelease|-\*.zip + `archived here <../../_static/archive/>`_. + Plotted data set size per test case is equal to the number of job executions + presented in this report version: **10**. .. toctree:: + :maxdepth: 1 l2 - ipv4 - ipv6 - ipv4_tunnels - ipv6_tunnels + ip4 + ip6 + srv6 + ip4_tunnels + ip6_tunnels vm_vhost + container_memif + container_orchestrated ipsec + vts