9 Throughput graphs are generated by multiple executions of the same
10 performance tests across physical testbeds hosted LF FD.io labs:
11 2n-skx. Box-and-Whisker plots are used to display variations in
12 measured throughput values, without making any assumptions of the
13 underlying statistical distribution.
15 For each test case, Box-and-Whisker plots show the quartiles (Min, 1st
16 quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd
17 quartile / 75th percentile, Max) across collected data set. Outliers are
18 plotted as individual points.
20 Additional information about graph data:
22 #. **Graph Title**: describes tested packet path, testbed topology,
23 processor model, NIC model, packet size, number of cores and
24 threads used by data plane workers and indication of DPDK DUT
27 #. **X-axis Labels**: indices of individual test suites as listed in
30 #. **Y-axis Labels**: measured Packets Per Second [pps] throughput
33 #. **Graph Legend**: lists X-axis indices with associated CSIT test
34 suites executed to generate graphed test results.
36 #. **Hover Information**: lists minimum, first quartile, median,
37 third quartile, and maximum. If either type of outlier is present the
38 whisker on the appropriate side is taken to 1.5×IQR from the quartile
39 (the "inner fence") rather than the max or min, and individual outlying
40 data points are displayed as unfilled circles (for suspected outliers)
41 or filled circles (for outliers). (The "outer fence" is 3×IQR from the
46 Test results are stored in
47 `build logs from FD.io trex performance job 2n-skx`_.
48 Required per test case data set size is **10** and for TRex tests
49 this is the actual size, as all scheduled test executions completed