csit rls1704 report: final update to csit_release_notes.rst, packet_*_graphs.rst...

[csit.git] / docs / report / vpp_performance_tests / packet_throughput_graphs / l2.rst

diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst
index d9a6901..5344dd7 100644 (file)
--- a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst
+++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst
@@ -7,11 +7,15 @@ and PDR throughput (<0.5% packet loss). Performance is reported for VPP
 running in multiple configurations of VPP worker thread(s), a.k.a. VPP
 data plane thread(s), and their physical CPU core(s) placement.
 
 running in multiple configurations of VPP worker thread(s), a.k.a. VPP
 data plane thread(s), and their physical CPU core(s) placement.
 

-Results are generated by multiple executions of the same CSIT tests.
-In order to display variation in measured throughput values, Box-and-
-whisker plots are used to show their quartiles (Min, 1st quartile / 25th
-percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / 75th
-percentile, Max). Outliers are plotted as individual points.
+Results are generated by multiple executions of the same CSIT
+performance tests across three physical testbeds within LF FD.io labs.
+To provide a descriptive summary view, Box-and-Whisker plots are used to
+display variation in measured throughput values, without making any
+assumptions of the underlying statistical distribution. For each plotted
+test case, Box-and-Whisker plots show the quartiles (Min, 1st quartile
+/ 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile /
+75th percentile, Max) across collected data set (data set size stated in
+the note below). Outliers are plotted as individual points.

 
 *Title of each graph* is a regex (regular expression) matching all
 throughput test cases plotted on this graph, *X-axis labels* are indices
 
 *Title of each graph* is a regex (regular expression) matching all
 throughput test cases plotted on this graph, *X-axis labels* are indices


@@ -26,7 +30,9 @@ legend* lists the plotted test suites and their indices.
     `csit-vpp-perf-1704-all
     <https://jenkins.fd.io/view/csit/job/csit-vpp-perf-1704-all/>`_,
     with Robot Framework result files csit-vpp-perf-1704-all-<id>.zip
     `csit-vpp-perf-1704-all
     <https://jenkins.fd.io/view/csit/job/csit-vpp-perf-1704-all/>`_,
     with Robot Framework result files csit-vpp-perf-1704-all-<id>.zip

-    `archived here <../../_static/archive/>`_
+    `archived here <../../_static/archive/>`_. Plotted data set size per
+    test case is equal to the number of job executions presented in this
+    report version: **5**.

 
 NDR Throughput
 ~~~~~~~~~~~~~~
 
 NDR Throughput
 ~~~~~~~~~~~~~~