X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fsoak_tests%2Findex.rst;h=39e5ce152fbc989edad49408473196b46f3532c9;hb=b1af33fbcd345c9d4eca534072f6daf0c55c0305;hp=568d0477ee208d7ed1eb674babb984deb9af0a24;hpb=b039eae431ce144b4d5e9ec05eeafbdea557d755;p=csit.git

diff --git a/docs/report/vpp_performance_tests/soak_tests/index.rst b/docs/report/vpp_performance_tests/soak_tests/index.rst
index 568d0477ee..39e5ce152f 100644
--- a/docs/report/vpp_performance_tests/soak_tests/index.rst
+++ b/docs/report/vpp_performance_tests/soak_tests/index.rst
@@ -28,16 +28,14 @@
 
     </script>
 
-.. _soak_tests:
+.. _`soak tests`:
 
 Soak Tests
 ==========
 
-Long duration soak tests are executed using `PLRsearch algorithm`_.
-
-As soak tests are new, and take long time to run,
-only 6 tests were executed. From those, 4 tests encountered some caveat,
-making their results unreliable.
+Long duration (30 minutes per test) soak tests are executed
+using :ref:`plrsearch` algorithm. As the test take long time, only 10 test
+were executed, two runs each.
 
 Additional information about graph data:
 
@@ -45,17 +43,24 @@ Additional information about graph data:
 
 #. **X-axis Labels**: indices of test suites.
 
-#. **Y-axis Labels**: estimated intervals for packet throughput value in [Mpps].
+#. **Y-axis Labels**: estimated lower bounds for critical rate value in [Mpps].
 
 #. **Graph Legend**: list of X-axis indices with CSIT test suites.
 
-#. **Hover Information**: lists the lower and upper bounds for the estimated
-   throughput value.
+#. **Hover Information**: in general lists minimum, first quartile, median,
+   third quartile, and maximum. If either type of outlier is present the
+   whisker on the appropriate side is taken to 1.5×IQR from the quartile
+   (the "inner fence") rather than the max or min, and individual outlying
+   data points are displayed as unfilled circles (for suspected outliers)
+   or filled circles (for outliers). (The "outer fence" is 3×IQR from the
+   quartile.)
+   When number of samples is low, some values are not displayed.
 
 .. note::
 
     Test results have been generated by
-    `FD.io test executor vpp performance job 2n-skx`_ with RF
+    `FD.io test executor vpp performance job 2n-skx`_ and
+    `FD.io test executor vpp performance job 2n-clx`_ with RF
     result files csit-vpp-perf-|srelease|-\*.zip
     `archived here <../../_static/archive/>`_.
 
@@ -63,10 +68,76 @@ Additional information about graph data:
 
     \clearpage
 
+2n-clx
+------
+
+.. raw:: html
+
+    <center>
+    <iframe id="ifrm01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-1.html"></iframe>
+    <p><br></p>
+    </center>
+
+.. raw:: latex
+
+    \begin{figure}[H]
+        \centering
+            \graphicspath{{../_build/_static/vpp/}}
+            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-1}
+            \label{fig:soak-test-1}
+    \end{figure}
+
+.. raw:: latex
+
+    \clearpage
+
+.. raw:: html
+
+    <center>
+    <iframe id="ifrm02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2.html"></iframe>
+    <p><br></p>
+    </center>
+
+.. raw:: latex
+
+    \begin{figure}[H]
+        \centering
+            \graphicspath{{../_build/_static/vpp/}}
+            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2}
+            \label{fig:soak-test-2}
+    \end{figure}
+
+.. raw:: latex
+
+    \clearpage
+
+2n-skx
+------
+
+.. raw:: html
+
+    <center>
+    <iframe id="ifrm101" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2n-skx-1.html"></iframe>
+    <p><br></p>
+    </center>
+
+.. raw:: latex
+
+    \begin{figure}[H]
+        \centering
+            \graphicspath{{../_build/_static/vpp/}}
+            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-1}
+            \label{fig:soak-test-2n-skx-1}
+    \end{figure}
+
+.. raw:: latex
+
+    \clearpage
+
 .. raw:: html
 
     <center>
-    <iframe id="ifrm01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/example-soak-boxes.html"></iframe>
+    <iframe id="ifrm102" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2n-skx-2.html"></iframe>
     <p><br></p>
     </center>
 
@@ -75,6 +146,6 @@ Additional information about graph data:
     \begin{figure}[H]
         \centering
             \graphicspath{{../_build/_static/vpp/}}
-            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{example-soak-boxes}
-            \label{fig:example-soak-boxes}
+            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-2}
+            \label{fig:soak-test-2n-skx-2}
     \end{figure}