</script>
-.. _soak_tests:
+.. _`soak tests`:
Soak Tests
==========
-Long duration soak tests are executed using `plrsearch_algorithm`_.
+Long duration (30 minutes per test) soak tests are executed
+using :ref:`plrsearch` algorithm. As the tests take long time,
+only 12 test cases were executed, two runs each.
Additional information about graph data:
#. **X-axis Labels**: indices of test suites.
-#. **Y-axis Labels**: estimated intervals for packet throughput value in [Mpps].
+#. **Y-axis Labels**: estimated lower bounds for critical rate value in [Mpps].
-#. **Graph Legend**: list of X-axis indices with CSIT test suites.
+#. **Graph Legend**: list of X-axis indices with CSIT test cases.
-#. **Hover Information**: lists minimum, first quartile, median,
- third quartile, and maximum. If either type of outlier is present the
- whisker on the appropriate side is taken to 1.5×IQR from the quartile
- (the "inner fence") rather than the max or min, and individual outlying
- data points are displayed as unfilled circles (for suspected outliers)
- or filled circles (for outliers). (The "outer fence" is 3×IQR from the
- quartile.)
- It also lists the lower bounds for the estimated throughput value.
+#. **Hover Information**: in general lists minimum, first quartile, median,
+ third quartile, and maximum. As only two samples are used,
+ minimum and maximum are not distinguished from quartiles.
.. note::
- Test results have been generated by
- `FD.io test executor vpp performance job 2n-skx`_ with RF
+ Test results are stored in
+ `build logs from FD.io vpp performance job 2n-icx`_,
+ `build logs from FD.io vpp performance job 2n-skx`_ and
+ `build logs from FD.io vpp performance job 2n-clx`_ with RF
result files csit-vpp-perf-|srelease|-\*.zip
`archived here <../../_static/archive/>`_.
\clearpage
+2n-icx
+------
+
+.. raw:: html
+
+ <center>
+ <iframe id="icx01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2n-icx-1.html"></iframe>
+ <p><br></p>
+ </center>
+
+.. raw:: latex
+
+ \begin{figure}[H]
+ \centering
+ \graphicspath{{../_build/_static/vpp/}}
+ \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-icx-1}
+ \label{fig:soak-test-2n-icx-1}
+ \end{figure}
+
+.. raw:: latex
+
+ \clearpage
+
+.. raw:: html
+
+ <center>
+ <iframe id="icx02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2n-icx-2.html"></iframe>
+ <p><br></p>
+ </center>
+
+.. raw:: latex
+
+ \begin{figure}[H]
+ \centering
+ \graphicspath{{../_build/_static/vpp/}}
+ \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-icx-2}
+ \label{fig:soak-test-2n-icx-2}
+ \end{figure}
+
+.. raw:: latex
+
+ \clearpage
+
+2n-clx
+------
+
.. raw:: html
<center>
\includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2}
\label{fig:soak-test-2}
\end{figure}
+
+.. raw:: latex
+
+ \clearpage
+
+2n-skx
+------
+
+.. raw:: html
+
+ <center>
+ <iframe id="ifrm101" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2n-skx-1.html"></iframe>
+ <p><br></p>
+ </center>
+
+.. raw:: latex
+
+ \begin{figure}[H]
+ \centering
+ \graphicspath{{../_build/_static/vpp/}}
+ \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-1}
+ \label{fig:soak-test-2n-skx-1}
+ \end{figure}
+
+.. raw:: latex
+
+ \clearpage
+
+.. raw:: html
+
+ <center>
+ <iframe id="ifrm102" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/soak-test-2n-skx-2.html"></iframe>
+ <p><br></p>
+ </center>
+
+.. raw:: latex
+
+ \begin{figure}[H]
+ \centering
+ \graphicspath{{../_build/_static/vpp/}}
+ \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-2}
+ \label{fig:soak-test-2n-skx-2}
+ \end{figure}