X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fsoak_tests%2Findex.rst;h=c8aa4676856718a8e34d80a13b3733fc3832508b;hb=ddaf1688aa8dbb6f9a6e463faaf62c752c53a394;hp=568d0477ee208d7ed1eb674babb984deb9af0a24;hpb=b039eae431ce144b4d5e9ec05eeafbdea557d755;p=csit.git diff --git a/docs/report/vpp_performance_tests/soak_tests/index.rst b/docs/report/vpp_performance_tests/soak_tests/index.rst index 568d0477ee..c8aa467685 100644 --- a/docs/report/vpp_performance_tests/soak_tests/index.rst +++ b/docs/report/vpp_performance_tests/soak_tests/index.rst @@ -28,16 +28,14 @@ -.. _soak_tests: +.. _`soak tests`: Soak Tests ========== -Long duration soak tests are executed using `PLRsearch algorithm`_. - -As soak tests are new, and take long time to run, -only 6 tests were executed. From those, 4 tests encountered some caveat, -making their results unreliable. +Long duration (30 minutes per test) soak tests are executed +using :ref:`plrsearch` algorithm. As the tests take long time, +only 12 test cases were executed, two runs each. Additional information about graph data: @@ -45,17 +43,19 @@ Additional information about graph data: #. **X-axis Labels**: indices of test suites. -#. **Y-axis Labels**: estimated intervals for packet throughput value in [Mpps]. +#. **Y-axis Labels**: estimated lower bounds for critical rate value in [Mpps]. -#. **Graph Legend**: list of X-axis indices with CSIT test suites. +#. **Graph Legend**: list of X-axis indices with CSIT test cases. -#. **Hover Information**: lists the lower and upper bounds for the estimated - throughput value. +#. **Hover Information**: in general lists minimum, first quartile, median, + third quartile, and maximum. As only two samples are used, + minimum and maximum are not distinguished from quartiles. .. note:: Test results have been generated by - `FD.io test executor vpp performance job 2n-skx`_ with RF + `FD.io test executor vpp performance job 2n-skx`_ and + `FD.io test executor vpp performance job 2n-clx`_ with RF result files csit-vpp-perf-|srelease|-\*.zip `archived here <../../_static/archive/>`_. @@ -63,10 +63,76 @@ Additional information about graph data: \clearpage +2n-clx +------ + +.. raw:: html + +
+ +


+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-1} + \label{fig:soak-test-1} + \end{figure} + +.. raw:: latex + + \clearpage + +.. raw:: html + +
+ +


+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2} + \label{fig:soak-test-2} + \end{figure} + +.. raw:: latex + + \clearpage + +2n-skx +------ + +.. raw:: html + +
+ +


+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-1} + \label{fig:soak-test-2n-skx-1} + \end{figure} + +.. raw:: latex + + \clearpage + .. raw:: html
- +


@@ -75,6 +141,6 @@ Additional information about graph data: \begin{figure}[H] \centering \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{example-soak-boxes} - \label{fig:example-soak-boxes} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-2} + \label{fig:soak-test-2n-skx-2} \end{figure}