X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fhttp_server_performance%2Findex.rst;h=fce8511b3ab527886516b81f6266b1e0db6ea501;hp=af8f0b40b7849ea749e14550a517a4a5720b52bc;hb=86ed10d81d7d5c27b75908cc339f5bc3d4da4668;hpb=a576a8096e610a56c098355a567e1a669692d056 diff --git a/docs/report/vpp_performance_tests/http_server_performance/index.rst b/docs/report/vpp_performance_tests/http_server_performance/index.rst index af8f0b40b7..fce8511b3a 100644 --- a/docs/report/vpp_performance_tests/http_server_performance/index.rst +++ b/docs/report/vpp_performance_tests/http_server_performance/index.rst @@ -1,90 +1,111 @@ -VPP HTTP Server Performance Results -=================================== - -Plotted results are generated by multiple executions of the same CSIT -performance tests across three physical testbeds within LF FD.io labs. -To provide a descriptive summary view, Box-and-Whisker plots are used to -display variation in measured performance values, without making any -assumptions of the underlying statistical distribution. - -For each plotted test case, Box-and-Whisker plots show the quartiles -(Min, 1st quartile / 25th percentile, 2nd quartile / 50th percentile / -mean, 3rd quartile / 75th percentile, Max) across collected data set -(data set size stated in the note below). Outliers are plotted as -individual points. Min and max values are plotted as bottom and top -Whiskers respectively. 2nd and 3rd quartiles are plotted as bottom and -top edge of the box. If multiple samples match only two values, and all -samples fall between them, then no whiskers are plotted. If all samples -have the same value, only a horizontal line is plotted. + +.. raw:: latex + + \clearpage + +.. raw:: html + + + +HTTP and TCP/IP +=============== + +Performance graphs are generated by multiple executions of the same +performance tests across physical testbeds hosted LF FD.io labs: 3n-hsw. +Box-and-Whisker plots are used to display variations in measured +throughput values, without making any assumptions of the underlying +statistical distribution. + +For each test case, Box-and-Whisker plots show the quartiles (Min, 1st +quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd +quartile / 75th percentile, Max) across collected data set. Outliers are +plotted as individual points. + +Additional information about graph data: + +#. **X-axis Labels**: indices of individual test suites as listed in + Graph Legend. + +#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per + Second [rps] throughput values. + +#. **Graph Legend**: lists X-axis indices with associated CSIT test + suites executed to generate graphed test results. + +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) .. note:: Data sources for reported test results: i) `FD.io test executor vpp - performance jobs`_, ii) archived FD.io jobs test result `output files + performance job 2n-skx`_, ii) archived FD.io jobs test result `output files <../../_static/archive/>`_. + CSIT source code for the test cases used for plots can be found in + `CSIT git repository `_. + +.. raw:: latex + + \clearpage + Connections per second ---------------------- .. raw:: html - + .. raw:: latex \begin{figure}[H] \centering \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 8cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} \label{fig:http-server-performance-cps} \end{figure} -*Figure 1. VPP HTTP Server Performance - Connections per Second* - -CSIT source code for the test cases used for above plots can be found in CSIT -git repository: - -.. only:: html - - .. program-output:: cd ../../../../../ && set +x && cd tests/vpp/perf/tcp && grep -HE '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-cps' * - :shell: - -.. only:: latex - - .. code-block:: bash +.. raw:: latex - $ cd tests/vpp/perf/tcp - $ grep -HE '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-cps' * + \clearpage Requests per second ------------------- .. raw:: html - + .. raw:: latex \begin{figure}[H] \centering \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 8cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} \label{fig:http-server-performance-rps} \end{figure} - -*Figure 2. VPP HTTP Server Performance - Requests per Second* - -CSIT source code for the test cases used for above plots can be found in CSIT -git repository: - -.. only:: html - - .. program-output:: cd ../../../../../ && set +x && cd tests/vpp/perf/tcp && grep -HE '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-rps' * - :shell: - -.. only:: latex - - .. code-block:: bash - - $ cd tests/vpp/perf/tcp - $ grep -HE '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-rps' *