X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fpacket_throughput_graphs%2Fipsec.rst;h=31420b6845df01182fb33b09c71c75dba64ceda5;hb=e0806c8358f38406432d1c6f09de7b90fadb8646;hp=ad71a8a07c68ffe321115c3e629fd3d3e27be70a;hpb=fa8714742330382e764419c0432099702f182da1;p=csit.git diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipsec.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipsec.rst index ad71a8a07c..31420b6845 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipsec.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipsec.rst @@ -1,5 +1,35 @@ -IPSec Crypto HW: IP4 Routed-Forwarding -====================================== + +.. raw:: latex + + \clearpage + +.. raw:: html + + + +IPSec IPv4 Routing +================== Following sections include summary graphs of VPP Phy-to-Phy performance with IPSec encryption used in combination with IPv4 routed-forwarding, @@ -10,146 +40,338 @@ Performance is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread(s), and their physical CPU core(s) placement. -Results are generated by multiple executions of the same CSIT -performance tests across three physical testbeds within LF FD.io labs. -To provide a descriptive summary view, Box-and-Whisker plots are used to -display variation in measured throughput values, without making any -assumptions of the underlying statistical distribution. For each plotted -test case, Box-and-Whisker plots show the quartiles (Min, 1st quartile -/ 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / -75th percentile, Max) across collected data set (data set size stated in -the note below). Outliers are plotted as individual points. +CSIT source code for the test cases used for plots can be found in +`CSIT git repository `_. + +.. raw:: latex + + \clearpage + +3n-hsw-xl710 +~~~~~~~~~~~~ + +64b-1t1c-base +------------- + +.. raw:: html + +
+ +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-1t1c-base-ndr` + +.. raw:: html + + + +



+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-1t1c-base-ndr} + \label{fig:ipsec-3n-hsw-xl710-64b-1t1c-base-ndr} + \end{figure} + +.. raw:: html + +
+ +.. raw:: latex + + \clearpage + +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-1t1c-base-pdr` + +.. raw:: html + + + +



+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-1t1c-base-pdr} + \label{fig:ipsec-3n-hsw-xl710-64b-1t1c-base-pdr} + \end{figure} + +.. raw:: latex + + \clearpage + +64b-2t2c-base +------------- + +.. raw:: html + +
+ +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-2t2c-base-ndr` + +.. raw:: html + + + +



+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-2t2c-base-ndr} + \label{fig:ipsec-3n-hsw-xl710-64b-2t2c-base-ndr} + \end{figure} + +.. raw:: html + +
+ +.. raw:: latex + + \clearpage + +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-2t2c-base-pdr` + +.. raw:: html + + + +



+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-2t2c-base-pdr} + \label{fig:ipsec-3n-hsw-xl710-64b-2t2c-base-pdr} + \end{figure} + +.. raw:: latex + + \clearpage + +64b-1t1c-scale +-------------- + +.. raw:: html + +
+ +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-1t1c-scale-ndr` + +.. raw:: html + + + +



+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-1t1c-scale-ndr} + \label{fig:ipsec-3n-hsw-xl710-64b-1t1c-scale-ndr} + \end{figure} + +.. raw:: html + +
+ +.. raw:: latex + + \clearpage + +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-1t1c-scale-pdr` + +.. raw:: html + + + +



+
+ +.. raw:: latex -*Title of each graph* is a regex (regular expression) matching all -throughput test cases plotted on this graph, *X-axis labels* are indices -of individual test suites executed by csit-vpp-perf-1704-all jobs that -created result output files used as data sources for the graph, *Y-axis -labels* are measured Packets Per Second [pps] values, and the *Graph -legend* lists the plotted test suites and their indices. + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-1t1c-scale-pdr} + \label{fig:ipsec-3n-hsw-xl710-64b-1t1c-scale-pdr} + \end{figure} -.. note:: +.. raw:: latex - Test results have been generated by FD.io test executor jobs - `csit-vpp-perf-1704-all - `_, - with Robot Framework result files csit-vpp-perf-1704-all-.zip - `archived here <../../_static/archive/>`_. Plotted data set size per - test case is equal to the number of job executions presented in this - report version: **5**. + \clearpage -NDR Throughput -~~~~~~~~~~~~~~ +64b-2t2c-scale +-------------- -VPP NDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented -in the graph below. +.. raw:: html + +
+ +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-2t2c-scale-ndr` + +.. raw:: html + + + +



+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-2t2c-scale-ndr} + \label{fig:ipsec-3n-hsw-xl710-64b-2t2c-scale-ndr} + \end{figure} + +.. raw:: html + +
+ +.. raw:: latex + + \clearpage + +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-2t2c-scale-pdr` .. raw:: html - + + +



+
+ +.. raw:: latex -*Figure 1. VPP 1thread 1core - NDR Throughput for Phy-to-Phy IPSEC HW.* + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-2t2c-scale-pdr} + \label{fig:ipsec-3n-hsw-xl710-64b-2t2c-scale-pdr} + \end{figure} -CSIT source code for the test cases used for above plots can be found in CSIT -git repository: +.. raw:: latex -.. code-block:: bash + \clearpage - $ cd $CSIT/tests/perf - $ grep -E "64B-1t1c-.*ipsec.*-ndrdisc" * +64b-1t1c-sw +----------- - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrdisc +.. raw:: html +
-VPP NDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented -in the graph below. +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-1t1c-sw-ndr` .. raw:: html - + + +



+
-*Figure 2. VPP 2threads 2cores - NDR Throughput for Phy-to-Phy IPSEC HW.* +.. raw:: latex -CSIT source code for the test cases used for above plots can be found in CSIT -git repository: + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-1t1c-sw-ndr} + \label{fig:ipsec-3n-hsw-xl710-64b-1t1c-sw-ndr} + \end{figure} -.. code-block:: bash +.. raw:: html - $ cd $CSIT/tests/perf - $ grep -E "64B-2t2c-.*ipsec.*-ndrdisc" * +
- 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-ndrdisc - 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc07-64B-2t2c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrdisc +.. raw:: latex -PDR Throughput -~~~~~~~~~~~~~~ + \clearpage -VPP PDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented -in the graph below. PDR measured for 0.5% packet loss ratio. +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-1t1c-sw-pdr` .. raw:: html - + + +



+
-*Figure 3. VPP 1thread 1core - PDR Throughput for Phy-to-Phy IPSEC HW.* +.. raw:: latex -CSIT source code for the test cases used for above plots can be found in CSIT -git repository: + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-1t1c-sw-pdr} + \label{fig:ipsec-3n-hsw-xl710-64b-1t1c-sw-pdr} + \end{figure} -.. code-block:: bash +.. raw:: latex - $ cd $CSIT/tests/perf - $ grep -E "64B-1t1c-.*ipsec.*-pdrdisc" * + \clearpage - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-pdrdisc +64b-2t2c-sw +----------- +.. raw:: html + +
-VPP PDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented -in the graph below. PDR measured for 0.5% packet loss ratio. +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-2t2c-sw-ndr` .. raw:: html - + + +



+
-*Figure 4. VPP 2thread 2core - PDR Throughput for Phy-to-Phy IPSEC HW.* +.. raw:: latex -CSIT source code for the test cases used for above plots can be found in CSIT -git repository: + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-2t2c-sw-ndr} + \label{fig:ipsec-3n-hsw-xl710-64b-2t2c-sw-ndr} + \end{figure} -.. code-block:: bash +.. raw:: html + +
+ +.. raw:: latex + + \clearpage + +:index:`Packet Throughput: ipsec-3n-hsw-xl710-64b-2t2c-sw-pdr` + +.. raw:: html - $ cd $CSIT/tests/perf - $ grep -E "64B-2t2c-.*ipsec.*-pdrdisc" * + + +



+
- 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-pdrdisc - 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc08-64B-2t2c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-pdrdisc +.. raw:: latex + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{ipsec-3n-hsw-xl710-64b-2t2c-sw-pdr} + \label{fig:ipsec-3n-hsw-xl710-64b-2t2c-sw-pdr} + \end{figure}