docs/report/vpp_performance_tests/packet_throughput_graphs/ipsec.rst

   1 IPSec Crypto HW: IP4 Routed-Forwarding
   2 ======================================
   3
   4 Following sections include summary graphs of VPP Phy-to-Phy performance with
   5 IPSec encryption used in combination with IPv4 routed-forwarding,
   6 including NDR throughput (zero packet loss) and PDR throughput (<0.5%
   7 packet loss). VPP IPSec encryption is accelerated using DPDK cryptodev
   8 library driving Intel Quick Assist (QAT) crypto PCIe hardware cards.
   9 Performance is reported for VPP running in multiple configurations of
  10 VPP worker thread(s), a.k.a. VPP data plane thread(s), and their
  11 physical CPU core(s) placement.
  12
  13 Results are generated by multiple executions of the same CSIT
  14 performance tests across three physical testbeds within LF FD.io labs.
  15 To provide a descriptive summary view, Box-and-Whisker plots are used to
  16 display variation in measured throughput values, without making any
  17 assumptions of the underlying statistical distribution. For each plotted
  18 test case, Box-and-Whisker plots show the quartiles (Min, 1st quartile
  19 / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile /
  20 75th percentile, Max) across collected data set (data set size stated in
  21 the note below). Outliers are plotted as individual points.
  22
  23 *Title of each graph* is a regex (regular expression) matching all
  24 throughput test cases plotted on this graph, *X-axis labels* are indices
  25 of individual test suites executed by csit-vpp-perf-1704-all jobs that
  26 created result output files used as data sources for the graph, *Y-axis
  27 labels* are measured Packets Per Second [pps] values, and the *Graph
  28 legend* lists the plotted test suites and their indices.
  29
  30 .. note::
  31
  32     Test results have been generated by FD.io test executor jobs
  33     `csit-vpp-perf-1704-all
  34     <https://jenkins.fd.io/view/csit/job/csit-vpp-perf-1704-all/>`_,
  35     with Robot Framework result files csit-vpp-perf-1704-all-<id>.zip
  36     `archived here <../../_static/archive/>`_. Plotted data set size per
  37     test case is equal to the number of job executions presented in this
  38     report version: **5**.
  39
  40 NDR Throughput
  41 ~~~~~~~~~~~~~~
  42
  43 VPP NDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented
  44 in the graph below.
  45
  46 .. raw:: html
  47
  48     <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/vpp/64B-1t1c-ipsechw-ndrdisc.html"></iframe>
  49
  50 *Figure 1. VPP 1thread 1core - NDR Throughput for Phy-to-Phy IPSEC HW.*
  51
  52 CSIT source code for the test cases used for above plots can be found in CSIT
  53 git repository:
  54
  55 .. code-block:: bash
  56
  57     $ cd $CSIT/tests/perf
  58     $ grep -E "64B-1t1c-.*ipsec.*-ndrdisc" *
  59
  60     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-ndrdisc
  61     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-ndrdisc
  62     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-ndrdisc
  63     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-ndrdisc
  64     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-ndrdisc
  65     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-ndrdisc
  66     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-ndrdisc
  67     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc03-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-ndrdisc
  68     40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrdisc
  69
  70
  71 VPP NDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented
  72 in the graph below.
  73
  74 .. raw:: html
  75
  76     <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/vpp/64B-2t2c-ipsechw-ndrdisc.html"></iframe>
  77
  78 *Figure 2. VPP 2threads 2cores - NDR Throughput for Phy-to-Phy IPSEC HW.*
  79
  80 CSIT source code for the test cases used for above plots can be found in CSIT
  81 git repository:
  82
  83 .. code-block:: bash
  84
  85     $ cd $CSIT/tests/perf
  86     $ grep -E "64B-2t2c-.*ipsec.*-ndrdisc" *
  87
  88     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-ndrdisc
  89     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-ndrdisc
  90     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-ndrdisc
  91     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-ndrdisc
  92     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-ndrdisc
  93     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-ndrdisc
  94     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc13-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-ndrdisc
  95     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc15-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-ndrdisc
  96     40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc07-64B-2t2c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrdisc
  97
  98 PDR Throughput
  99 ~~~~~~~~~~~~~~
 100
 101 VPP PDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented
 102 in the graph below. PDR measured for 0.5% packet loss ratio.
 103
 104 .. raw:: html
 105
 106     <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/vpp/64B-1t1c-ipsechw-pdrdisc.html"></iframe>
 107
 108 *Figure 3. VPP 1thread 1core - PDR Throughput for Phy-to-Phy IPSEC HW.*
 109
 110 CSIT source code for the test cases used for above plots can be found in CSIT
 111 git repository:
 112
 113 .. code-block:: bash
 114
 115     $ cd $CSIT/tests/perf
 116     $ grep -E "64B-1t1c-.*ipsec.*-pdrdisc" *
 117
 118     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-pdrdisc
 119     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-pdrdisc
 120     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-pdrdisc
 121     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-pdrdisc
 122     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-pdrdisc
 123     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-pdrdisc
 124     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-pdrdisc
 125     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc04-64B-1t1c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-pdrdisc
 126     40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-pdrdisc
 127
 128
 129 VPP PDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented
 130 in the graph below. PDR measured for 0.5% packet loss ratio.
 131
 132 .. raw:: html
 133
 134     <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/vpp/64B-2t2c-ipsechw-pdrdisc.html"></iframe>
 135
 136 *Figure 4. VPP 2thread 2core - PDR Throughput for Phy-to-Phy IPSEC HW.*
 137
 138 CSIT source code for the test cases used for above plots can be found in CSIT
 139 git repository:
 140
 141 .. code-block:: bash
 142
 143     $ cd $CSIT/tests/perf
 144     $ grep -E "64B-2t2c-.*ipsec.*-pdrdisc" *
 145
 146     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-aes-gcm-pdrdisc
 147     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-aes-gcm-pdrdisc
 148     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-interfaces-cbc-sha1-pdrdisc
 149     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-cbc-sha1-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-interfaces-cbc-sha1-pdrdisc
 150     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-aes-gcm-pdrdisc
 151     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-aes-gcm-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-aes-gcm-pdrdisc
 152     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc14-64B-2t2c-ethip4ipsecscale1ip4-ip4base-tunnels-cbc-sha1-pdrdisc
 153     40ge2p1xl710-ethip4ipsecscaleip4-ip4base-tunnels-cbc-sha1-ndrpdrdisc.robot:| tc16-64B-2t2c-ethip4ipsecscale1000ip4-ip4base-tunnels-cbc-sha1-pdrdisc
 154     40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdrdisc.robot:| tc08-64B-2t2c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-pdrdisc
 155