docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs Previous Release
   5 ---------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 2-node Intel Xeon Skylake (2n-skx), 3-node Intel Xeon Skylake
  11 (3n-skx), 2-node Intel Atom Denverton
  12 (2n-dnv), 3-node Intel Atom Denverton (3n-dnv), 3-node Arm TaiShan (3n-tsh)
  13 testbeds, in 1-core, 2-core and 4-core (MRR only) configurations.
  14
  15 Listed mean and standard deviation values are computed based on a series
  16 of the same tests executed against respective VPP releases to verify
  17 test results repeatability, with percentage change calculated for mean
  18 values. Note that the standard deviation is quite high for a small
  19 number of packet throughput tests, what indicates poor test results
  20 repeatability and makes the relative change of mean throughput value not
  21 fully representative for these tests. The root causes behind poor
  22 results repeatability vary between the test cases.
  23
  24 .. note::
  25
  26     Test results are stored in
  27
  28     - `build logs from FD.io vpp performance job 2n-skx`_,
  29     - `build logs from FD.io vpp performance job 3n-skx`_,
  30     - `build logs from FD.io vpp performance job 2n-clx`_,
  31     - `build logs from FD.io vpp performance job 2n-zn2`_,
  32     - `build logs from FD.io vpp performance job 2n-dnv`_,
  33     - `build logs from FD.io vpp performance job 3n-dnv`_,
  34     - `build logs from FD.io vpp performance job 3n-tsh`_,
  35     - `build logs from FD.io vpp performance job 2n-tx2`_
  36
  37     with RF result files csit-vpp-perf-|srelease|-\*.zip
  38     `archived here <../../_static/archive/>`_.
  39
  40 2n-skx
  41 ~~~~~~
  42
  43 NDR Comparison
  44 ``````````````
  45
  46 Comparison tables in HTML, ASCII and CSV formats:
  47
  48   - `HTML 2t1c NDR comparison <performance-changes-2n-skx-2t1c-ndr.html>`_
  49   - `HTML 4t2c NDR comparison <performance-changes-2n-skx-4t2c-ndr.html>`_
  50   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
  51   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
  52   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr-csv.csv>`_
  53   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr-csv.csv>`_
  54
  55 PDR Comparison
  56 ``````````````
  57
  58 Comparison tables in HTML, ASCII and CSV formats:
  59
  60   - `HTML 2t1c PDR comparison <performance-changes-2n-skx-2t1c-pdr.html>`_
  61   - `HTML 4t2c PDR comparison <performance-changes-2n-skx-4t2c-pdr.html>`_
  62   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
  63   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
  64   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr-csv.csv>`_
  65   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr-csv.csv>`_
  66
  67 MRR Comparison
  68 ``````````````
  69
  70 Comparison tables in HTML, ASCII and CSV formats:
  71
  72   - `HTML 2t1c MRR comparison <performance-changes-2n-skx-2t1c-mrr.html>`_
  73   - `HTML 4t2c MRR comparison <performance-changes-2n-skx-4t2c-mrr.html>`_
  74   - `HTML 8t4c MRR comparison <performance-changes-2n-skx-8t4c-mrr.html>`_
  75   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
  76   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
  77   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
  78   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr-csv.csv>`_
  79   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr-csv.csv>`_
  80   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr-csv.csv>`_
  81
  82 Latency Comparison
  83 ``````````````````
  84
  85 Comparison tables in HTML, ASCII and CSV formats:
  86
  87   - `HTML 2t1c PDR50, direction1, average value comparison <performance-changes-2n-skx-xxv710-2t1c-pdr50-d1-avg.html>`_
  88   - `HTML 2t1c PDR90, direction1, average value comparison <performance-changes-2n-skx-xxv710-2t1c-pdr90-d1-avg.html>`_
  89   - `HTML 2t1c PDR90, direction1, max value comparison <performance-changes-2n-skx-xxv710-2t1c-pdr90-d1-max.html>`_
  90   - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-skx-xxv710-2t1c-pdr50-d1-avg.txt>`_
  91   - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-skx-xxv710-2t1c-pdr90-d1-avg.txt>`_
  92   - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-skx-xxv710-2t1c-pdr90-d1-max.txt>`_
  93   - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-skx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_
  94   - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-skx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_
  95   - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-skx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_
  96
  97 3n-skx
  98 ~~~~~~
  99
 100 NDR Comparison
 101 ``````````````
 102
 103 Comparison tables in HTML, ASCII and CSV formats:
 104
 105   - `HTML 2t1c NDR comparison <performance-changes-3n-skx-2t1c-ndr.html>`_
 106   - `HTML 4t2c NDR comparison <performance-changes-3n-skx-4t2c-ndr.html>`_
 107   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
 108   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
 109   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr-csv.csv>`_
 110   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr-csv.csv>`_
 111
 112 PDR Comparison
 113 ``````````````
 114
 115 Comparison tables in HTML, ASCII and CSV formats:
 116
 117   - `HTML 2t1c PDR comparison <performance-changes-3n-skx-2t1c-pdr.html>`_
 118   - `HTML 4t2c PDR comparison <performance-changes-3n-skx-4t2c-pdr.html>`_
 119   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
 120   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
 121   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr-csv.csv>`_
 122   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr-csv.csv>`_
 123
 124 MRR Comparison
 125 ``````````````
 126
 127 Comparison tables in HTML, ASCII and CSV formats:
 128
 129   - `HTML 2t1c MRR comparison <performance-changes-3n-skx-2t1c-mrr.html>`_
 130   - `HTML 4t2c MRR comparison <performance-changes-3n-skx-4t2c-mrr.html>`_
 131   - `HTML 8t4c MRR comparison <performance-changes-3n-skx-8t4c-mrr.html>`_
 132   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
 133   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
 134   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
 135   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr-csv.csv>`_
 136   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr-csv.csv>`_
 137   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr-csv.csv>`_
 138
 139 Latency Comparison
 140 ``````````````````
 141
 142 Comparison tables in HTML, ASCII and CSV formats:
 143
 144   - `HTML 2t1c PDR50, direction1, average value comparison <performance-changes-3n-skx-xxv710-2t1c-pdr50-d1-avg.html>`_
 145   - `HTML 2t1c PDR90, direction1, average value comparison <performance-changes-3n-skx-xxv710-2t1c-pdr90-d1-avg.html>`_
 146   - `HTML 2t1c PDR90, direction1, max value comparison <performance-changes-3n-skx-xxv710-2t1c-pdr90-d1-max.html>`_
 147   - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-3n-skx-xxv710-2t1c-pdr50-d1-avg.txt>`_
 148   - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-3n-skx-xxv710-2t1c-pdr90-d1-avg.txt>`_
 149   - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-3n-skx-xxv710-2t1c-pdr90-d1-max.txt>`_
 150   - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-3n-skx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_
 151   - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-3n-skx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_
 152   - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-3n-skx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_
 153
 154 2n-clx-xxv710
 155 ~~~~~~~~~~~~~
 156
 157 NDR Comparison
 158 ``````````````
 159
 160 Comparison tables in HTML, ASCII and CSV formats:
 161
 162   - `HTML 2t1c NDR comparison <performance-changes-2n-clx-xxv710-2t1c-ndr.html>`_
 163   - `HTML 4t2c NDR comparison <performance-changes-2n-clx-xxv710-4t2c-ndr.html>`_
 164   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr.txt>`_
 165   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr.txt>`_
 166   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr-csv.csv>`_
 167   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr-csv.csv>`_
 168
 169 PDR Comparison
 170 ``````````````
 171
 172 Comparison tables in HTML, ASCII and CSV formats:
 173
 174   - `HTML 2t1c PDR comparison <performance-changes-2n-clx-xxv710-2t1c-pdr.html>`_
 175   - `HTML 4t2c PDR comparison <performance-changes-2n-clx-xxv710-4t2c-pdr.html>`_
 176   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr.txt>`_
 177   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr.txt>`_
 178   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr-csv.csv>`_
 179   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr-csv.csv>`_
 180
 181 MRR Comparison
 182 ``````````````
 183
 184 Comparison tables in HTML, ASCII and CSV formats:
 185
 186   - `HTML 2t1c MRR comparison <performance-changes-2n-clx-xxv710-2t1c-mrr.html>`_
 187   - `HTML 4t2c MRR comparison <performance-changes-2n-clx-xxv710-4t2c-mrr.html>`_
 188   - `HTML 8t4c MRR comparison <performance-changes-2n-clx-xxv710-8t4c-mrr.html>`_
 189   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr.txt>`_
 190   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr.txt>`_
 191   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr.txt>`_
 192   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr-csv.csv>`_
 193   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr-csv.csv>`_
 194   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr-csv.csv>`_
 195
 196 Latency Comparison
 197 ``````````````````
 198
 199 Comparison tables in HTML, ASCII and CSV formats:
 200
 201   - `HTML 2t1c PDR50, direction1, average value comparison <performance-changes-2n-clx-xxv710-2t1c-pdr50-d1-avg.html>`_
 202   - `HTML 2t1c PDR90, direction1, average value comparison <performance-changes-2n-clx-xxv710-2t1c-pdr90-d1-avg.html>`_
 203   - `HTML 2t1c PDR90, direction1, max value comparison <performance-changes-2n-clx-xxv710-2t1c-pdr90-d1-max.html>`_
 204   - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr50-d1-avg.txt>`_
 205   - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr90-d1-avg.txt>`_
 206   - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr90-d1-max.txt>`_
 207   - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_
 208   - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_
 209   - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_
 210
 211 2n-clx-cx556a
 212 ~~~~~~~~~~~~~
 213
 214 NDR Comparison
 215 ``````````````
 216
 217 Comparison tables in HTML, ASCII and CSV formats:
 218
 219   - `HTML 2t1c NDR comparison <performance-changes-2n-clx-cx556a-2t1c-ndr.html>`_
 220   - `HTML 4t2c NDR comparison <performance-changes-2n-clx-cx556a-4t2c-ndr.html>`_
 221   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-ndr.txt>`_
 222   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-ndr.txt>`_
 223   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-ndr-csv.csv>`_
 224   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-ndr-csv.csv>`_
 225
 226 PDR Comparison
 227 ``````````````
 228
 229 Comparison tables in HTML, ASCII and CSV formats:
 230
 231   - `HTML 2t1c PDR comparison <performance-changes-2n-clx-cx556a-2t1c-pdr.html>`_
 232   - `HTML 4t2c PDR comparison <performance-changes-2n-clx-cx556a-4t2c-pdr.html>`_
 233   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr.txt>`_
 234   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-pdr.txt>`_
 235   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr-csv.csv>`_
 236   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-pdr-csv.csv>`_
 237
 238 MRR Comparison
 239 ``````````````
 240
 241 Comparison tables in HTML, ASCII and CSV formats:
 242
 243   - `HTML 2t1c MRR comparison <performance-changes-2n-clx-cx556a-2t1c-mrr.html>`_
 244   - `HTML 4t2c MRR comparison <performance-changes-2n-clx-cx556a-4t2c-mrr.html>`_
 245   - `HTML 8t4c MRR comparison <performance-changes-2n-clx-cx556a-8t4c-mrr.html>`_
 246   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-mrr.txt>`_
 247   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-mrr.txt>`_
 248   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-8t4c-mrr.txt>`_
 249   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-mrr-csv.csv>`_
 250   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-mrr-csv.csv>`_
 251   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-8t4c-mrr-csv.csv>`_
 252
 253 Latency Comparison
 254 ``````````````````
 255
 256 Comparison tables in HTML, ASCII and CSV formats:
 257
 258   - `HTML 2t1c PDR50, direction1, average value comparison <performance-changes-2n-clx-cx556a-2t1c-pdr50-d1-avg.html>`_
 259   - `HTML 2t1c PDR90, direction1, average value comparison <performance-changes-2n-clx-cx556a-2t1c-pdr90-d1-avg.html>`_
 260   - `HTML 2t1c PDR90, direction1, max value comparison <performance-changes-2n-clx-cx556a-2t1c-pdr90-d1-max.html>`_
 261   - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr50-d1-avg.txt>`_
 262   - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr90-d1-avg.txt>`_
 263   - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr90-d1-max.txt>`_
 264   - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr50-d1-avg-csv.csv>`_
 265   - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr90-d1-avg-csv.csv>`_
 266   - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr90-d1-max-csv.csv>`_
 267
 268 2n-zn2-xxv710
 269 ~~~~~~~~~~~~~
 270
 271 NDR Comparison
 272 ``````````````
 273
 274 Comparison tables in HTML, ASCII and CSV formats:
 275
 276   - `HTML 2t1c NDR comparison <performance-changes-2n-zn2-xxv710-2t1c-ndr.html>`_
 277   - `HTML 4t2c NDR comparison <performance-changes-2n-zn2-xxv710-4t2c-ndr.html>`_
 278   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-ndr.txt>`_
 279   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-ndr.txt>`_
 280   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-ndr-csv.csv>`_
 281   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-ndr-csv.csv>`_
 282
 283 PDR Comparison
 284 ``````````````
 285
 286 Comparison tables in HTML, ASCII and CSV formats:
 287
 288   - `HTML 2t1c PDR comparison <performance-changes-2n-zn2-xxv710-2t1c-pdr.html>`_
 289   - `HTML 4t2c PDR comparison <performance-changes-2n-zn2-xxv710-4t2c-pdr.html>`_
 290   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr.txt>`_
 291   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-pdr.txt>`_
 292   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr-csv.csv>`_
 293   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-pdr-csv.csv>`_
 294
 295 MRR Comparison
 296 ``````````````
 297
 298 Comparison tables in HTML, ASCII and CSV formats:
 299
 300   - `HTML 2t1c MRR comparison <performance-changes-2n-zn2-xxv710-2t1c-mrr.html>`_
 301   - `HTML 4t2c MRR comparison <performance-changes-2n-zn2-xxv710-4t2c-mrr.html>`_
 302   - `HTML 8t4c MRR comparison <performance-changes-2n-zn2-xxv710-8t4c-mrr.html>`_
 303   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-mrr.txt>`_
 304   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-mrr.txt>`_
 305   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-8t4c-mrr.txt>`_
 306   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-mrr-csv.csv>`_
 307   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-mrr-csv.csv>`_
 308   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-8t4c-mrr-csv.csv>`_
 309
 310 Latency Comparison
 311 ``````````````````
 312
 313 Comparison tables in HTML, ASCII and CSV formats:
 314
 315   - `HTML 2t1c PDR50, direction1, average value comparison <performance-changes-2n-zn2-xxv710-2t1c-pdr50-d1-avg.html>`_
 316   - `HTML 2t1c PDR90, direction1, average value comparison <performance-changes-2n-zn2-xxv710-2t1c-pdr90-d1-avg.html>`_
 317   - `HTML 2t1c PDR90, direction1, max value comparison <performance-changes-2n-zn2-xxv710-2t1c-pdr90-d1-max.html>`_
 318   - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr50-d1-avg.txt>`_
 319   - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr90-d1-avg.txt>`_
 320   - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr90-d1-max.txt>`_
 321   - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_
 322   - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_
 323   - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr90-d1-max-csv.csv>`_
 324
 325 2n-dnv
 326 ~~~~~~
 327
 328 NDR Comparison
 329 ``````````````
 330
 331 Comparison tables in HTML, ASCII and CSV formats:
 332
 333   - `HTML 1t1c NDR comparison <performance-changes-2n-dnv-1t1c-ndr.html>`_
 334   - `HTML 2t2c NDR comparison <performance-changes-2n-dnv-2t2c-ndr.html>`_
 335   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_
 336   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_
 337   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr-csv.csv>`_
 338   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr-csv.csv>`_
 339
 340 PDR Comparison
 341 ``````````````
 342
 343 Comparison tables in HTML, ASCII and CSV formats:
 344
 345   - `HTML 1t1c PDR comparison <performance-changes-2n-dnv-1t1c-pdr.html>`_
 346   - `HTML 2t2c PDR comparison <performance-changes-2n-dnv-2t2c-pdr.html>`_
 347   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_
 348   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_
 349   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr-csv.csv>`_
 350   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr-csv.csv>`_
 351
 352 MRR Comparison
 353 ``````````````
 354
 355 Comparison tables in HTML, ASCII and CSV formats:
 356
 357   - `HTML 1t1c MRR comparison <performance-changes-2n-dnv-1t1c-mrr.html>`_
 358   - `HTML 2t2c MRR comparison <performance-changes-2n-dnv-2t2c-mrr.html>`_
 359   - `HTML 4t4c MRR comparison <performance-changes-2n-dnv-4t4c-mrr.html>`_
 360   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_
 361   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_
 362   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_
 363   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr-csv.csv>`_
 364   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr-csv.csv>`_
 365   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr-csv.csv>`_
 366
 367 3n-dnv
 368 ~~~~~~
 369
 370 NDR Comparison
 371 ``````````````
 372
 373 Comparison tables in HTML, ASCII and CSV formats:
 374
 375   - `HTML 1t1c NDR comparison <performance-changes-3n-dnv-1t1c-ndr.html>`_
 376   - `HTML 2t2c NDR comparison <performance-changes-3n-dnv-2t2c-ndr.html>`_
 377   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr.txt>`_
 378   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr.txt>`_
 379   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr-csv.csv>`_
 380   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr-csv.csv>`_
 381
 382 PDR Comparison
 383 ``````````````
 384
 385 Comparison tables in HTML, ASCII and CSV formats:
 386
 387   - `HTML 1t1c PDR comparison <performance-changes-3n-dnv-1t1c-pdr.html>`_
 388   - `HTML 2t2c PDR comparison <performance-changes-3n-dnv-2t2c-pdr.html>`_
 389   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr.txt>`_
 390   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr.txt>`_
 391   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr-csv.csv>`_
 392   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr-csv.csv>`_
 393
 394 MRR Comparison
 395 ``````````````
 396
 397 Comparison tables in HTML, ASCII and CSV formats:
 398
 399   - `HTML 1t1c MRR comparison <performance-changes-3n-dnv-1t1c-mrr.html>`_
 400   - `HTML 2t2c MRR comparison <performance-changes-3n-dnv-2t2c-mrr.html>`_
 401   - `HTML 4t4c MRR comparison <performance-changes-3n-dnv-4t4c-mrr.html>`_
 402   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr.txt>`_
 403   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr.txt>`_
 404   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr.txt>`_
 405   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr-csv.csv>`_
 406   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr-csv.csv>`_
 407   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr-csv.csv>`_
 408
 409 3n-tsh
 410 ~~~~~~
 411
 412 NDR Comparison
 413 ``````````````
 414
 415 Comparison tables in HTML, ASCII and CSV formats:
 416
 417   - `HTML 1t1c NDR comparison <performance-changes-3n-tsh-1t1c-ndr.html>`_
 418   - `HTML 2t2c NDR comparison <performance-changes-3n-tsh-2t2c-ndr.html>`_
 419   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr.txt>`_
 420   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr.txt>`_
 421   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr-csv.csv>`_
 422   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr-csv.csv>`_
 423
 424 PDR Comparison
 425 ``````````````
 426
 427 Comparison tables in HTML, ASCII and CSV formats:
 428
 429   - `HTML 1t1c PDR comparison <performance-changes-3n-tsh-1t1c-pdr.html>`_
 430   - `HTML 2t2c PDR comparison <performance-changes-3n-tsh-2t2c-pdr.html>`_
 431   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr.txt>`_
 432   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr.txt>`_
 433   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr-csv.csv>`_
 434   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr-csv.csv>`_
 435
 436 MRR Comparison
 437 ``````````````
 438
 439 Comparison tables in HTML, ASCII and CSV formats:
 440
 441   - `HTML 1t1c MRR comparison <performance-changes-3n-tsh-1t1c-mrr.html>`_
 442   - `HTML 2t2c MRR comparison <performance-changes-3n-tsh-2t2c-mrr.html>`_
 443   - `HTML 4t4c MRR comparison <performance-changes-3n-tsh-4t4c-mrr.html>`_
 444   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr.txt>`_
 445   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr.txt>`_
 446   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr.txt>`_
 447   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr-csv.csv>`_
 448   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr-csv.csv>`_
 449   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr-csv.csv>`_
 450
 451 Latency Comparison
 452 ``````````````````
 453
 454 Comparison tables in HTML, ASCII and CSV formats:
 455
 456   - `HTML 1t1c PDR50, direction1, average value comparison <performance-changes-2n-tsh-x520-1t1c-pdr50-d1-avg.html>`_
 457   - `HTML 1t1c PDR90, direction1, average value comparison <performance-changes-2n-tsh-x520-1t1c-pdr90-d1-avg.html>`_
 458   - `HTML 1t1c PDR90, direction1, max value comparison <performance-changes-2n-tsh-x520-1t1c-pdr90-d1-max.html>`_
 459   - `ASCII 1t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tsh-x520-1t1c-pdr50-d1-avg.txt>`_
 460   - `ASCII 1t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tsh-x520-1t1c-pdr90-d1-avg.txt>`_
 461   - `ASCII 1t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-tsh-x520-1t1c-pdr90-d1-max.txt>`_
 462   - `CSV 1t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tsh-x520-1t1c-pdr50-d1-avg-csv.csv>`_
 463   - `CSV 1t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tsh-x520-1t1c-pdr90-d1-avg-csv.csv>`_
 464   - `CSV 1t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-tsh-x520-1t1c-pdr90-d1-max-csv.csv>`_
 465
 466 2n-tx2
 467 ~~~~~~
 468
 469 NDR Comparison
 470 ``````````````
 471
 472 Comparison tables in HTML, ASCII and CSV formats:
 473
 474   - `HTML 1t1c NDR comparison <performance-changes-2n-tx2-1t1c-ndr.html>`_
 475   - `HTML 2t2c NDR comparison <performance-changes-2n-tx2-2t2c-ndr.html>`_
 476   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-ndr.txt>`_
 477   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-ndr.txt>`_
 478   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-ndr-csv.csv>`_
 479   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-ndr-csv.csv>`_
 480
 481 PDR Comparison
 482 ``````````````
 483
 484 Comparison tables in HTML, ASCII and CSV formats:
 485
 486   - `HTML 1t1c PDR comparison <performance-changes-2n-tx2-1t1c-pdr.html>`_
 487   - `HTML 2t2c PDR comparison <performance-changes-2n-tx2-2t2c-pdr.html>`_
 488   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-pdr.txt>`_
 489   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-pdr.txt>`_
 490   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-pdr-csv.csv>`_
 491   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-pdr-csv.csv>`_
 492
 493 MRR Comparison
 494 ``````````````
 495
 496 Comparison tables in HTML, ASCII and CSV formats:
 497
 498   - `HTML 1t1c MRR comparison <performance-changes-2n-tx2-1t1c-mrr.html>`_
 499   - `HTML 2t2c MRR comparison <performance-changes-2n-tx2-2t2c-mrr.html>`_
 500   - `HTML 4t4c MRR comparison <performance-changes-2n-tx2-4t4c-mrr.html>`_
 501   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-mrr.txt>`_
 502   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-mrr.txt>`_
 503   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-4t4c-mrr.txt>`_
 504   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-mrr-csv.csv>`_
 505   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-mrr-csv.csv>`_
 506   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-4t4c-mrr-csv.csv>`_
 507
 508 Latency Comparison
 509 ``````````````````
 510
 511 Comparison tables in HTML, ASCII and CSV formats:
 512
 513   - `HTML 1t1c PDR50, direction1, average value comparison <performance-changes-2n-tx2-xl710-1t1c-pdr50-d1-avg.html>`_
 514   - `HTML 1t1c PDR90, direction1, average value comparison <performance-changes-2n-tx2-xl710-1t1c-pdr90-d1-avg.html>`_
 515   - `HTML 1t1c PDR90, direction1, max value comparison <performance-changes-2n-tx2-xl710-1t1c-pdr90-d1-max.html>`_
 516   - `ASCII 1t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tx2-xl710-1t1c-pdr50-d1-avg.txt>`_
 517   - `ASCII 1t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tx2-xl710-1t1c-pdr90-d1-avg.txt>`_
 518   - `ASCII 1t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-tx2-xl710-1t1c-pdr90-d1-max.txt>`_
 519   - `CSV 1t1c PDR50, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tx2-xl710-1t1c-pdr50-d1-avg-csv.csv>`_
 520   - `CSV 1t1c PDR90, direction1, average value comparison <../../_static/vpp/performance-changes-2n-tx2-xl710-1t1c-pdr90-d1-avg-csv.csv>`_
 521   - `CSV 1t1c PDR90, direction1, max value comparison <../../_static/vpp/performance-changes-2n-tx2-xl710-1t1c-pdr90-d1-max-csv.csv>`_