docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs Previous Release
   5 ---------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 2-node Intel Xeon Skylake (2n-skx), 3-node Intel Xeon Skylake
  11 (3n-skx), 2-node Intel Atom Denverton
  12 (2n-dnv), 3-node Intel Atom Denverton (3n-dnv), 3-node Arm TaiShan (3n-tsh)
  13 testbeds, in 1-core, 2-core and 4-core (MRR only) configurations.
  14
  15 Listed mean and standard deviation values are computed based on a series
  16 of the same tests executed against respective VPP releases to verify
  17 test results repeatability, with percentage change calculated for mean
  18 values. Note that the standard deviation is quite high for a small
  19 number of packet throughput tests, what indicates poor test results
  20 repeatability and makes the relative change of mean throughput value not
  21 fully representative for these tests. The root causes behind poor
  22 results repeatability vary between the test cases.
  23
  24 .. note::
  25
  26     Test results are stored in
  27
  28     - `build logs from FD.io vpp performance job 2n-skx`_,
  29     - `build logs from FD.io vpp performance job 3n-skx`_,
  30     - `build logs from FD.io vpp performance job 2n-clx`_,
  31     - `build logs from FD.io vpp performance job 2n-zn2`_,
  32     - `build logs from FD.io vpp performance job 2n-dnv`_,
  33     - `build logs from FD.io vpp performance job 3n-dnv`_,
  34     - `build logs from FD.io vpp performance job 3n-tsh`_,
  35     - `build logs from FD.io vpp performance job 2n-tx2`_
  36
  37     with RF result files csit-vpp-perf-|srelease|-\*.zip
  38     `archived here <../../_static/archive/>`_.
  39
  40 2n-skx
  41 ~~~~~~
  42
  43 NDR Comparison
  44 ``````````````
  45
  46 Comparison tables in HTML, ASCII and CSV formats:
  47
  48   - `HTML 2t1c NDR comparison <performance-changes-2n-skx-2t1c-ndr.html>`_
  49   - `HTML 4t2c NDR comparison <performance-changes-2n-skx-4t2c-ndr.html>`_
  50   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
  51   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
  52   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr-csv.csv>`_
  53   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr-csv.csv>`_
  54
  55 PDR Comparison
  56 ``````````````
  57
  58 Comparison tables in HTML, ASCII and CSV formats:
  59
  60   - `HTML 2t1c PDR comparison <performance-changes-2n-skx-2t1c-pdr.html>`_
  61   - `HTML 4t2c PDR comparison <performance-changes-2n-skx-4t2c-pdr.html>`_
  62   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
  63   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
  64   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr-csv.csv>`_
  65   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr-csv.csv>`_
  66
  67 MRR Comparison
  68 ``````````````
  69
  70 Comparison tables in HTML, ASCII and CSV formats:
  71
  72   - `HTML 2t1c MRR comparison <performance-changes-2n-skx-2t1c-mrr.html>`_
  73   - `HTML 4t2c MRR comparison <performance-changes-2n-skx-4t2c-mrr.html>`_
  74   - `HTML 8t4c MRR comparison <performance-changes-2n-skx-8t4c-mrr.html>`_
  75   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
  76   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
  77   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
  78   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr-csv.csv>`_
  79   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr-csv.csv>`_
  80   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr-csv.csv>`_
  81
  82 3n-skx
  83 ~~~~~~
  84
  85 NDR Comparison
  86 ``````````````
  87
  88 Comparison tables in HTML, ASCII and CSV formats:
  89
  90   - `HTML 2t1c NDR comparison <performance-changes-3n-skx-2t1c-ndr.html>`_
  91   - `HTML 4t2c NDR comparison <performance-changes-3n-skx-4t2c-ndr.html>`_
  92   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
  93   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
  94   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr-csv.csv>`_
  95   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr-csv.csv>`_
  96
  97 PDR Comparison
  98 ``````````````
  99
 100 Comparison tables in HTML, ASCII and CSV formats:
 101
 102   - `HTML 2t1c PDR comparison <performance-changes-3n-skx-2t1c-pdr.html>`_
 103   - `HTML 4t2c PDR comparison <performance-changes-3n-skx-4t2c-pdr.html>`_
 104   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
 105   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
 106   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr-csv.csv>`_
 107   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr-csv.csv>`_
 108
 109 MRR Comparison
 110 ``````````````
 111
 112 Comparison tables in HTML, ASCII and CSV formats:
 113
 114   - `HTML 2t1c MRR comparison <performance-changes-3n-skx-2t1c-mrr.html>`_
 115   - `HTML 4t2c MRR comparison <performance-changes-3n-skx-4t2c-mrr.html>`_
 116   - `HTML 8t4c MRR comparison <performance-changes-3n-skx-8t4c-mrr.html>`_
 117   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
 118   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
 119   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
 120   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr-csv.csv>`_
 121   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr-csv.csv>`_
 122   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr-csv.csv>`_
 123
 124 2n-clx-xxv710
 125 ~~~~~~~~~~~~~
 126
 127 NDR Comparison
 128 ``````````````
 129
 130 Comparison tables in HTML, ASCII and CSV formats:
 131
 132   - `HTML 2t1c NDR comparison <performance-changes-2n-clx-xxv710-2t1c-ndr.html>`_
 133   - `HTML 4t2c NDR comparison <performance-changes-2n-clx-xxv710-4t2c-ndr.html>`_
 134   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr.txt>`_
 135   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr.txt>`_
 136   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr-csv.csv>`_
 137   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr-csv.csv>`_
 138
 139 PDR Comparison
 140 ``````````````
 141
 142 Comparison tables in HTML, ASCII and CSV formats:
 143
 144   - `HTML 2t1c PDR comparison <performance-changes-2n-clx-xxv710-2t1c-pdr.html>`_
 145   - `HTML 4t2c PDR comparison <performance-changes-2n-clx-xxv710-4t2c-pdr.html>`_
 146   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr.txt>`_
 147   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr.txt>`_
 148   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr-csv.csv>`_
 149   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr-csv.csv>`_
 150
 151 MRR Comparison
 152 ``````````````
 153
 154 Comparison tables in HTML, ASCII and CSV formats:
 155
 156   - `HTML 2t1c MRR comparison <performance-changes-2n-clx-xxv710-2t1c-mrr.html>`_
 157   - `HTML 4t2c MRR comparison <performance-changes-2n-clx-xxv710-4t2c-mrr.html>`_
 158   - `HTML 8t4c MRR comparison <performance-changes-2n-clx-xxv710-8t4c-mrr.html>`_
 159   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr.txt>`_
 160   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr.txt>`_
 161   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr.txt>`_
 162   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr-csv.csv>`_
 163   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr-csv.csv>`_
 164   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr-csv.csv>`_
 165
 166 2n-clx-cx556a
 167 ~~~~~~~~~~~~~
 168
 169 NDR Comparison
 170 ``````````````
 171
 172 Comparison tables in HTML, ASCII and CSV formats:
 173
 174   - `HTML 2t1c NDR comparison <performance-changes-2n-clx-cx556a-2t1c-ndr.html>`_
 175   - `HTML 4t2c NDR comparison <performance-changes-2n-clx-cx556a-4t2c-ndr.html>`_
 176   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-ndr.txt>`_
 177   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-ndr.txt>`_
 178   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-ndr-csv.csv>`_
 179   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-ndr-csv.csv>`_
 180
 181 PDR Comparison
 182 ``````````````
 183
 184 Comparison tables in HTML, ASCII and CSV formats:
 185
 186   - `HTML 2t1c PDR comparison <performance-changes-2n-clx-cx556a-2t1c-pdr.html>`_
 187   - `HTML 4t2c PDR comparison <performance-changes-2n-clx-cx556a-4t2c-pdr.html>`_
 188   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr.txt>`_
 189   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-pdr.txt>`_
 190   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-pdr-csv.csv>`_
 191   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-pdr-csv.csv>`_
 192
 193 MRR Comparison
 194 ``````````````
 195
 196 Comparison tables in HTML, ASCII and CSV formats:
 197
 198   - `HTML 2t1c MRR comparison <performance-changes-2n-clx-cx556a-2t1c-mrr.html>`_
 199   - `HTML 4t2c MRR comparison <performance-changes-2n-clx-cx556a-4t2c-mrr.html>`_
 200   - `HTML 8t4c MRR comparison <performance-changes-2n-clx-cx556a-8t4c-mrr.html>`_
 201   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-mrr.txt>`_
 202   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-mrr.txt>`_
 203   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-8t4c-mrr.txt>`_
 204   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-2t1c-mrr-csv.csv>`_
 205   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-4t2c-mrr-csv.csv>`_
 206   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-cx556a-8t4c-mrr-csv.csv>`_
 207
 208 2n-zn2-xxv710
 209 ~~~~~~~~~~~~~
 210
 211 NDR Comparison
 212 ``````````````
 213
 214 Comparison tables in HTML, ASCII and CSV formats:
 215
 216   - `HTML 2t1c NDR comparison <performance-changes-2n-zn2-xxv710-2t1c-ndr.html>`_
 217   - `HTML 4t2c NDR comparison <performance-changes-2n-zn2-xxv710-4t2c-ndr.html>`_
 218   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-ndr.txt>`_
 219   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-ndr.txt>`_
 220   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-ndr-csv.csv>`_
 221   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-ndr-csv.csv>`_
 222
 223 PDR Comparison
 224 ``````````````
 225
 226 Comparison tables in HTML, ASCII and CSV formats:
 227
 228   - `HTML 2t1c PDR comparison <performance-changes-2n-zn2-xxv710-2t1c-pdr.html>`_
 229   - `HTML 4t2c PDR comparison <performance-changes-2n-zn2-xxv710-4t2c-pdr.html>`_
 230   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr.txt>`_
 231   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-pdr.txt>`_
 232   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-pdr-csv.csv>`_
 233   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-pdr-csv.csv>`_
 234
 235 MRR Comparison
 236 ``````````````
 237
 238 Comparison tables in HTML, ASCII and CSV formats:
 239
 240   - `HTML 2t1c MRR comparison <performance-changes-2n-zn2-xxv710-2t1c-mrr.html>`_
 241   - `HTML 4t2c MRR comparison <performance-changes-2n-zn2-xxv710-4t2c-mrr.html>`_
 242   - `HTML 8t4c MRR comparison <performance-changes-2n-zn2-xxv710-8t4c-mrr.html>`_
 243   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-mrr.txt>`_
 244   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-mrr.txt>`_
 245   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-8t4c-mrr.txt>`_
 246   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-2t1c-mrr-csv.csv>`_
 247   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-4t2c-mrr-csv.csv>`_
 248   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-zn2-xxv710-8t4c-mrr-csv.csv>`_
 249
 250 2n-dnv
 251 ~~~~~~
 252
 253 NDR Comparison
 254 ``````````````
 255
 256 Comparison tables in HTML, ASCII and CSV formats:
 257
 258   - `HTML 1t1c NDR comparison <performance-changes-2n-dnv-1t1c-ndr.html>`_
 259   - `HTML 2t2c NDR comparison <performance-changes-2n-dnv-2t2c-ndr.html>`_
 260   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_
 261   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_
 262   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr-csv.csv>`_
 263   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr-csv.csv>`_
 264
 265 PDR Comparison
 266 ``````````````
 267
 268 Comparison tables in HTML, ASCII and CSV formats:
 269
 270   - `HTML 1t1c PDR comparison <performance-changes-2n-dnv-1t1c-pdr.html>`_
 271   - `HTML 2t2c PDR comparison <performance-changes-2n-dnv-2t2c-pdr.html>`_
 272   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_
 273   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_
 274   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr-csv.csv>`_
 275   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr-csv.csv>`_
 276
 277 MRR Comparison
 278 ``````````````
 279
 280 Comparison tables in HTML, ASCII and CSV formats:
 281
 282   - `HTML 1t1c MRR comparison <performance-changes-2n-dnv-1t1c-mrr.html>`_
 283   - `HTML 2t2c MRR comparison <performance-changes-2n-dnv-2t2c-mrr.html>`_
 284   - `HTML 4t4c MRR comparison <performance-changes-2n-dnv-4t4c-mrr.html>`_
 285   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_
 286   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_
 287   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_
 288   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr-csv.csv>`_
 289   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr-csv.csv>`_
 290   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr-csv.csv>`_
 291
 292 3n-dnv
 293 ~~~~~~
 294
 295 NDR Comparison
 296 ``````````````
 297
 298 Comparison tables in HTML, ASCII and CSV formats:
 299
 300   - `HTML 1t1c NDR comparison <performance-changes-3n-dnv-1t1c-ndr.html>`_
 301   - `HTML 2t2c NDR comparison <performance-changes-3n-dnv-2t2c-ndr.html>`_
 302   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr.txt>`_
 303   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr.txt>`_
 304   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr-csv.csv>`_
 305   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr-csv.csv>`_
 306
 307 PDR Comparison
 308 ``````````````
 309
 310 Comparison tables in HTML, ASCII and CSV formats:
 311
 312   - `HTML 1t1c PDR comparison <performance-changes-3n-dnv-1t1c-pdr.html>`_
 313   - `HTML 2t2c PDR comparison <performance-changes-3n-dnv-2t2c-pdr.html>`_
 314   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr.txt>`_
 315   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr.txt>`_
 316   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr-csv.csv>`_
 317   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr-csv.csv>`_
 318
 319 MRR Comparison
 320 ``````````````
 321
 322 Comparison tables in HTML, ASCII and CSV formats:
 323
 324   - `HTML 1t1c MRR comparison <performance-changes-3n-dnv-1t1c-mrr.html>`_
 325   - `HTML 2t2c MRR comparison <performance-changes-3n-dnv-2t2c-mrr.html>`_
 326   - `HTML 4t4c MRR comparison <performance-changes-3n-dnv-4t4c-mrr.html>`_
 327   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr.txt>`_
 328   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr.txt>`_
 329   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr.txt>`_
 330   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr-csv.csv>`_
 331   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr-csv.csv>`_
 332   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr-csv.csv>`_
 333
 334 3n-tsh
 335 ~~~~~~
 336
 337 NDR Comparison
 338 ``````````````
 339
 340 Comparison tables in HTML, ASCII and CSV formats:
 341
 342   - `HTML 1t1c NDR comparison <performance-changes-3n-tsh-1t1c-ndr.html>`_
 343   - `HTML 2t2c NDR comparison <performance-changes-3n-tsh-2t2c-ndr.html>`_
 344   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr.txt>`_
 345   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr.txt>`_
 346   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr-csv.csv>`_
 347   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr-csv.csv>`_
 348
 349 PDR Comparison
 350 ``````````````
 351
 352 Comparison tables in HTML, ASCII and CSV formats:
 353
 354   - `HTML 1t1c PDR comparison <performance-changes-3n-tsh-1t1c-pdr.html>`_
 355   - `HTML 2t2c PDR comparison <performance-changes-3n-tsh-2t2c-pdr.html>`_
 356   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr.txt>`_
 357   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr.txt>`_
 358   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr-csv.csv>`_
 359   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr-csv.csv>`_
 360
 361 MRR Comparison
 362 ``````````````
 363
 364 Comparison tables in HTML, ASCII and CSV formats:
 365
 366   - `HTML 1t1c MRR comparison <performance-changes-3n-tsh-1t1c-mrr.html>`_
 367   - `HTML 2t2c MRR comparison <performance-changes-3n-tsh-2t2c-mrr.html>`_
 368   - `HTML 4t4c MRR comparison <performance-changes-3n-tsh-4t4c-mrr.html>`_
 369   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr.txt>`_
 370   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr.txt>`_
 371   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr.txt>`_
 372   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr-csv.csv>`_
 373   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr-csv.csv>`_
 374   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr-csv.csv>`_
 375
 376
 377 2n-tx2
 378 ~~~~~~
 379
 380 NDR Comparison
 381 ``````````````
 382
 383 Comparison tables in HTML, ASCII and CSV formats:
 384
 385   - `HTML 1t1c NDR comparison <performance-changes-2n-tx2-1t1c-ndr.html>`_
 386   - `HTML 2t2c NDR comparison <performance-changes-2n-tx2-2t2c-ndr.html>`_
 387   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-ndr.txt>`_
 388   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-ndr.txt>`_
 389   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-ndr-csv.csv>`_
 390   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-ndr-csv.csv>`_
 391
 392 PDR Comparison
 393 ``````````````
 394
 395 Comparison tables in HTML, ASCII and CSV formats:
 396
 397   - `HTML 1t1c PDR comparison <performance-changes-2n-tx2-1t1c-pdr.html>`_
 398   - `HTML 2t2c PDR comparison <performance-changes-2n-tx2-2t2c-pdr.html>`_
 399   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-pdr.txt>`_
 400   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-pdr.txt>`_
 401   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-pdr-csv.csv>`_
 402   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-pdr-csv.csv>`_
 403
 404 MRR Comparison
 405 ``````````````
 406
 407 Comparison tables in HTML, ASCII and CSV formats:
 408
 409   - `HTML 1t1c MRR comparison <performance-changes-2n-tx2-1t1c-mrr.html>`_
 410   - `HTML 2t2c MRR comparison <performance-changes-2n-tx2-2t2c-mrr.html>`_
 411   - `HTML 4t4c MRR comparison <performance-changes-2n-tx2-4t4c-mrr.html>`_
 412   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-mrr.txt>`_
 413   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-mrr.txt>`_
 414   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-4t4c-mrr.txt>`_
 415   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-1t1c-mrr-csv.csv>`_
 416   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-2t2c-mrr-csv.csv>`_
 417   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-tx2-4t4c-mrr-csv.csv>`_