docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs. Previous Release
   5 ----------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 2-node Intel Xeon Skylake (2n-skx), 3-node Intel Xeon Skylake
  11 (3n-skx), 3-Node Intel Xeon Haswell (3n-hsw), 2-node Intel Atom Denverton
  12 (2n-dnv), 3-node Intel Atom Denverton (3n-dnv), 3-node Arm TaiShan (3n-tsh)
  13 testbeds, in 1-core, 2-core and 4-core (MRR only) configurations.
  14
  15 Listed mean and standard deviation values are computed based on a series
  16 of the same tests executed against respective VPP releases to verify
  17 test results repeatability, with percentage change calculated for mean
  18 values. Note that the standard deviation is quite high for a small
  19 number of packet throughput tests, what indicates poor test results
  20 repeatability and makes the relative change of mean throughput value not
  21 fully representative for these tests. The root causes behind poor
  22 results repeatability vary between the test cases.
  23
  24 .. note::
  25
  26     Test results have been generated by
  27
  28     - `FD.io test executor vpp performance job 2n-skx`_,
  29     - `FD.io test executor vpp performance job 3n-skx`_,
  30     - `FD.io test executor vpp performance job 3n-hsw`_,
  31     - `FD.io test executor vpp performance job 2n-dnv`_,
  32     - `FD.io test executor vpp performance job 3n-dnv`_,
  33     - `FD.io test executor vpp performance job 3n-tsh`_
  34
  35     with RF result files csit-vpp-perf-|srelease|-\*.zip
  36     `archived here <../../_static/archive/>`_.
  37
  38 2n-skx
  39 ~~~~~~
  40
  41 NDR Root Cause Analysis
  42 ```````````````````````
  43
  44   - `HTML 2t1c NDR RCA <performance-rca-2n-skx-2t1c-ndr.html>`_
  45   - `ASCII 2t1c NDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-ndr.txt>`_
  46   - `CSV 2t1c NDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-ndr-csv.csv>`_
  47
  48 PDR Root Cause Analysis
  49 ```````````````````````
  50
  51   - `HTML 2t1c PDR RCA <performance-rca-2n-skx-2t1c-pdr.html>`_
  52   - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr.txt>`_
  53   - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr-csv.csv>`_
  54
  55 ..
  56     NDR Comparison
  57     ``````````````
  58
  59     Comparison tables in HTML, ASCII and CSV formats:
  60
  61       - `HTML 2t1c NDR comparison <performance-changes-2n-skx-2t1c-ndr.html>`_
  62       - `HTML 4t2c NDR comparison <performance-changes-2n-skx-4t2c-ndr.html>`_
  63       - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
  64       - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
  65       - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
  66       - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_
  67
  68       - `HTML 2t1c NFV Service Density NDR comparison <performance-changes-nfv-2n-skx-2t1c-ndr.html>`_
  69       - `HTML 4t2c NFV Service Density NDR comparison <performance-changes-nfv-2n-skx-4t2c-ndr.html>`_
  70       - `HTML 8t4c NFV Service Density NDR comparison <performance-changes-nfv-2n-skx-8t4c-ndr.html>`_
  71       - `ASCII 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.txt>`_
  72       - `ASCII 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.txt>`_
  73       - `ASCII 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.txt>`_
  74       - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.csv>`_
  75       - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.csv>`_
  76       - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.csv>`_
  77
  78     PDR Comparison
  79     ``````````````
  80
  81     Comparison tables in HTML, ASCII and CSV formats:
  82
  83       - `HTML 2t1c PDR comparison <performance-changes-2n-skx-2t1c-pdr.html>`_
  84       - `HTML 4t2c PDR comparison <performance-changes-2n-skx-4t2c-pdr.html>`_
  85       - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
  86       - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
  87       - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
  88       - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_
  89
  90
  91       - `HTML 2t1c NFV Service Density PDR comparison <performance-changes-nfv-2n-skx-2t1c-pdr.html>`_
  92       - `HTML 4t2c NFV Service Density PDR comparison <performance-changes-nfv-2n-skx-4t2c-pdr.html>`_
  93       - `HTML 8t4c NFV Service Density PDR comparison <performance-changes-nfv-2n-skx-8t4c-pdr.html>`_
  94       - `ASCII 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-pdr.txt>`_
  95       - `ASCII 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-pdr.txt>`_
  96       - `ASCII 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-pdr.txt>`_
  97       - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-pdr.csv>`_
  98       - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-pdr.csv>`_
  99       - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-pdr.csv>`_
 100
 101     MRR Comparison
 102     ``````````````
 103
 104     Comparison tables in HTML, ASCII and CSV formats:
 105
 106       - `HTML 2t1c MRR comparison <performance-changes-2n-skx-2t1c-mrr.html>`_
 107       - `HTML 4t2c MRR comparison <performance-changes-2n-skx-4t2c-mrr.html>`_
 108       - `HTML 8t4c MRR comparison <performance-changes-2n-skx-8t4c-mrr.html>`_
 109       - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
 110       - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
 111       - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
 112       - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_
 113       - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_
 114       - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_
 115
 116       - `HTML 2t1c NFV Service Density MRR comparison <performance-changes-nfv-2n-skx-2t1c-mrr.html>`_
 117       - `HTML 4t2c NFV Service Density MRR comparison <performance-changes-nfv-2n-skx-4t2c-mrr.html>`_
 118       - `HTML 8t4c NFV Service Density MRR comparison <performance-changes-nfv-2n-skx-8t4c-mrr.html>`_
 119       - `ASCII 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-mrr.txt>`_
 120       - `ASCII 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-mrr.txt>`_
 121       - `ASCII 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-mrr.txt>`_
 122       - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-mrr.csv>`_
 123       - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-mrr.csv>`_
 124       - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-mrr.csv>`_
 125
 126 3n-skx
 127 ~~~~~~
 128
 129 NDR Root Cause Analysis
 130 ```````````````````````
 131
 132   - `HTML 2t1c NDR RCA <performance-rca-3n-skx-2t1c-ndr.html>`_
 133   - `ASCII 2t1c NDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-ndr.txt>`_
 134   - `CSV 2t1c NDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-ndr-csv.csv>`_
 135
 136 PDR Root Cause Analysis
 137 ```````````````````````
 138
 139   - `HTML 2t1c PDR RCA <performance-rca-3n-skx-2t1c-pdr.html>`_
 140   - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr.txt>`_
 141   - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr-csv.csv>`_
 142
 143 ..
 144     NDR Comparison
 145     ``````````````
 146
 147     Comparison tables in HTML, ASCII and CSV formats:
 148
 149       - `HTML 2t1c NDR comparison <performance-changes-3n-skx-2t1c-ndr.html>`_
 150       - `HTML 4t2c NDR comparison <performance-changes-3n-skx-4t2c-ndr.html>`_
 151       - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
 152       - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
 153       - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
 154       - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_
 155
 156     PDR Comparison
 157     ``````````````
 158
 159     Comparison tables in HTML, ASCII and CSV formats:
 160
 161       - `HTML 2t1c PDR comparison <performance-changes-3n-skx-2t1c-pdr.html>`_
 162       - `HTML 4t2c PDR comparison <performance-changes-3n-skx-4t2c-pdr.html>`_
 163       - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
 164       - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
 165       - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
 166       - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_
 167
 168     MRR Comparison
 169     ``````````````
 170
 171     Comparison tables in HTML, ASCII and CSV formats:
 172
 173       - `HTML 2t1c MRR comparison <performance-changes-3n-skx-2t1c-mrr.html>`_
 174       - `HTML 4t2c MRR comparison <performance-changes-3n-skx-4t2c-mrr.html>`_
 175       - `HTML 8t4c MRR comparison <performance-changes-3n-skx-8t4c-mrr.html>`_
 176       - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
 177       - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
 178       - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
 179       - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_
 180       - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_
 181       - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_
 182
 183 3n-hsw
 184 ~~~~~~
 185
 186 NDR Comparison
 187 ``````````````
 188
 189 Comparison tables in HTML, ASCII and CSV formats:
 190
 191   - `HTML 1t1c NDR comparison <performance-changes-3n-hsw-1t1c-ndr.html>`_
 192   - `HTML 2t2c NDR comparison <performance-changes-3n-hsw-2t2c-ndr.html>`_
 193   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.txt>`_
 194   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.txt>`_
 195   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.csv>`_
 196   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.csv>`_
 197
 198 PDR Comparison
 199 ``````````````
 200
 201 Comparison tables in HTML, ASCII and CSV formats:
 202
 203   - `HTML 1t1c PDR comparison <performance-changes-3n-hsw-1t1c-pdr.html>`_
 204   - `HTML 2t2c PDR comparison <performance-changes-3n-hsw-2t2c-pdr.html>`_
 205   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.txt>`_
 206   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.txt>`_
 207   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.csv>`_
 208   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.csv>`_
 209
 210 MRR Comparison
 211 ``````````````
 212
 213 Comparison tables in HTML, ASCII and CSV formats:
 214
 215   - `HTML 1t1c MRR comparison <performance-changes-3n-hsw-1t1c-mrr.html>`_
 216   - `HTML 2t2c MRR comparison <performance-changes-3n-hsw-2t2c-mrr.html>`_
 217   - `HTML 4t4c MRR comparison <performance-changes-3n-hsw-4t4c-mrr.html>`_
 218   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_
 219   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_
 220   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_
 221   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_
 222   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_
 223   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_
 224
 225 2n-dnv
 226 ~~~~~~
 227
 228 NDR Comparison
 229 ``````````````
 230
 231 Comparison tables in HTML, ASCII and CSV formats:
 232
 233   - `HTML 1t1c NDR comparison <performance-changes-2n-dnv-1t1c-ndr.html>`_
 234   - `HTML 2t2c NDR comparison <performance-changes-2n-dnv-2t2c-ndr.html>`_
 235   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_
 236   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_
 237   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.csv>`_
 238   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.csv>`_
 239
 240 PDR Comparison
 241 ``````````````
 242
 243 Comparison tables in HTML, ASCII and CSV formats:
 244
 245   - `HTML 1t1c PDR comparison <performance-changes-2n-dnv-1t1c-pdr.html>`_
 246   - `HTML 2t2c PDR comparison <performance-changes-2n-dnv-2t2c-pdr.html>`_
 247   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_
 248   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_
 249   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.csv>`_
 250   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.csv>`_
 251
 252 MRR Comparison
 253 ``````````````
 254
 255 Comparison tables in HTML, ASCII and CSV formats:
 256
 257   - `HTML 1t1c MRR comparison <performance-changes-2n-dnv-1t1c-mrr.html>`_
 258   - `HTML 2t2c MRR comparison <performance-changes-2n-dnv-2t2c-mrr.html>`_
 259   - `HTML 4t4c MRR comparison <performance-changes-2n-dnv-4t4c-mrr.html>`_
 260   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_
 261   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_
 262   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_
 263   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.csv>`_
 264   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.csv>`_
 265   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.csv>`_
 266
 267 3n-dnv
 268 ~~~~~~
 269
 270 NDR Comparison
 271 ``````````````
 272
 273 Comparison tables in HTML, ASCII and CSV formats:
 274
 275   - `HTML 1t1c NDR comparison <performance-changes-3n-dnv-1t1c-ndr.html>`_
 276   - `HTML 2t2c NDR comparison <performance-changes-3n-dnv-2t2c-ndr.html>`_
 277   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr.txt>`_
 278   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr.txt>`_
 279   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr.csv>`_
 280   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr.csv>`_
 281
 282 PDR Comparison
 283 ``````````````
 284
 285 Comparison tables in HTML, ASCII and CSV formats:
 286
 287   - `HTML 1t1c PDR comparison <performance-changes-3n-dnv-1t1c-pdr.html>`_
 288   - `HTML 2t2c PDR comparison <performance-changes-3n-dnv-2t2c-pdr.html>`_
 289   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr.txt>`_
 290   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr.txt>`_
 291   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr.csv>`_
 292   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr.csv>`_
 293
 294 MRR Comparison
 295 ``````````````
 296
 297 Comparison tables in HTML, ASCII and CSV formats:
 298
 299   - `HTML 1t1c MRR comparison <performance-changes-3n-dnv-1t1c-mrr.html>`_
 300   - `HTML 2t2c MRR comparison <performance-changes-3n-dnv-2t2c-mrr.html>`_
 301   - `HTML 4t4c MRR comparison <performance-changes-3n-dnv-4t4c-mrr.html>`_
 302   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr.txt>`_
 303   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr.txt>`_
 304   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr.txt>`_
 305   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr.csv>`_
 306   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr.csv>`_
 307   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr.csv>`_
 308
 309 3n-tsh
 310 ~~~~~~
 311
 312 NDR Comparison
 313 ``````````````
 314
 315 Comparison tables in HTML, ASCII and CSV formats:
 316
 317   - `HTML 1t1c NDR comparison <performance-changes-3n-tsh-1t1c-ndr.html>`_
 318   - `HTML 2t2c NDR comparison <performance-changes-3n-tsh-2t2c-ndr.html>`_
 319   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr.txt>`_
 320   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr.txt>`_
 321   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr.csv>`_
 322   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr.csv>`_
 323
 324 PDR Comparison
 325 ``````````````
 326
 327 Comparison tables in HTML, ASCII and CSV formats:
 328
 329   - `HTML 1t1c PDR comparison <performance-changes-3n-tsh-1t1c-pdr.html>`_
 330   - `HTML 2t2c PDR comparison <performance-changes-3n-tsh-2t2c-pdr.html>`_
 331   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr.txt>`_
 332   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr.txt>`_
 333   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr.csv>`_
 334   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr.csv>`_
 335
 336 MRR Comparison
 337 ``````````````
 338
 339 Comparison tables in HTML, ASCII and CSV formats:
 340
 341   - `HTML 1t1c MRR comparison <performance-changes-3n-tsh-1t1c-mrr.html>`_
 342   - `HTML 2t2c MRR comparison <performance-changes-3n-tsh-2t2c-mrr.html>`_
 343   - `HTML 4t4c MRR comparison <performance-changes-3n-tsh-4t4c-mrr.html>`_
 344   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr.txt>`_
 345   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr.txt>`_
 346   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr.txt>`_
 347   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr.csv>`_
 348   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr.csv>`_
 349   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr.csv>`_