docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs. Previous Release
   5 ----------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 3-Node Intel Xeon Haswell testbeds (3n-hsw) in 1-core, 2-core
  11 and 4-core (MRR only) configurations.
  12
  13 Listed mean and standard deviation values are computed based on a series
  14 of the same tests executed against respective VPP releases to verify
  15 test results repeatability, with percentage change calculated for mean
  16 values. Note that the standard deviation is quite high for a small
  17 number of packet throughput tests, what indicates poor test results
  18 repeatability and makes the relative change of mean throughput value not
  19 fully representative for these tests. The root causes behind poor
  20 results repeatability vary between the test cases.
  21
  22 .. note::
  23
  24     Test results have been generated by
  25
  26     - `FD.io test executor vpp performance job 3n-hsw`_,
  27     - `FD.io test executor vpp performance job 3n-skx`_,
  28     - `FD.io test executor vpp performance job 2n-skx`_
  29
  30     with RF result files csit-vpp-perf-|srelease|-\*.zip
  31     `archived here <../../_static/archive/>`_.
  32
  33 3n-hsw
  34 ~~~~~~
  35
  36 NDR Comparison
  37 ``````````````
  38
  39 Comparison tables in ASCII and CSV formats:
  40
  41   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.txt>`_
  42   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.txt>`_
  43   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.csv>`_
  44   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.csv>`_
  45
  46 PDR Comparison
  47 ``````````````
  48
  49 Comparison tables in ASCII and CSV formats:
  50
  51   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.txt>`_
  52   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.txt>`_
  53   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.csv>`_
  54   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.csv>`_
  55
  56 MRR Comparison
  57 ``````````````
  58
  59 Comparison tables in ASCII and CSV formats:
  60
  61   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_
  62   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_
  63   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_
  64   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_
  65   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_
  66   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_
  67
  68 3n-skx
  69 ~~~~~~
  70
  71 NDR Comparison
  72 ``````````````
  73
  74 Comparison tables in ASCII and CSV formats:
  75
  76   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
  77   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
  78   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
  79   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_
  80
  81 PDR Comparison
  82 ``````````````
  83
  84 Comparison tables in ASCII and CSV formats:
  85
  86   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
  87   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
  88   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
  89   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_
  90
  91 MRR Comparison
  92 ``````````````
  93
  94 Comparison tables in ASCII and CSV formats:
  95
  96   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
  97   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
  98   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
  99   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_
 100   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_
 101   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_
 102
 103 2n-skx
 104 ~~~~~~
 105
 106 NDR Comparison
 107 ``````````````
 108
 109 Comparison tables in ASCII and CSV formats:
 110
 111   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
 112   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
 113   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
 114   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_
 115
 116 PDR Comparison
 117 ``````````````
 118
 119 Comparison tables in ASCII and CSV formats:
 120
 121   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
 122   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
 123   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
 124   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_
 125
 126 MRR Comparison
 127 ``````````````
 128
 129 Comparison tables in ASCII and CSV formats:
 130
 131   - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
 132   - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
 133   - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
 134   - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_
 135   - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_
 136   - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_
 137
 138 2n-dnv
 139 ~~~~~~
 140
 141 NDR Comparison
 142 ``````````````
 143
 144 Comparison tables in ASCII and CSV formats:
 145
 146   - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_
 147   - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_
 148   - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.csv>`_
 149   - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.csv>`_
 150
 151 PDR Comparison
 152 ``````````````
 153
 154 Comparison tables in ASCII and CSV formats:
 155
 156   - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_
 157   - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_
 158   - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.csv>`_
 159   - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.csv>`_
 160
 161 MRR Comparison
 162 ``````````````
 163
 164 Comparison tables in ASCII and CSV formats:
 165
 166   - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_
 167   - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_
 168   - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_
 169   - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.csv>`_
 170   - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.csv>`_
 171   - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.csv>`_