docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs. Previous Release
   5 ----------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 3-Node Intel Xeon Haswell testbeds (3n-hsw) in 1-core, 2-core
  11 and 4-core (MRR only) configurations.
  12
  13 Listed mean and standard deviation values are computed based on a series
  14 of the same tests executed against respective VPP releases to verify
  15 test results repeatability, with percentage change calculated for mean
  16 values. Note that the standard deviation is quite high for a small
  17 number of packet throughput tests, what indicates poor test results
  18 repeatability and makes the relative change of mean throughput value not
  19 fully representative for these tests. The root causes behind poor
  20 results repeatability vary between the test cases.
  21
  22 .. note::
  23
  24     Test results have been generated by
  25
  26     - `FD.io test executor vpp performance job 3n-hsw`_,
  27     - `FD.io test executor vpp performance job 3n-skx`_,
  28     - `FD.io test executor vpp performance job 2n-skx`_
  29
  30     with RF result files csit-vpp-perf-|srelease|-\*.zip
  31     `archived here <../../_static/archive/>`_.
  32
  33 ..
  34     3n-hsw
  35     ~~~~~~
  36
  37     NDR Comparison
  38     ``````````````
  39
  40     Comparison tables in ASCII and CSV formats:
  41
  42       - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.txt>`_
  43       - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.txt>`_
  44       - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.csv>`_
  45       - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.csv>`_
  46
  47     PDR Comparison
  48     ``````````````
  49
  50     Comparison tables in ASCII and CSV formats:
  51
  52       - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.txt>`_
  53       - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.txt>`_
  54       - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.csv>`_
  55       - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.csv>`_
  56
  57     MRR Comparison
  58     ``````````````
  59
  60     Comparison tables in ASCII and CSV formats:
  61
  62       - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_
  63       - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_
  64       - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_
  65       - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_
  66       - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_
  67       - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_
  68
  69 3n-skx
  70 ~~~~~~
  71
  72 NDR Comparison
  73 ``````````````
  74
  75 Comparison tables in ASCII and CSV formats:
  76
  77   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
  78   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
  79   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
  80   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_
  81
  82 PDR Comparison
  83 ``````````````
  84
  85 Comparison tables in ASCII and CSV formats:
  86
  87   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
  88   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
  89   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
  90   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_
  91
  92 ..
  93     MRR Comparison
  94     ``````````````
  95
  96     Comparison tables in ASCII and CSV formats:
  97
  98       - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
  99       - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
 100       - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
 101       - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_
 102       - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_
 103       - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_
 104
 105 ..
 106     2n-skx
 107     ~~~~~~
 108
 109     NDR Comparison
 110     ``````````````
 111
 112     Comparison tables in ASCII and CSV formats:
 113
 114       - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
 115       - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
 116       - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
 117       - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_
 118
 119     PDR Comparison
 120     ``````````````
 121
 122     Comparison tables in ASCII and CSV formats:
 123
 124       - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
 125       - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
 126       - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
 127       - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_
 128
 129     MRR Comparison
 130     ``````````````
 131
 132     Comparison tables in ASCII and CSV formats:
 133
 134       - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
 135       - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
 136       - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
 137       - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_
 138       - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_
 139       - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_