docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs. Previous Release
   5 ----------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 3-Node Intel Xeon Haswell testbeds (3n-hsw) in 1-core, 2-core
  11 and 4-core (MRR only) configurations.
  12
  13 Listed mean and standard deviation values are computed based on a series
  14 of the same tests executed against respective VPP releases to verify
  15 test results repeatability, with percentage change calculated for mean
  16 values. Note that the standard deviation is quite high for a small
  17 number of packet throughput tests, what indicates poor test results
  18 repeatability and makes the relative change of mean throughput value not
  19 fully representative for these tests. The root causes behind poor
  20 results repeatability vary between the test cases.
  21
  22 .. note::
  23
  24     Test results have been generated by
  25
  26     - `FD.io test executor vpp performance job 3n-hsw`_,
  27     - `FD.io test executor vpp performance job 3n-skx`_,
  28     - `FD.io test executor vpp performance job 2n-skx`_
  29
  30     with RF result files csit-vpp-perf-|srelease|-\*.zip
  31     `archived here <../../_static/archive/>`_.
  32
  33 ..
  34     3n-hsw
  35     ~~~~~~
  36
  37     NDR Comparison
  38     ``````````````
  39
  40     Comparison tables in ASCII and CSV formats:
  41
  42       - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.txt>`_
  43       - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.txt>`_
  44       - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.csv>`_
  45       - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.csv>`_
  46
  47     PDR Comparison
  48     ``````````````
  49
  50     Comparison tables in ASCII and CSV formats:
  51
  52       - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.txt>`_
  53       - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.txt>`_
  54       - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.csv>`_
  55       - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.csv>`_
  56
  57
  58     MRR Comparison
  59     ``````````````
  60
  61     Comparison tables in ASCII and CSV formats:
  62
  63       - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_
  64       - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_
  65       - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_
  66       - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_
  67       - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_
  68       - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_
  69
  70 3n-skx
  71 ~~~~~~
  72
  73 NDR Comparison
  74 ``````````````
  75
  76 Comparison tables in ASCII and CSV formats:
  77
  78   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
  79   - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
  80   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
  81   - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_
  82
  83 PDR Comparison
  84 ``````````````
  85
  86 Comparison tables in ASCII and CSV formats:
  87
  88   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
  89   - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
  90   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
  91   - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_
  92
  93 ..
  94     MRR Comparison
  95     ``````````````
  96
  97     Comparison tables in ASCII and CSV formats:
  98
  99       - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
 100       - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
 101       - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
 102       - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_
 103       - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_
 104       - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_
 105
 106 ..
 107     2n-skx
 108     ~~~~~~
 109
 110     NDR Comparison
 111     ``````````````
 112
 113     Comparison tables in ASCII and CSV formats:
 114
 115       - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
 116       - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
 117       - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
 118       - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_
 119
 120     PDR Comparison
 121     ``````````````
 122
 123     Comparison tables in ASCII and CSV formats:
 124
 125       - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
 126       - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
 127       - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
 128       - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_
 129
 130     MRR Comparison
 131     ``````````````
 132
 133     Comparison tables in ASCII and CSV formats:
 134
 135       - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
 136       - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
 137       - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
 138       - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_
 139       - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_
 140       - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_