docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst

   1
   2 .. _vpp_compare_current_vs_previous_release:
   3
   4 Current vs. Previous Release
   5 ----------------------------
   6
   7 Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
   8 |vpp-release| and |vpp-release-1| (measured for |csit-release| and
   9 |csit-release-1| respectively) is calculated from results of tests
  10 running on 2-node Intel Xeon Skylake (2n-skx), 3-node Intel Xeon Skylake
  11 (3n-skx), 3-Node Intel Xeon Haswell (3n-hsw), 2-node Intel Atom Denverton
  12 (2n-dnv), 3-node Intel Atom Denverton (3n-dnv), 3-node Arm TaiShan (3n-tsh)
  13 testbeds, in 1-core, 2-core and 4-core (MRR only) configurations.
  14
  15 Listed mean and standard deviation values are computed based on a series
  16 of the same tests executed against respective VPP releases to verify
  17 test results repeatability, with percentage change calculated for mean
  18 values. Note that the standard deviation is quite high for a small
  19 number of packet throughput tests, what indicates poor test results
  20 repeatability and makes the relative change of mean throughput value not
  21 fully representative for these tests. The root causes behind poor
  22 results repeatability vary between the test cases.
  23
  24 .. note::
  25
  26     Test results have been generated by
  27
  28     - `FD.io test executor vpp performance job 2n-skx`_,
  29     - `FD.io test executor vpp performance job 3n-skx`_,
  30     - `FD.io test executor vpp performance job 2n-clx`_
  31
  32     with RF result files csit-vpp-perf-|srelease|-\*.zip
  33     `archived here <../../_static/archive/>`_.
  34
  35 2n-skx
  36 ~~~~~~
  37
  38 NDR Comparison
  39 ``````````````
  40
  41 Comparison tables in HTML, ASCII and CSV formats:
  42
  43   - `HTML 2t1c NDR comparison <performance-changes-2n-skx-2t1c-ndr.html>`_
  44   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
  45   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
  46
  47 PDR Comparison
  48 ``````````````
  49
  50 Comparison tables in HTML, ASCII and CSV formats:
  51
  52   - `HTML 2t1c PDR comparison <performance-changes-2n-skx-2t1c-pdr.html>`_
  53   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
  54   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
  55
  56 3n-skx
  57 ~~~~~~
  58
  59 NDR Comparison
  60 ``````````````
  61
  62 Comparison tables in HTML, ASCII and CSV formats:
  63
  64   - `HTML 2t1c NDR comparison <performance-changes-3n-skx-2t1c-ndr.html>`_
  65   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
  66   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
  67
  68 PDR Comparison
  69 ``````````````
  70
  71 Comparison tables in HTML, ASCII and CSV formats:
  72
  73   - `HTML 2t1c PDR comparison <performance-changes-3n-skx-2t1c-pdr.html>`_
  74   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
  75   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
  76
  77 2n-clx
  78 ~~~~~~
  79
  80 NDR Comparison
  81 ``````````````
  82
  83 Comparison tables in HTML, ASCII and CSV formats:
  84
  85   - `HTML 2t1c NDR comparison <performance-changes-2n-clx-2t1c-ndr.html>`_
  86   - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-ndr.txt>`_
  87   - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-ndr.csv>`_
  88
  89 PDR Comparison
  90 ``````````````
  91
  92 Comparison tables in HTML, ASCII and CSV formats:
  93
  94   - `HTML 2t1c PDR comparison <performance-changes-2n-clx-2t1c-pdr.html>`_
  95   - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-pdr.txt>`_
  96   - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-pdr.csv>`_