+
+.. _vpp_compare_current_vs_previous_release:
+
Current vs. Previous Release
----------------------------
Relative comparison of VPP packet throughput (NDR, PDR and MRR) between
|vpp-release| and |vpp-release-1| (measured for |csit-release| and
|csit-release-1| respectively) is calculated from results of tests
-running on 3-Node Intel Xeon Haswell testbeds (3n-hsw) in 1-core, 2-core
-and 4-core (MRR only) configurations.
+running on 2-node Intel Xeon Skylake (2n-skx), 3-node Intel Xeon Skylake
+(3n-skx), 3-Node Intel Xeon Haswell (3n-hsw), 2-node Intel Atom Denverton
+(2n-dnv), 3-node Intel Atom Denverton (3n-dnv), 3-node Arm TaiShan (3n-tsh)
+testbeds, in 1-core, 2-core and 4-core (MRR only) configurations.
Listed mean and standard deviation values are computed based on a series
of the same tests executed against respective VPP releases to verify
fully representative for these tests. The root causes behind poor
results repeatability vary between the test cases.
+.. note::
+
+ Test results have been generated by
+
+ - `FD.io test executor vpp performance job 2n-skx`_,
+ - `FD.io test executor vpp performance job 3n-skx`_,
+ - `FD.io test executor vpp performance job 2n-clx`_
+
+ with RF result files csit-vpp-perf-|srelease|-\*.zip
+ `archived here <../../_static/archive/>`_.
+
+2n-skx
+~~~~~~
+
NDR Comparison
-~~~~~~~~~~~~~~
+``````````````
-NDR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
+Comparison tables in HTML, ASCII and CSV formats:
- - `CSV 1t1c NDR changes <../_static/vpp/performance-changes-1t1c-ndr.csv>`_,
- - `CSV 2t2c NDR changes <../_static/vpp/performance-changes-2t2c-ndr.csv>`_,
- - `ASCII 1t1c NDR changes <../_static/vpp/performance-changes-1t1c-ndr.txt>`_,
- - `ASCII 2t2c NDR changes <../_static/vpp/performance-changes-2t2c-ndr.txt>`_.
+ - `HTML 2t1c NDR comparison <performance-changes-2n-skx-2t1c-ndr.html>`_
+ - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
-.. note::
+PDR Comparison
+``````````````
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_,
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+Comparison tables in HTML, ASCII and CSV formats:
+
+ - `HTML 2t1c PDR comparison <performance-changes-2n-skx-2t1c-pdr.html>`_
+ - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
+
+3n-skx
+~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in HTML, ASCII and CSV formats:
+
+ - `HTML 2t1c NDR comparison <performance-changes-3n-skx-2t1c-ndr.html>`_
+ - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
PDR Comparison
-~~~~~~~~~~~~~~
+``````````````
-PDR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
+Comparison tables in HTML, ASCII and CSV formats:
- - `CSV 1t1c PDR changes <../_static/vpp/performance-changes-1t1c-pdr.csv>`_,
- - `CSV 2t2c PDR changes <../_static/vpp/performance-changes-2t2c-pdr.csv>`_,
- - `ASCII 1t1c PDR changes <../_static/vpp/performance-changes-1t1c-pdr.txt>`_,
- - `ASCII 2t2c PDR changes <../_static/vpp/performance-changes-2t2c-pdr.txt>`_.
+ - `HTML 2t1c PDR comparison <performance-changes-3n-skx-2t1c-pdr.html>`_
+ - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
-.. note::
+2n-clx
+~~~~~~
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_,
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+NDR Comparison
+``````````````
-MRR Comparison
-~~~~~~~~~~~~~~
+Comparison tables in HTML, ASCII and CSV formats:
-MRR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
+ - `HTML 2t1c NDR comparison <performance-changes-2n-clx-2t1c-ndr.html>`_
+ - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-ndr.txt>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-ndr.csv>`_
- - `CSV 1t1c MRR changes <../_static/vpp/performance-changes-1t1c-mrr.csv>`_,
- - `CSV 2t2c MRR changes <../_static/vpp/performance-changes-2t2c-mrr.csv>`_,
- - `CSV 4t4c MRR changes <../_static/vpp/performance-changes-4t4c-mrr.csv>`_,
- - `ASCII 1t1c MRR changes <../_static/vpp/performance-changes-1t1c-mrr.txt>`_,
- - `ASCII 2t2c MRR changes <../_static/vpp/performance-changes-2t2c-mrr.txt>`_,
- - `ASCII 4t4c MRR changes <../_static/vpp/performance-changes-4t4c-mrr.txt>`_.
+PDR Comparison
+``````````````
-.. note::
+Comparison tables in HTML, ASCII and CSV formats:
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_,
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+ - `HTML 2t1c PDR comparison <performance-changes-2n-clx-2t1c-pdr.html>`_
+ - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-pdr.txt>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-2t1c-pdr.csv>`_