Code Review / csit.git / blobdiff
? search:
summary | shortlog | log | commit | commitdiff | review | tree
raw | inline | side by side
Report: Comparisons
[csit.git] / docs / report / dpdk_performance_tests / comparisons / current_vs_previous_release.rst
diff --git a/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst
index 6a7829a..42bb235 100644 (file)
--- a/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst
+++ b/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst
@@ -1,51 +1,215 @@
-Current vs. Previous Release
-----------------------------
+
+.. _dpdk_compare_current_vs_previous_release:
+
+Current vs Previous Release
+---------------------------
 
 Relative comparison of DPDK Testpmd and L3fwd packet throughput (NDR,
 
 Relative comparison of DPDK Testpmd and L3fwd packet throughput (NDR,
-PDR and MRR) between |dpdk-release| and DPDK-18.02 (measured for |csit-
-release| and |csit-release-1| respectively) is calculated from results
-of tests running on 3-Node Intel Xeon Haswell testbeds (3n-hsw) in
-1-core, 2-core and 4-core (MRR only) configurations.
+PDR and MRR) between |dpdk-release| and |dpdk-release-1| (measured for
+|csit-release| and |csit-release-1| respectively) is calculated from
+results of tests running on 3n-skx, 2n-skx, 2n-clx, 2n-zn2 testbeds
+in 1-core and 2-core configurations.
 
 Listed mean and standard deviation values are computed based on a series
 of the same tests executed against respective DPDK releases to verify
 test results repeatability, with percentage change calculated for mean
 values.
 
 
 Listed mean and standard deviation values are computed based on a series
 of the same tests executed against respective DPDK releases to verify
 test results repeatability, with percentage change calculated for mean
 values.
 
+.. note::
+
+    Test results are stored in
+    `build logs from FD.io dpdk performance job 3n-icx`_,
+    `build logs from FD.io dpdk performance job 2n-icx`_,
+    `build logs from FD.io dpdk performance job 3n-skx`_,
+    `build logs from FD.io dpdk performance job 2n-skx`_,
+    `build logs from FD.io dpdk performance job 2n-clx`_,
+    `build logs from FD.io dpdk performance job 2n-zn2`_,
+    `build logs from FD.io dpdk performance job 3n-tsh`_,
+    `build logs from FD.io dpdk performance job 2n-tx2`_,
+    with RF result
+    files csit-dpdk-perf-|srelease|-\*.zip
+    `archived here <../../_static/archive/>`_.
+
+3n-icx-xxv710
+~~~~~~~~~~~~~
+
 NDR Comparison
 NDR Comparison
-~~~~~~~~~~~~~~
+``````````````
 
 
-NDR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
+Comparison tables in ASCII and CSV formats:
 
 
-  - `CSV 1t1c NDR changes <../_static/dpdk/performance-changes-1t1c-ndr.csv>`_,
-  - `CSV 2t2c NDR changes <../_static/dpdk/performance-changes-2t2c-ndr.csv>`_,
-  - `ASCII 1t1c NDR changes <../_static/dpdk/performance-changes-1t1c-ndr.txt>`_,
-  - `ASCII 2t2c NDR changes <../_static/dpdk/performance-changes-2t2c-ndr.txt>`_.
+  - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-ndr.txt>`_
+  - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-ndr.txt>`_
+  - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-ndr.csv>`_
+  - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-ndr.csv>`_
 
 
-.. note::
+PDR Comparison
+``````````````
 
 
-    Test results have been generated by
-    `FD.io test executor dpdk performance job 3n-hsw`_
-    with RF result
-    files csit-dpdk-perf-|srelease|-\*.zip
-    `archived here <../_static/archive/>`_.
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-pdr.txt>`_
+  - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-pdr.txt>`_
+  - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-pdr.csv>`_
+  - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-pdr.csv>`_
+
+2n-icx-xxv710
+~~~~~~~~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-ndr.txt>`_
+  - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-ndr.txt>`_
+  - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-ndr.csv>`_
+  - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-ndr.csv>`_
 
 PDR Comparison
 
 PDR Comparison
-~~~~~~~~~~~~~~
+``````````````
 
 
-PDR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
+Comparison tables in ASCII and CSV formats:
 
 
-  - `CSV 1t1c PDR changes <../_static/dpdk/performance-changes-1t1c-pdr.csv>`_,
-  - `CSV 2t2c PDR changes <../_static/dpdk/performance-changes-2t2c-pdr.csv>`_,
-  - `ASCII 1t1c PDR changes <../_static/dpdk/performance-changes-1t1c-pdr.txt>`_,
-  - `ASCII 2t2c PDR changes <../_static/dpdk/performance-changes-2t2c-pdr.txt>`_.
+  - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-pdr.txt>`_
+  - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-pdr.txt>`_
+  - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-pdr.csv>`_
+  - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-pdr.csv>`_
 
 
-.. note::
+3n-skx-xxv710
+~~~~~~~~~~~~~
 
 
-    Test results have been generated by
-    `FD.io test executor dpdk performance job 3n-hsw`_
-    with RF result
-    files csit-dpdk-perf-|srelease|-\*.zip
-    `archived here <../_static/archive/>`_.
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-ndr.txt>`_
+  - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-ndr.txt>`_
+  - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-ndr.csv>`_
+  - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-pdr.txt>`_
+  - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-pdr.txt>`_
+  - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-pdr.csv>`_
+  - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-pdr.csv>`_
+
+2n-skx-xxv710
+~~~~~~~~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-ndr.txt>`_
+  - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-ndr.txt>`_
+  - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-ndr.csv>`_
+  - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-pdr.txt>`_
+  - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-pdr.txt>`_
+  - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-pdr.csv>`_
+  - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-pdr.csv>`_
+
+2n-clx-xxv710
+~~~~~~~~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-ndr.txt>`_
+  - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-ndr.txt>`_
+  - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-ndr.csv>`_
+  - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-pdr.txt>`_
+  - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-pdr.txt>`_
+  - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-pdr.csv>`_
+  - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-pdr.csv>`_
+
+2n-zn2-xxv710
+~~~~~~~~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-ndr.txt>`_
+  - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-ndr.txt>`_
+  - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-ndr.csv>`_
+  - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-pdr.txt>`_
+  - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-pdr.txt>`_
+  - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-pdr.csv>`_
+  - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-pdr.csv>`_
+
+3n-tsh-x520
+~~~~~~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-ndr.txt>`_
+  - `ASCII 2t2c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-ndr.txt>`_
+  - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-ndr.csv>`_
+  - `CSV 2t2c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-pdr.txt>`_
+  - `ASCII 2t2c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-pdr.txt>`_
+  - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-pdr.csv>`_
+  - `CSV 2t2c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-pdr.csv>`_
+
+2n-tx2-xl710
+~~~~~~~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-ndr.txt>`_
+  - `ASCII 2t2c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-ndr.txt>`_
+  - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-ndr.csv>`_
+  - `CSV 2t2c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+  - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-pdr.txt>`_
+  - `ASCII 2t2c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-pdr.txt>`_
+  - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-pdr.csv>`_
+  - `CSV 2t2c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-pdr.csv>`_
Integration tests