X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fdpdk_performance_tests%2Fcomparisons%2Fcurrent_vs_previous_release.rst;h=42bb2351d3dd5f542724aa2fb4f3e23ba97bcc69;hp=6a7829ac8a046d68d764e6767cb7237d474546db;hb=d0a30297017d1e947c3540ca81b00599ea77825e;hpb=637eb126bb4ed30df61a293e03d36bd8ad5265e5 diff --git a/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst index 6a7829ac8a..42bb2351d3 100644 --- a/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst @@ -1,51 +1,215 @@ -Current vs. Previous Release ----------------------------- + +.. _dpdk_compare_current_vs_previous_release: + +Current vs Previous Release +--------------------------- Relative comparison of DPDK Testpmd and L3fwd packet throughput (NDR, -PDR and MRR) between |dpdk-release| and DPDK-18.02 (measured for |csit- -release| and |csit-release-1| respectively) is calculated from results -of tests running on 3-Node Intel Xeon Haswell testbeds (3n-hsw) in -1-core, 2-core and 4-core (MRR only) configurations. +PDR and MRR) between |dpdk-release| and |dpdk-release-1| (measured for +|csit-release| and |csit-release-1| respectively) is calculated from +results of tests running on 3n-skx, 2n-skx, 2n-clx, 2n-zn2 testbeds +in 1-core and 2-core configurations. Listed mean and standard deviation values are computed based on a series of the same tests executed against respective DPDK releases to verify test results repeatability, with percentage change calculated for mean values. +.. note:: + + Test results are stored in + `build logs from FD.io dpdk performance job 3n-icx`_, + `build logs from FD.io dpdk performance job 2n-icx`_, + `build logs from FD.io dpdk performance job 3n-skx`_, + `build logs from FD.io dpdk performance job 2n-skx`_, + `build logs from FD.io dpdk performance job 2n-clx`_, + `build logs from FD.io dpdk performance job 2n-zn2`_, + `build logs from FD.io dpdk performance job 3n-tsh`_, + `build logs from FD.io dpdk performance job 2n-tx2`_, + with RF result + files csit-dpdk-perf-|srelease|-\*.zip + `archived here <../../_static/archive/>`_. + +3n-icx-xxv710 +~~~~~~~~~~~~~ + NDR Comparison -~~~~~~~~~~~~~~ +`````````````` -NDR throughput comparison between releases is available in CSV and pretty -ASCII formats: +Comparison tables in ASCII and CSV formats: - - `CSV 1t1c NDR changes <../_static/dpdk/performance-changes-1t1c-ndr.csv>`_, - - `CSV 2t2c NDR changes <../_static/dpdk/performance-changes-2t2c-ndr.csv>`_, - - `ASCII 1t1c NDR changes <../_static/dpdk/performance-changes-1t1c-ndr.txt>`_, - - `ASCII 2t2c NDR changes <../_static/dpdk/performance-changes-2t2c-ndr.txt>`_. + - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-ndr.csv>`_ -.. note:: +PDR Comparison +`````````````` - Test results have been generated by - `FD.io test executor dpdk performance job 3n-hsw`_ - with RF result - files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../_static/archive/>`_. +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-icx-4t2c-pdr.csv>`_ + +2n-icx-xxv710 +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-ndr.csv>`_ PDR Comparison -~~~~~~~~~~~~~~ +`````````````` -PDR throughput comparison between releases is available in CSV and pretty -ASCII formats: +Comparison tables in ASCII and CSV formats: - - `CSV 1t1c PDR changes <../_static/dpdk/performance-changes-1t1c-pdr.csv>`_, - - `CSV 2t2c PDR changes <../_static/dpdk/performance-changes-2t2c-pdr.csv>`_, - - `ASCII 1t1c PDR changes <../_static/dpdk/performance-changes-1t1c-pdr.txt>`_, - - `ASCII 2t2c PDR changes <../_static/dpdk/performance-changes-2t2c-pdr.txt>`_. + - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-icx-4t2c-pdr.csv>`_ -.. note:: +3n-skx-xxv710 +~~~~~~~~~~~~~ - Test results have been generated by - `FD.io test executor dpdk performance job 3n-hsw`_ - with RF result - files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../_static/archive/>`_. +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-ndr.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-pdr.csv>`_ + +2n-skx-xxv710 +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-ndr.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-pdr.csv>`_ + +2n-clx-xxv710 +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-ndr.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-pdr.csv>`_ + +2n-zn2-xxv710 +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-ndr.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-pdr.csv>`_ + +3n-tsh-x520 +~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-ndr.txt>`_ + - `ASCII 2t2c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-ndr.txt>`_ + - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-ndr.csv>`_ + - `CSV 2t2c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-ndr.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-pdr.txt>`_ + - `ASCII 2t2c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-pdr.txt>`_ + - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-pdr.csv>`_ + - `CSV 2t2c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-pdr.csv>`_ + +2n-tx2-xl710 +~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-ndr.txt>`_ + - `ASCII 2t2c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-ndr.txt>`_ + - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-ndr.csv>`_ + - `CSV 2t2c NDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-ndr.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in ASCII and CSV formats: + + - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-pdr.txt>`_ + - `ASCII 2t2c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-pdr.txt>`_ + - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-1t1c-pdr.csv>`_ + - `CSV 2t2c PDR comparison <../../_static/dpdk/performance-changes-2n-tx2-2t2c-pdr.csv>`_