X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_performance_tests%2Fcomparisons%2Fcurrent_vs_previous_release.rst;h=f6c7dde63bfc59dbd0f267630b5c33a168e50db8;hp=dbfc391d2a8666ea479e80d7f21853567d36efa3;hb=466bf87200ec963f4d7f809454876212c9273b0a;hpb=7902281ee08456a4d90bb5829ba42da2c71a6379 diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst index dbfc391d2a..f6c7dde63b 100644 --- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst @@ -25,6 +25,8 @@ results repeatability vary between the test cases. Test results are stored in + - `build logs from FD.io vpp performance job 2n-icx`_, + - `build logs from FD.io vpp performance job 3n-icx`_, - `build logs from FD.io vpp performance job 2n-skx`_, - `build logs from FD.io vpp performance job 3n-skx`_, - `build logs from FD.io vpp performance job 2n-clx`_, @@ -32,13 +34,128 @@ results repeatability vary between the test cases. - `build logs from FD.io vpp performance job 2n-dnv`_, - `build logs from FD.io vpp performance job 3n-dnv`_, - `build logs from FD.io vpp performance job 3n-tsh`_, - - `build logs from FD.io vpp performance job 2n-tx2`_ + - `build logs from FD.io vpp performance job 2n-tx2`_, + - `build logs from FD.io vpp performance job 2n-aws`_, with RF result files csit-vpp-perf-|srelease|-\*.zip `archived here <../../_static/archive/>`_. -2n-skx -~~~~~~ +2n-icx-xxv710 +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c NDR comparison `_ + - `HTML 4t2c NDR comparison `_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-icx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-icx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-icx-2t1c-ndr-csv.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-icx-4t2c-ndr-csv.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR comparison `_ + - `HTML 4t2c PDR comparison `_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-icx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-icx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-icx-2t1c-pdr-csv.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-icx-4t2c-pdr-csv.csv>`_ + +MRR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c MRR comparison `_ + - `HTML 4t2c MRR comparison `_ + - `HTML 8t4c MRR comparison `_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-icx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-icx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-icx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-icx-2t1c-mrr-csv.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-icx-4t2c-mrr-csv.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-icx-8t4c-mrr-csv.csv>`_ + +Latency Comparison +`````````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR50, direction1, average value comparison `_ + - `HTML 2t1c PDR90, direction1, average value comparison `_ + - `HTML 2t1c PDR90, direction1, max value comparison `_ + - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-icx-xxv710-2t1c-pdr50-d1-avg.txt>`_ + - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-icx-xxv710-2t1c-pdr90-d1-avg.txt>`_ + - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-icx-xxv710-2t1c-pdr90-d1-max.txt>`_ + - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-icx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_ + - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-icx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ + - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-icx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ + +3n-icx-xxv710 +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c NDR comparison `_ + - `HTML 4t2c NDR comparison `_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-icx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-icx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-icx-2t1c-ndr-csv.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-icx-4t2c-ndr-csv.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR comparison `_ + - `HTML 4t2c PDR comparison `_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-icx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-icx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-icx-2t1c-pdr-csv.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-icx-4t2c-pdr-csv.csv>`_ + +MRR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c MRR comparison `_ + - `HTML 4t2c MRR comparison `_ + - `HTML 8t4c MRR comparison `_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-icx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-icx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-icx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-icx-2t1c-mrr-csv.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-icx-4t2c-mrr-csv.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-icx-8t4c-mrr-csv.csv>`_ + +Latency Comparison +`````````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR50, direction1, average value comparison `_ + - `HTML 2t1c PDR90, direction1, average value comparison `_ + - `HTML 2t1c PDR90, direction1, max value comparison `_ + - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr50-d1-avg.txt>`_ + - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr90-d1-avg.txt>`_ + - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr90-d1-max.txt>`_ + - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_ + - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ + - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ + +2n-skx-xxv710 +~~~~~~~~~~~~~ NDR Comparison `````````````` @@ -94,8 +211,8 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ -3n-skx -~~~~~~ +3n-skx-xxv710 +~~~~~~~~~~~~~ NDR Comparison `````````````` @@ -322,8 +439,8 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-zn2-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-zn2-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ -2n-dnv -~~~~~~ +2n-dnv-x553 +~~~~~~~~~~~ NDR Comparison `````````````` @@ -364,8 +481,8 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr-csv.csv>`_ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr-csv.csv>`_ -3n-dnv -~~~~~~ +3n-dnv-x553 +~~~~~~~~~~~ NDR Comparison `````````````` @@ -406,8 +523,8 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr-csv.csv>`_ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr-csv.csv>`_ -3n-tsh -~~~~~~ +3n-tsh-x520 +~~~~~~~~~~~ NDR Comparison `````````````` @@ -453,18 +570,18 @@ Latency Comparison Comparison tables in HTML, ASCII and CSV formats: - - `HTML 1t1c PDR50, direction1, average value comparison `_ - - `HTML 1t1c PDR90, direction1, average value comparison `_ - - `HTML 1t1c PDR90, direction1, max value comparison `_ - - `ASCII 1t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-tsh-x520-1t1c-pdr50-d1-avg.txt>`_ - - `ASCII 1t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-tsh-x520-1t1c-pdr90-d1-avg.txt>`_ - - `ASCII 1t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-tsh-x520-1t1c-pdr90-d1-max.txt>`_ - - `CSV 1t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-tsh-x520-1t1c-pdr50-d1-avg-csv.csv>`_ - - `CSV 1t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-tsh-x520-1t1c-pdr90-d1-avg-csv.csv>`_ - - `CSV 1t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-tsh-x520-1t1c-pdr90-d1-max-csv.csv>`_ + - `HTML 1t1c PDR50, direction1, average value comparison `_ + - `HTML 1t1c PDR90, direction1, average value comparison `_ + - `HTML 1t1c PDR90, direction1, max value comparison `_ + - `ASCII 1t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-3n-tsh-x520-1t1c-pdr50-d1-avg.txt>`_ + - `ASCII 1t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-tsh-x520-1t1c-pdr90-d1-avg.txt>`_ + - `ASCII 1t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-tsh-x520-1t1c-pdr90-d1-max.txt>`_ + - `CSV 1t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-3n-tsh-x520-1t1c-pdr50-d1-avg-csv.csv>`_ + - `CSV 1t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-tsh-x520-1t1c-pdr90-d1-avg-csv.csv>`_ + - `CSV 1t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-tsh-x520-1t1c-pdr90-d1-max-csv.csv>`_ -2n-tx2 -~~~~~~ +2n-tx2-xl710 +~~~~~~~~~~~~ NDR Comparison `````````````` @@ -519,3 +636,42 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 1t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-tx2-xl710-1t1c-pdr50-d1-avg-csv.csv>`_ - `CSV 1t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-tx2-xl710-1t1c-pdr90-d1-avg-csv.csv>`_ - `CSV 1t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-tx2-xl710-1t1c-pdr90-d1-max-csv.csv>`_ + +2n-aws-nitro50g +~~~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c NDR comparison `_ + - `HTML 4t2c NDR comparison `_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-aws-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-aws-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-aws-2t1c-ndr-csv.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-aws-4t2c-ndr-csv.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR comparison `_ + - `HTML 4t2c PDR comparison `_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-aws-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-aws-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-aws-2t1c-pdr-csv.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-aws-4t2c-pdr-csv.csv>`_ + +MRR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c MRR comparison `_ + - `HTML 4t2c MRR comparison `_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-aws-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-aws-4t2c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-aws-2t1c-mrr-csv.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-aws-4t2c-mrr-csv.csv>`_