From 1fcfc9bcc91c9bf9f1ab10fab898efc0d8c1e25f Mon Sep 17 00:00:00 2001 From: Maciek Konstantynowicz Date: Tue, 7 Feb 2017 18:52:35 +0000 Subject: [PATCH] csit rls1701 report nits and updates: - Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz --- docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst | 7 +++++-- .../testpmd_performance_tests/packet_throughput_graphs/l2.rst | 7 +++++-- docs/report/vpp_performance_tests/packet_latency_graphs/ipv4.rst | 7 +++++-- .../vpp_performance_tests/packet_latency_graphs/ipv4_tunnels.rst | 7 +++++-- docs/report/vpp_performance_tests/packet_latency_graphs/ipv6.rst | 7 +++++-- .../vpp_performance_tests/packet_latency_graphs/ipv6_tunnels.rst | 7 +++++-- docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst | 7 +++++-- .../vpp_performance_tests/packet_latency_graphs/vm_vhost.rst | 7 +++++-- .../report/vpp_performance_tests/packet_throughput_graphs/ipv4.rst | 7 +++++-- .../packet_throughput_graphs/ipv4_tunnels.rst | 7 +++++-- .../report/vpp_performance_tests/packet_throughput_graphs/ipv6.rst | 7 +++++-- .../packet_throughput_graphs/ipv6_tunnels.rst | 7 +++++-- docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst | 7 +++++-- .../vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst | 7 +++++-- resources/tools/report_gen/run_report.sh | 4 ++-- 15 files changed, 72 insertions(+), 30 deletions(-) diff --git a/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst b/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst index a323761133..fc2e833967 100644 --- a/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst +++ b/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for Testpmd running in multiple configurations of Testpmd worker thread(s), a.k.a. Testpmd data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-dpdk-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst index 31a3d31b66..ee79a4c6d0 100644 --- a/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput Testpmd worker thread (a.k.a. VPP data plane thread) and physical CPU core configurations. -Title of each graph is a regex (regular expression) matching plotted -test cases. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-dpdk-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4.rst index c46f0141a2..6473422316 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4_tunnels.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4_tunnels.rst index d3293cc6aa..a41351403f 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4_tunnels.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv4_tunnels.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6.rst index 38bcf71de6..762b427349 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6_tunnels.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6_tunnels.rst index 94bf9a811f..1b9e5626b6 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6_tunnels.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ipv6_tunnels.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst index a487306dad..8354ac5582 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst index 6421db1c59..9c070fa3d4 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst @@ -7,8 +7,11 @@ throughput rate. Latency is reported for VPP running in multiple configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +latency test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured packet Latency [uSec] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4.rst index c413adb51e..169d07a332 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4_tunnels.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4_tunnels.rst index 23ac3fc001..131e4e45e2 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4_tunnels.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv4_tunnels.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6.rst index e04f2c6822..1230bde94c 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6_tunnels.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6_tunnels.rst index 1a57998018..fcd5bef2ca 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6_tunnels.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ipv6_tunnels.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst index 89429a6192..e28400ecce 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst index b5bc0dd5a3..beadc052d4 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst @@ -7,8 +7,11 @@ performance illustrating NDR throughput (zero packet loss) and PDR throughput configurations of VPP worker thread(s), a.k.a. VPP data plane thread (s), and their physical CPU core(s) placement. -Title of each graph is a regex (regular expression) matching all plotted -test case throughput measurements. +*Title of each graph* is a regex (regular expression) matching all plotted +throughput test cases, *X-axis labels* are indeces of csit-vpp-perf-1701 jobs +that created result output files used as data sources for the graph, +*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph +legend* identifes the plotted test suites. .. note:: diff --git a/resources/tools/report_gen/run_report.sh b/resources/tools/report_gen/run_report.sh index 83a4467334..f169a1d199 100755 --- a/resources/tools/report_gen/run_report.sh +++ b/resources/tools/report_gen/run_report.sh @@ -65,7 +65,7 @@ JEN_URL='https://jenkins.fd.io/view/csit/job' JEN_FILE_PERF='output_perf_data.xml' JEN_JOB='csit-vpp-perf-1701-all' -JEN_BUILD=(3 4 7 8) +JEN_BUILD=(3 4 7 8 9) for i in "${JEN_BUILD[@]}"; do curl -fs ${JEN_URL}/${JEN_JOB}/${i}/artifact/${JEN_FILE_PERF} -o ${STATIC_DIR_VPP}/${JEN_JOB}-${i}.xml @@ -89,7 +89,7 @@ for i in "${JEN_BUILD[@]}"; do done JEN_JOB='csit-vpp-functional-1701-virl' -JEN_BUILD=(18) +JEN_BUILD=(48) for i in "${JEN_BUILD[@]}"; do curl -fs ${JEN_URL}/${JEN_JOB}/${i}/artifact/\*zip\*/archive.zip -o ${STATIC_DIR_ARCH}/${JEN_JOB}-${i}.zip -- 2.16.6