Code Review / csit.git / commitdiff
? search:
summary | shortlog | log | commit | commitdiff | review | tree
raw | patch | inline | side by side (parent: a0ff7c5)
report content - honeycomb, part2 56/7756/2
authorselias <samelias@cisco.com>
Tue, 25 Jul 2017 08:52:41 +0000 (10:52 +0200)
committerPeter Mikus <pmikus@cisco.com>
Tue, 25 Jul 2017 10:03:43 +0000 (10:03 +0000)
Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e
Signed-off-by: selias <samelias@cisco.com>
docs/report/honeycomb_performance_tests/test_result_data.rst patch | blob | history
resources/tools/report_gen/run_report.cfg patch | blob | history

diff --git a/docs/report/honeycomb_performance_tests/test_result_data.rst b/docs/report/honeycomb_performance_tests/test_result_data.rst
index 563e93e..2e36536 100644 (file)
--- a/docs/report/honeycomb_performance_tests/test_result_data.rst
+++ b/docs/report/honeycomb_performance_tests/test_result_data.rst
@@ -24,15 +24,15 @@ netconf-netty-threads: 16
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
-| 1              | 6630                             | 100K           |
+| 1              | 5179                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 2              | 14598                            | 100K           |
+| 2              | 10601                            | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 4              | 28309                            | 100K           |
+| 4              | 21488                            | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 8              | 46715                            | 100K           |
+| 8              | 35772                            | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 16             | 458141                           | 100K           |
+| 16             | 73544                            | 100K           |
 +----------------+----------------------------------+----------------+
 
 netconf-netty-threads: 1
 +----------------+----------------------------------+----------------+
 
 netconf-netty-threads: 1
@@ -40,22 +40,19 @@ netconf-netty-threads: 1
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
-| 1              | 6563                             | 100K           |
+| 1              | 5179                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 2              | 7601                             | 100K           |
+| 2              | 5557                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 4              | 8212                             | 100K           |
+| 4              | 5888                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 8              | 8595                             | 100K           |
+| 8              | 5977                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 16             | 8699                             | 100K           |
+| 16             | 6119                             | 100K           |
 +----------------+----------------------------------+----------------+
 
 Data source:
 +----------------+----------------------------------+----------------+
 
 Data source:
-https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/4/
-
-Note: At 46K/s we are likely hitting the limits of the Netconf interface,
-according to https://wiki.opendaylight.org/view/NETCONF:Testing#Results_3
+https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/8/
 
 Honeycomb + Netconf + VPP
 =========================
 
 Honeycomb + Netconf + VPP
 =========================
@@ -65,20 +62,19 @@ uses VPP API to obtain the value from VPP before responding. Operations are
 performed synchronously per client, varying the number of clients from 1 to 16.
 
 netconf-netty-threads: 16
 performed synchronously per client, varying the number of clients from 1 to 16.
 
 netconf-netty-threads: 16
-# Results pending
 
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
 
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
-| 1              |                                  | 100K           |
+| 1              | 4766                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 2              |                                  | 100K           |
+| 2              | 9906                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 4              |                                  | 100K           |
+| 4              | 17594                            | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 8              |                                  | 100K           |
+| 8              | 29933                            | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 16             |                                  | 100K           |
+| 16             | 45254                            | 100K           |
 +----------------+----------------------------------+----------------+
 
 netconf-netty-threads: 1
 +----------------+----------------------------------+----------------+
 
 netconf-netty-threads: 1
@@ -86,16 +82,16 @@ netconf-netty-threads: 1
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
 +----------------+----------------------------------+----------------+
 | # clients      | TCP performance (reads/sec)      | Total requests |
 +================+==================================+================+
-| 1              |                                  | 100K           |
+| 1              | 4600                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 2              |                                  | 100K           |
+| 2              | 5375                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 4              |                                  | 100K           |
+| 4              | 5404                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 8              |                                  | 100K           |
+| 8              | 5488                             | 100K           |
 +----------------+----------------------------------+----------------+
 +----------------+----------------------------------+----------------+
-| 16             |                                  | 100K           |
+| 16             | 6000                             | 100K           |
 +----------------+----------------------------------+----------------+
 
 Data source:
 +----------------+----------------------------------+----------------+
 
 Data source:
-# TODO
+https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/9/
\ No newline at end of file
diff --git a/resources/tools/report_gen/run_report.cfg b/resources/tools/report_gen/run_report.cfg
index dba6414..57b2be0 100644 (file)
--- a/resources/tools/report_gen/run_report.cfg
+++ b/resources/tools/report_gen/run_report.cfg
@@ -51,7 +51,7 @@ JOB[PERF,DPDK,FBLD]=10
 JOB[FUNC,VPP]=csit-vpp-functional-1707-ubuntu1604-virl
 JOB[FUNC,VPP,BLD]=lastSuccessfulBuild
 JOB[PERF,HC]=hc2vpp-csit-perf-master-ubuntu1604
 JOB[FUNC,VPP]=csit-vpp-functional-1707-ubuntu1604-virl
 JOB[FUNC,VPP,BLD]=lastSuccessfulBuild
 JOB[PERF,HC]=hc2vpp-csit-perf-master-ubuntu1604
-JOB[PERF,HC,BLD]=4
+JOB[PERF,HC,BLD]="8 9"
 JOB[FUNC,HC]=hc2vpp-csit-integration-1707-ubuntu1604
 JOB[FUNC,HC,BLD]=lastSuccessfulBuild
 JOB[FUNC,NSH]=hc2vpp-csit-integration-1707-ubuntu1604
 JOB[FUNC,HC]=hc2vpp-csit-integration-1707-ubuntu1604
 JOB[FUNC,HC,BLD]=lastSuccessfulBuild
 JOB[FUNC,NSH]=hc2vpp-csit-integration-1707-ubuntu1604
Integration tests