Static report content - Honeycomb

[csit.git] / docs / report / honeycomb_performance_tests / test_result_data.rst

diff --git a/docs/report/honeycomb_performance_tests/test_result_data.rst b/docs/report/honeycomb_performance_tests/test_result_data.rst
new file mode 100644 (file)
index 0000000..563e93e
--- /dev/null
+++ b/docs/report/honeycomb_performance_tests/test_result_data.rst
@@ -0,0 +1,101 @@
+Test Result Data
+================
+
+This section includes summary of Netconf read operation performance.
+Performance is reported for Honeycomb running in multiple configurations of
+netconf thread(s) and their physical CPU core(s) placement, and for different
+read operation targets.
+
+.. note::
+
+    Test results have been generated by
+    `FD.io test executor honeycomb performance jobs`_ with Robot Framework
+    result files csit-vpp-perf-\*.zip `archived here <../../_static/archive/>`_.
+
+Honeycomb + Netconf
+===================
+
+Performs read operations from Honeycomb's operational data store. Honeycomb
+does not contact VPP to obtain the most up-to-date value. Operations are
+performed synchronously per client, varying the number of clients from 1 to 16.
+
+netconf-netty-threads: 16
+
++----------------+----------------------------------+----------------+
+| # clients      | TCP performance (reads/sec)      | Total requests |
++================+==================================+================+
+| 1              | 6630                             | 100K           |
++----------------+----------------------------------+----------------+
+| 2              | 14598                            | 100K           |
++----------------+----------------------------------+----------------+
+| 4              | 28309                            | 100K           |
++----------------+----------------------------------+----------------+
+| 8              | 46715                            | 100K           |
++----------------+----------------------------------+----------------+
+| 16             | 458141                           | 100K           |
++----------------+----------------------------------+----------------+
+
+netconf-netty-threads: 1
+
++----------------+----------------------------------+----------------+
+| # clients      | TCP performance (reads/sec)      | Total requests |
++================+==================================+================+
+| 1              | 6563                             | 100K           |
++----------------+----------------------------------+----------------+
+| 2              | 7601                             | 100K           |
++----------------+----------------------------------+----------------+
+| 4              | 8212                             | 100K           |
++----------------+----------------------------------+----------------+
+| 8              | 8595                             | 100K           |
++----------------+----------------------------------+----------------+
+| 16             | 8699                             | 100K           |
++----------------+----------------------------------+----------------+
+
+Data source:
+https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/4/
+
+Note: At 46K/s we are likely hitting the limits of the Netconf interface,
+according to https://wiki.opendaylight.org/view/NETCONF:Testing#Results_3
+
+Honeycomb + Netconf + VPP
+=========================
+
+Performs read operations from Honeycomb's operational data store. Honeycomb
+uses VPP API to obtain the value from VPP before responding. Operations are
+performed synchronously per client, varying the number of clients from 1 to 16.
+
+netconf-netty-threads: 16
+# Results pending
+
++----------------+----------------------------------+----------------+
+| # clients      | TCP performance (reads/sec)      | Total requests |
++================+==================================+================+
+| 1              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 2              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 4              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 8              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 16             |                                  | 100K           |
++----------------+----------------------------------+----------------+
+
+netconf-netty-threads: 1
+
++----------------+----------------------------------+----------------+
+| # clients      | TCP performance (reads/sec)      | Total requests |
++================+==================================+================+
+| 1              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 2              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 4              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 8              |                                  | 100K           |
++----------------+----------------------------------+----------------+
+| 16             |                                  | 100K           |
++----------------+----------------------------------+----------------+
+
+Data source:
+# TODO