docs/report/honeycomb_performance_tests/test_result_data.rst

   1 Test Result Data
   2 ================
   3
   4 This section includes summary of Netconf read operation performance.
   5 Performance is reported for Honeycomb running in multiple configurations of
   6 netconf thread(s) and their physical CPU core(s) placement, and for different
   7 read operation targets.
   8
   9 .. note::
  10
  11     Test results have been generated by
  12     `FD.io test executor honeycomb performance jobs`_ with Robot Framework
  13     result files csit-vpp-perf-\*.zip `archived here <../../_static/archive/>`_.
  14
  15 Honeycomb + Netconf
  16 ===================
  17
  18 Performs read operations from Honeycomb's operational data store. Honeycomb
  19 does not contact VPP to obtain the most up-to-date value. Operations are
  20 performed synchronously per client, varying the number of clients from 1 to 16.
  21
  22 netconf-netty-threads: 16
  23
  24 +----------------+----------------------------------+----------------+
  25 | # clients      | TCP performance (reads/sec)      | Total requests |
  26 +================+==================================+================+
  27 | 1              | 6630                             | 100K           |
  28 +----------------+----------------------------------+----------------+
  29 | 2              | 14598                            | 100K           |
  30 +----------------+----------------------------------+----------------+
  31 | 4              | 28309                            | 100K           |
  32 +----------------+----------------------------------+----------------+
  33 | 8              | 46715                            | 100K           |
  34 +----------------+----------------------------------+----------------+
  35 | 16             | 458141                           | 100K           |
  36 +----------------+----------------------------------+----------------+
  37
  38 netconf-netty-threads: 1
  39
  40 +----------------+----------------------------------+----------------+
  41 | # clients      | TCP performance (reads/sec)      | Total requests |
  42 +================+==================================+================+
  43 | 1              | 6563                             | 100K           |
  44 +----------------+----------------------------------+----------------+
  45 | 2              | 7601                             | 100K           |
  46 +----------------+----------------------------------+----------------+
  47 | 4              | 8212                             | 100K           |
  48 +----------------+----------------------------------+----------------+
  49 | 8              | 8595                             | 100K           |
  50 +----------------+----------------------------------+----------------+
  51 | 16             | 8699                             | 100K           |
  52 +----------------+----------------------------------+----------------+
  53
  54 Data source:
  55 https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/4/
  56
  57 Note: At 46K/s we are likely hitting the limits of the Netconf interface,
  58 according to https://wiki.opendaylight.org/view/NETCONF:Testing#Results_3
  59
  60 Honeycomb + Netconf + VPP
  61 =========================
  62
  63 Performs read operations from Honeycomb's operational data store. Honeycomb
  64 uses VPP API to obtain the value from VPP before responding. Operations are
  65 performed synchronously per client, varying the number of clients from 1 to 16.
  66
  67 netconf-netty-threads: 16
  68 # Results pending
  69
  70 +----------------+----------------------------------+----------------+
  71 | # clients      | TCP performance (reads/sec)      | Total requests |
  72 +================+==================================+================+
  73 | 1              |                                  | 100K           |
  74 +----------------+----------------------------------+----------------+
  75 | 2              |                                  | 100K           |
  76 +----------------+----------------------------------+----------------+
  77 | 4              |                                  | 100K           |
  78 +----------------+----------------------------------+----------------+
  79 | 8              |                                  | 100K           |
  80 +----------------+----------------------------------+----------------+
  81 | 16             |                                  | 100K           |
  82 +----------------+----------------------------------+----------------+
  83
  84 netconf-netty-threads: 1
  85
  86 +----------------+----------------------------------+----------------+
  87 | # clients      | TCP performance (reads/sec)      | Total requests |
  88 +================+==================================+================+
  89 | 1              |                                  | 100K           |
  90 +----------------+----------------------------------+----------------+
  91 | 2              |                                  | 100K           |
  92 +----------------+----------------------------------+----------------+
  93 | 4              |                                  | 100K           |
  94 +----------------+----------------------------------+----------------+
  95 | 8              |                                  | 100K           |
  96 +----------------+----------------------------------+----------------+
  97 | 16             |                                  | 100K           |
  98 +----------------+----------------------------------+----------------+
  99
 100 Data source:
 101 # TODO