report content - honeycomb, part2
[csit.git] / docs / report / honeycomb_performance_tests / test_result_data.rst
1 Test Result Data
2 ================
3
4 This section includes summary of Netconf read operation performance.
5 Performance is reported for Honeycomb running in multiple configurations of
6 netconf thread(s) and their physical CPU core(s) placement, and for different
7 read operation targets.
8
9 .. note::
10
11     Test results have been generated by
12     `FD.io test executor honeycomb performance jobs`_ with Robot Framework
13     result files csit-vpp-perf-\*.zip `archived here <../../_static/archive/>`_.
14
15 Honeycomb + Netconf
16 ===================
17
18 Performs read operations from Honeycomb's operational data store. Honeycomb
19 does not contact VPP to obtain the most up-to-date value. Operations are
20 performed synchronously per client, varying the number of clients from 1 to 16.
21
22 netconf-netty-threads: 16
23
24 +----------------+----------------------------------+----------------+
25 | # clients      | TCP performance (reads/sec)      | Total requests |
26 +================+==================================+================+
27 | 1              | 5179                             | 100K           |
28 +----------------+----------------------------------+----------------+
29 | 2              | 10601                            | 100K           |
30 +----------------+----------------------------------+----------------+
31 | 4              | 21488                            | 100K           |
32 +----------------+----------------------------------+----------------+
33 | 8              | 35772                            | 100K           |
34 +----------------+----------------------------------+----------------+
35 | 16             | 73544                            | 100K           |
36 +----------------+----------------------------------+----------------+
37
38 netconf-netty-threads: 1
39
40 +----------------+----------------------------------+----------------+
41 | # clients      | TCP performance (reads/sec)      | Total requests |
42 +================+==================================+================+
43 | 1              | 5179                             | 100K           |
44 +----------------+----------------------------------+----------------+
45 | 2              | 5557                             | 100K           |
46 +----------------+----------------------------------+----------------+
47 | 4              | 5888                             | 100K           |
48 +----------------+----------------------------------+----------------+
49 | 8              | 5977                             | 100K           |
50 +----------------+----------------------------------+----------------+
51 | 16             | 6119                             | 100K           |
52 +----------------+----------------------------------+----------------+
53
54 Data source:
55 https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/8/
56
57 Honeycomb + Netconf + VPP
58 =========================
59
60 Performs read operations from Honeycomb's operational data store. Honeycomb
61 uses VPP API to obtain the value from VPP before responding. Operations are
62 performed synchronously per client, varying the number of clients from 1 to 16.
63
64 netconf-netty-threads: 16
65
66 +----------------+----------------------------------+----------------+
67 | # clients      | TCP performance (reads/sec)      | Total requests |
68 +================+==================================+================+
69 | 1              | 4766                             | 100K           |
70 +----------------+----------------------------------+----------------+
71 | 2              | 9906                             | 100K           |
72 +----------------+----------------------------------+----------------+
73 | 4              | 17594                            | 100K           |
74 +----------------+----------------------------------+----------------+
75 | 8              | 29933                            | 100K           |
76 +----------------+----------------------------------+----------------+
77 | 16             | 45254                            | 100K           |
78 +----------------+----------------------------------+----------------+
79
80 netconf-netty-threads: 1
81
82 +----------------+----------------------------------+----------------+
83 | # clients      | TCP performance (reads/sec)      | Total requests |
84 +================+==================================+================+
85 | 1              | 4600                             | 100K           |
86 +----------------+----------------------------------+----------------+
87 | 2              | 5375                             | 100K           |
88 +----------------+----------------------------------+----------------+
89 | 4              | 5404                             | 100K           |
90 +----------------+----------------------------------+----------------+
91 | 8              | 5488                             | 100K           |
92 +----------------+----------------------------------+----------------+
93 | 16             | 6000                             | 100K           |
94 +----------------+----------------------------------+----------------+
95
96 Data source:
97 https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/9/