31da9aeb18bc82ffbd50a98b28d26daf06340290
[csit.git] / docs / cpta / introduction / index.rst
1 VPP MRR Performance Dashboard
2 =============================
3
4 Description
5 -----------
6
7 Dashboard tables list a summary of per test-case VPP MRR performance trend
8 values and detected anomalies (Maximum Receive Rate - received packet rate
9 under line rate load). Data comes from trending MRR jobs executed every 12 hrs
10 (2:00, 14:00 UTC). Trend and anomaly calculations are done over a rolling
11 window of <N> samples, currently with N=14 covering last 7 days. Separate
12 tables are generated for tested VPP worker-thread-core combinations (1t1c,
13 2t2c, 4t4c).
14
15 Legend to table:
16
17     - "Test case": name of CSIT test case, naming convention here
18       `CSIT/csit-test-naming <https://wiki.fd.io/view/CSIT/csit-test-naming>`_
19     - "Thput trend [Mpps]": last value of trend over rolling window.
20     - "Anomaly value [Mpps]": in precedence - i) highest outlier if 3
21       consecutive outliers, ii) highest regression if regressions detected,
22       iii) highest progression if progressions detected, iv) nil if normal i.e.
23       within trend.
24     - "Anomaly vs. Trend [%]": anomaly value vs. trend value.
25     - "Classification": outlier, regression, progression, normal - observed
26       over a rolling window.
27     - "# Outliers": number of outliers detected.
28
29 Tables are listed in sections 1.x. Followed by daily trending graphs in
30 sections 2.x. Daily trending data used to generate the graphs is listed in
31 sections 3.x.
32
33 VPP worker on 1t1c
34 ------------------
35
36 .. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c.rst
37
38 VPP worker on 2t2c
39 ------------------
40
41 .. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c.rst
42
43 VPP worker on 4t4c
44 ------------------
45
46 .. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c.rst
47

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.