summary |
shortlog |
log |
commit | commitdiff |
review |
tree
raw |
patch |
inline | side by side (from parent 1:
b659ab3)
+ Fix duration, mention number of tests and runs.
- Hover information still feels wrong.
+ Mention "critical rate" instead of "throughput" where possible.
+ Mention lower bounds are displayed.
+ Rename "plrsearch_algorithm" label to "PLRsearch".
+ Because the previous link did not work. Due to underscore?
+ Rename "SOAK" to "soak" or "Soak" (except when it is a tag).
Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
-.. _plrsearch_algorithm:
-Long duration soak tests are executed using `plrsearch_algorithm`_.
+Long duration (2 hours per test) soak tests are executed
+using `PLRsearch`_ algorithm. As the test take long time, only 10 test
+were executed, two runs each.
Additional information about graph data:
Additional information about graph data:
#. **X-axis Labels**: indices of test suites.
#. **X-axis Labels**: indices of test suites.
-#. **Y-axis Labels**: estimated intervals for packet throughput value in [Mpps].
+#. **Y-axis Labels**: estimated lower bounds for critical rate value in [Mpps].
#. **Graph Legend**: list of X-axis indices with CSIT test suites.
#. **Graph Legend**: list of X-axis indices with CSIT test suites.
-#. **Hover Information**: lists minimum, first quartile, median,
+#. **Hover Information**: in general lists minimum, first quartile, median,
third quartile, and maximum. If either type of outlier is present the
whisker on the appropriate side is taken to 1.5×IQR from the quartile
(the "inner fence") rather than the max or min, and individual outlying
data points are displayed as unfilled circles (for suspected outliers)
or filled circles (for outliers). (The "outer fence" is 3×IQR from the
quartile.)
third quartile, and maximum. If either type of outlier is present the
whisker on the appropriate side is taken to 1.5×IQR from the quartile
(the "inner fence") rather than the max or min, and individual outlying
data points are displayed as unfilled circles (for suspected outliers)
or filled circles (for outliers). (The "outer fence" is 3×IQR from the
quartile.)
- It also lists the lower bounds for the estimated throughput value.
+ When number of samples is low, some values are not displayed.
plot-vpp-soak-2n-skx:
# TODO: Add 1904 data
csit-vpp-perf-verify-1904-2n-skx:
plot-vpp-soak-2n-skx:
# TODO: Add 1904 data
csit-vpp-perf-verify-1904-2n-skx:
- - 70 # SOAK
- - 71 # SOAK
+ - 70 # soak
+ - 71 # soak
plot-vpp-nfv-2n-skx-ndrpdr-64b:
csit-vpp-perf-verify-1904-2n-skx:
plot-vpp-nfv-2n-skx-ndrpdr-64b:
csit-vpp-perf-verify-1904-2n-skx:
- 32 # NDRPDR sel
vpp-soak-vs-ndr-2n-skx-cmp:
csit-vpp-perf-verify-1904-2n-skx:
- 32 # NDRPDR sel
vpp-soak-vs-ndr-2n-skx-cmp:
csit-vpp-perf-verify-1904-2n-skx:
- - 70 # SOAK
- - 71 # SOAK
+ - 70 # soak
+ - 71 # soak
vpp-soak-vs-ndr-2n-skx:
csit-vpp-perf-verify-1904-2n-skx:
- 12 # NDRPDR sel
vpp-soak-vs-ndr-2n-skx:
csit-vpp-perf-verify-1904-2n-skx:
- 12 # NDRPDR sel
- 30 # NDRPDR sel
- 31 # NDRPDR sel
- 32 # NDRPDR sel
- 30 # NDRPDR sel
- 31 # NDRPDR sel
- 32 # NDRPDR sel
- - 70 # SOAK
- - 71 # SOAK
+ - 70 # soak
+ - 71 # soak
vpp-performance-changes-3n-hsw-mrr-h1:
csit-vpp-perf-verify-1810-3n-hsw:
vpp-performance-changes-3n-hsw-mrr-h1:
csit-vpp-perf-verify-1810-3n-hsw:
size: 16
zeroline: False
yaxis:
size: 16
zeroline: False
yaxis:
- title: "<b>Packet Throughput [Mpps]</b>"
+ title: "<b>Critical Rate Lower Bound [Mpps]</b>"
titlefont:
size: 16
gridcolor: "rgb(230, 230, 230)"
titlefont:
size: 16
gridcolor: "rgb(230, 230, 230)"
- 69 # NFV NDRPDR IMIX
- 80 # NFV MRR NDRPDR 64b IMIX
- 81 # NFV MRR NDRPDR 64b IMIX
- 69 # NFV NDRPDR IMIX
- 80 # NFV MRR NDRPDR 64b IMIX
- 81 # NFV MRR NDRPDR 64b IMIX
- - 70 # SOAK
- - 71 # SOAK
+ - 70 # soak
+ - 71 # soak
# csit-ligato-perf-verify-1901-3n-hsw:
# - 10 # NDRPDR full
# csit-ligato-perf-verify-1901-3n-hsw:
# - 10 # NDRPDR full
### T A B L E S ###
################################################################################
### T A B L E S ###
################################################################################
- type: "table"
title: "VPP Soak vs NDR 2n-skx"
algorithm: "table_soak_vs_ndr"
- type: "table"
title: "VPP Soak vs NDR 2n-skx"
algorithm: "table_soak_vs_ndr"
### P L O T S ###
################################################################################
### P L O T S ###
################################################################################
-# Soak test - 30min Soak Test (PLRsearch), boxes
+# Soak Test (PLRsearch), boxes
- title: "VPP Throughput: 30min Soak Test (PLRsearch) boxes"
+ title: "VPP Critical rate: 2 Hours Soak Test (PLRsearch)"
algorithm: "plot_performance_box"
output-file-type: ".html"
output-file: "{DIR[STATIC,VPP]}/soak-test-1"
algorithm: "plot_performance_box"
output-file-type: ".html"
output-file: "{DIR[STATIC,VPP]}/soak-test-1"
boxpoints: "all"
whiskerwidth: 0
layout:
boxpoints: "all"
whiskerwidth: 0
layout:
- title: "30min Soak Test (PLRsearch)"
+ title: "2 Hours Soak Test (PLRsearch)"
layout: "plot-soak-throughput"
layout: "plot-soak-throughput"
-# Soak test - 30min Soak Test (PLRsearch), boxes
+# Soak Test (PLRsearch), boxes
- title: "VPP Throughput: 30min Soak Test (PLRsearch) boxes"
+ title: "VPP Critical rate: 2 Hours Soak Test (PLRsearch)"
algorithm: "plot_performance_box"
output-file-type: ".html"
output-file: "{DIR[STATIC,VPP]}/soak-test-2"
algorithm: "plot_performance_box"
output-file-type: ".html"
output-file: "{DIR[STATIC,VPP]}/soak-test-2"
boxpoints: "all"
whiskerwidth: 0
layout:
boxpoints: "all"
whiskerwidth: 0
layout:
- title: "30min Soak Test (PLRsearch)"
+ title: "2 Hours Soak Test (PLRsearch)"
layout: "plot-soak-throughput"
################################################################################
layout: "plot-soak-throughput"
################################################################################