:caption: VPP Performance Dashboard
Dashboard <introduction/index>
+ Failed Tests <introduction/failures>
.. toctree::
:maxdepth: 2
--- /dev/null
+Failed Tests
+============
+
+The table lists the tests which failed over the <N=14> runs of the trending
+jobs.
+
+Legend to the table:
+
+ - **Test Case**: name of FD.io CSIT test case, naming convention
+ `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_.
+ - **Failures [#]**: number of test failures over the trending period.
+ - **Last Failure [Time]**: timestamp of last failure.
+ - **Last Failure [VPP-Build-Id]**: VPP build as of last failure.
+ - **Last Failure [CSIT-Job-Build-Id]**: CSIT build as of last failure.
+
+.. include:: ../../../_build/_static/vpp/failed-tests.rst
into groups according to minimum description length principle.
The trend value is the population average of the results within a group.
-Failed tests
-------------
-
-The table lists the tests which failed over the <N=14> runs of the trending
-jobs.
-
-Legend to the table:
-
- - **Test Case**: name of FD.io CSIT test case, naming convention
- `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_.
- - **Fails [#]**: number of fails of the tests over the period.
- - **Last Fail [Date]**: the date and time when the test failed the last
- time.
- - **Last Fail [VPP Build]**: VPP build which was tested when the test failed
- the last time.
- - **Last Fail [CSIT Build]**: the last CSIT build where the test failed.
-
-.. include:: ../../../_build/_static/vpp/failed-tests.rst
-
-Dashboard
----------
-
Legend to the tables:
- **Test Case**: name of FD.io CSIT test case, naming convention
used for trendline graphs is provided in sections 4.x.
VPP worker on 1t1c
-``````````````````
+------------------
.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c.rst
VPP worker on 2t2c
-``````````````````
+------------------
.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c.rst
VPP worker on 4t4c
-``````````````````
+------------------
.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c.rst
# Prepare the header of the tables
header = ["Test Case",
- "Fails [#]",
- "Last Fail [Timestamp]",
- "Last Fail [VPP Build]",
- "Last Fail [CSIT Build]"]
+ "Failures [#]",
+ "Last Failure [Time]",
+ "Last Failure [VPP-Build-Id]",
+ "Last Failure [CSIT-Job-Build-Id]"]
# Generate the data for the table according to the model in the table
# specification
th.text = item
# Rows:
- colors = {"very-bad": ("#ffcccc", "#ff9999"),
- "bad": ("#e9f1fb", "#d4e4f7")}
+ colors = ("#e9f1fb", "#d4e4f7")
for r_idx, row in enumerate(csv_lst[1:]):
- if int(row[1]) > 7:
- color = "very-bad"
- else:
- color = "bad"
- background = colors[color][r_idx % 2]
+ background = colors[r_idx % 2]
tr = ET.SubElement(failed_tests, "tr", attrib=dict(bgcolor=background))
# Columns: