FIX: PAL - list of failed tests

Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

diff --git a/docs/cpta/index.rst b/docs/cpta/index.rst
index b445a9b..b273397 100644 (file)
--- a/docs/cpta/index.rst
+++ b/docs/cpta/index.rst
@@ -12,6 +12,7 @@ analysis and anomaly detection methodology.
    :caption: VPP Performance Dashboard
 
    Dashboard <introduction/index>
+   Failed Tests <introduction/failures>
 
 .. toctree::
    :maxdepth: 2

diff --git a/docs/cpta/introduction/failures.rst b/docs/cpta/introduction/failures.rst
new file mode 100644 (file)
index 0000000..c181168
--- /dev/null
+++ b/docs/cpta/introduction/failures.rst
@@ -0,0 +1,16 @@
+Failed Tests
+============
+
+The table lists the tests which failed over the <N=14> runs of the trending
+jobs.
+
+Legend to the table:
+
+    - **Test Case**: name of FD.io CSIT test case, naming convention
+      `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_.
+    - **Failures [#]**: number of test failures over the trending period.
+    - **Last Failure [Time]**: timestamp of last failure.
+    - **Last Failure [VPP-Build-Id]**: VPP build as of last failure.
+    - **Last Failure [CSIT-Job-Build-Id]**: CSIT build as of last failure.
+
+.. include:: ../../../_build/_static/vpp/failed-tests.rst

diff --git a/docs/cpta/introduction/index.rst b/docs/cpta/introduction/index.rst
index 229e9e3..76aed6b 100644 (file)
--- a/docs/cpta/introduction/index.rst
+++ b/docs/cpta/introduction/index.rst
@@ -21,28 +21,6 @@ trend and anomaly evaluation is based on an algorithm which divides test runs
 into groups according to minimum description length principle.
 The trend value is the population average of the results within a group.
 
-Failed tests
-------------
-
-The table lists the tests which failed over the <N=14> runs of the trending
-jobs.
-
-Legend to the table:
-
-    - **Test Case**: name of FD.io CSIT test case, naming convention
-      `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_.
-    - **Fails [#]**: number of fails of the tests over the period.
-    - **Last Fail [Date]**: the date and time when the test failed the last
-      time.
-    - **Last Fail [VPP Build]**: VPP build which was tested when the test failed
-      the last time.
-    - **Last Fail [CSIT Build]**: the last CSIT build where the test failed.
-
-.. include:: ../../../_build/_static/vpp/failed-tests.rst
-
-Dashboard
----------
-
 Legend to the tables:
 
     - **Test Case**: name of FD.io CSIT test case, naming convention
@@ -61,16 +39,16 @@ section 2. and trendline graphs in sections 3.x. Performance test  data
 used for trendline graphs is provided in sections 4.x.
 
 VPP worker on 1t1c
-``````````````````
+------------------
 
 .. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c.rst
 
 VPP worker on 2t2c
-``````````````````
+------------------
 
 .. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c.rst
 
 VPP worker on 4t4c
-``````````````````
+------------------
 
 .. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c.rst

diff --git a/resources/tools/presentation/generator_tables.py b/resources/tools/presentation/generator_tables.py
index 43117cc..40eda7b 100644 (file)
--- a/resources/tools/presentation/generator_tables.py
+++ b/resources/tools/presentation/generator_tables.py
@@ -970,10 +970,10 @@ def table_failed_tests(table, input_data):
 
     # Prepare the header of the tables
     header = ["Test Case",
-              "Fails [#]",
-              "Last Fail [Timestamp]",
-              "Last Fail [VPP Build]",
-              "Last Fail [CSIT Build]"]
+              "Failures [#]",
+              "Last Failure [Time]",
+              "Last Failure [VPP-Build-Id]",
+              "Last Failure [CSIT-Job-Build-Id]"]
 
     # Generate the data for the table according to the model in the table
     # specification
@@ -1070,14 +1070,9 @@ def table_failed_tests_html(table, input_data):
         th.text = item
 
     # Rows:
-    colors = {"very-bad": ("#ffcccc", "#ff9999"),
-              "bad": ("#e9f1fb", "#d4e4f7")}
+    colors = ("#e9f1fb", "#d4e4f7")
     for r_idx, row in enumerate(csv_lst[1:]):
-        if int(row[1]) > 7:
-            color = "very-bad"
-        else:
-            color = "bad"
-        background = colors[color][r_idx % 2]
+        background = colors[r_idx % 2]
         tr = ET.SubElement(failed_tests, "tr", attrib=dict(bgcolor=background))
 
         # Columns: