Replace reconf results with disclaimer

+ Added a link to 19.08.1 result page.
+ Change the report version to 1908.40
+ Add note to "Report History"

Change-Id: Id566c28e82c30cf61e2a6e2a794634c7c353cbf1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst
index 64f7c24..753721d 100644 (file)
--- a/docs/report/introduction/report_history.rst
+++ b/docs/report/introduction/report_history.rst
@@ -6,6 +6,12 @@ FD.io CSIT-1908 Report history and per .[ww] revision changes are listed below.
 +----------------+------------------------------------------------------------+
 | .[ww] Revision | Changes                                                    |
 +================+============================================================+
+| .40            | 1. Presented results of :ref:`vnf_service_chains_reconf`   |
+|                |    reconfiguration tests were replaced by the link to      |
+|                |    CSIT-1908.1.40 report presenting results of these tests |
+|                |    re-run on VPP 19.08.1.                                  |
+|                |                                                            |
++----------------+------------------------------------------------------------+
 | .38            | 1. Added data:                                             |
 |                |                                                            |
 |                |    - NFV Density, 2n-skx                                   |

diff --git a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
index f17d567..ea76187 100644 (file)
--- a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
+++ b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
@@ -35,117 +35,8 @@ VNF Service Chains
 
 .. important::
 
-    **DISCLAIMER**: Presented test results should be taken with a pinch of
-    salt as they may not represent correctly the system behaviour due
-    to experimental nature of used test methodology (see :ref:`reconf_tests`).
-
-In each test, a single service chain is added, the re-configuration
-contains all the steps the initial chains got, except the last step
-(starting VMs) is skipped.
-
-Additional information about graph data:
-
-#. **Graph Title**: describes tested VPP packet path. Format:
-
-   - wire encapsulation ``dot1qip4vlxan``,
-   - VPP forwarding mode ``l2bd``,
-   - total number {Y} of service chains ``{Y}ch``,
-   - total number of chains being reconfigured ``1ach``,
-   - total number of vhost-user interfaces forwarding packets on VPP with {Y}
-     chains and {X} VMs per chain ``{2XY}vh`` (2 interfaces per {X} VMs per {Y}
-     chains),
-   - total number {XY} of VNF VMs forwarding packets ``{XY}vm`` and finally
-   - VNF workload in VM ``testpmd``.
-
-#. **X-axis Labels**: indices of individual test suites as listed in
-   Graph Legend.
-
-#. **Y-axis Labels**: measured Implied time loss [s] values.
-
-#. **Graph Legend**: lists X-axis indices with associated CSIT test
-   suites executed to generate graphed test results and the average value and
-   standard deviation of measured packet loss in millions of packets.
-
-#. **Hover Information**: lists minimum, first quartile, median,
-   third quartile, and maximum. If either type of outlier is present the
-   whisker on the appropriate side is taken to 1.5×IQR from the quartile
-   (the "inner fence") rather than the max or min, and individual outlying
-   data points are displayed as unfilled circles (for suspected outliers)
-   or filled circles (for outliers). (The "outer fence" is 3×IQR from the
-   quartile.)
-
-.. note::
-
-    Test results have been generated by
-    `FD.io test executor vpp performance job 2n-skx`_ with RF
-    result files csit-vpp-perf-|srelease|-\*.zip
-    `archived here <../../_static/archive/>`_.
-
-.. raw:: latex
-
-    \clearpage
-
-2n-skx-xxv710
-~~~~~~~~~~~~~
-
-imix-2t1c-dot1qip4vxlan-l2bd
-----------------------------
-
-.. raw:: html
-
-    <center>
-    <iframe id="01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf.html"></iframe>
-    </center>
-
-.. raw:: latex
-
-    \begin{figure}[H]
-        \centering
-            \graphicspath{{../_build/_static/vpp/}}
-            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf}
-            \label{fig:2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf}
-    \end{figure}
-
-.. raw:: latex
-
-    \clearpage
-
-imix-4t2c-dot1qip4vxlan-l2bd
-----------------------------
-
-.. raw:: html
-
-    <center>
-    <iframe id="02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf.html"></iframe>
-    </center>
-
-.. raw:: latex
-
-    \begin{figure}[H]
-        \centering
-            \graphicspath{{../_build/_static/vpp/}}
-            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf}
-            \label{fig:2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf}
-    \end{figure}
-
-.. raw:: latex
-
-    \clearpage
-
-imix-8t4c-dot1qip4vxlan-l2bd
-----------------------------
-
-.. raw:: html
-
-    <center>
-    <iframe id="03" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf.html"></iframe>
-    </center>
-
-.. raw:: latex
-
-    \begin{figure}[H]
-        \centering
-            \graphicspath{{../_build/_static/vpp/}}
-            \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf}
-            \label{fig:2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf}
-    \end{figure}
+    **DISCLAIMER**: Previously, this page has been showing results
+    for reconf tests. They were using the traffic generator in a new way,
+    that turned out to be wrong. We have fixed the tests,
+    and re-run them on VPP 19.08.1 so look at the correct results
+    `here <https://docs.fd.io/csit/rls1908_1/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.html>`_.

diff --git a/resources/tools/presentation/conf.py b/resources/tools/presentation/conf.py
index bd85dee..a42fafc 100644 (file)
--- a/resources/tools/presentation/conf.py
+++ b/resources/tools/presentation/conf.py
@@ -45,7 +45,7 @@ source_suffix = ['.rst', '.md']
 master_doc = 'index'
 
 # General information about the project.
-report_week = '38'
+report_week = '40'
 project = u'FD.io CSIT-1908.{week}'.format(week=report_week)
 copyright = u'2019, FD.io'
 author = u'FD.io CSIT'

diff --git a/resources/tools/presentation/run_report.sh b/resources/tools/presentation/run_report.sh
index 24b6c21..dcca276 100755 (executable)
--- a/resources/tools/presentation/run_report.sh
+++ b/resources/tools/presentation/run_report.sh
@@ -38,7 +38,7 @@ export PYTHONPATH=`pwd`
 python pal.py \
     --specification specification.yaml \
     --release ${RELEASE} \
-    --week "38" \
+    --week "40" \
     --logging INFO \
     --force