Report: add data 29/17729/1
authorTibor Frank <tifrank@cisco.com>
Wed, 20 Feb 2019 13:57:51 +0000 (14:57 +0100)
committerTibor Frank <tifrank@cisco.com>
Wed, 20 Feb 2019 16:02:17 +0000 (16:02 +0000)
Change-Id: I7387bdea66f8ddc58740908b2c69fc6b27b2b01c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit feec48e01c729f4c719c1947429e1d0c3b0fcccb)

docs/report/introduction/introduction.rst
docs/report/introduction/report_history.rst
docs/report/introduction/test_scenarios_overview.rst
resources/tools/presentation/specification.yaml

index 7ccc270..c5f37a6 100644 (file)
@@ -96,17 +96,6 @@ available for download.
    - **Documentation**: Pointers to CSIT source code documentation for
      Honeycomb functional tests.
 
-..
-    #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in
-       virtual FD.io testbeds.
-
-       - **Overview**: Tested virtual topologies, test coverage and naming
-         specifics;
-       - **Release Notes**: Changes in |csit-release|, known issues.
-       - **Test Environment**: Functional test environment configuration.
-       - **Documentation**: Pointers to CSIT source code documentation for
-         NSH_SFC functional tests.
-
 #. DMM FUNCTIONAL: DMM functional tests executed in
    virtual FD.io testbeds.
 
@@ -155,3 +144,14 @@ available for download.
      analytics module.
    - **CSIT RF Tags Descriptions**: CSIT RF Tags used for test suite and
      test case grouping and selection.
+
+..
+    #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in
+       virtual FD.io testbeds.
+
+       - **Overview**: Tested virtual topologies, test coverage and naming
+         specifics;
+       - **Release Notes**: Changes in |csit-release|, known issues.
+       - **Test Environment**: Functional test environment configuration.
+       - **Documentation**: Pointers to CSIT source code documentation for
+         NSH_SFC functional tests.
index eb16e9f..62b0e7f 100644 (file)
@@ -11,17 +11,19 @@ FD.io CSIT-1901 Report history and per .[ww] revision changes are listed below.
 |                |    a. VPP on 3n-hsw testbed,                               |
 |                |    b. VPP on 3n-skx testbed,                               |
 |                |    c. VPP on 2n-skx testbed,                               |
-|                |    d. DPDK on 3n-hsw testbed,                              |
-|                |    e. DPDK on 3n-skx testbed,                              |
-|                |    f. DPDK on 2n-skx testbed,                              |
-|                |    g. VPP K8s Container Memif on 3n-hsw testbed,           |
-|                |    h. NFV VPP tests on 2n-skx testbed.                     |
+|                |    d. VPP functional,                                      |
+|                |    e. DPDK on 3n-hsw testbed,                              |
+|                |    f. DPDK on 3n-skx testbed,                              |
+|                |    g. DPDK on 2n-skx testbed,                              |
+|                |    h. VPP K8s Container Memif on 3n-hsw testbed,           |
+|                |    i. NFV VPP tests on 2n-skx testbed.                     |
 |                |                                                            |
 |                | 2. Methodology updated:                                    |
 |                |                                                            |
 |                |    a. :ref:`PLRsearch algorithm`                           |
 |                |                                                            |
 |                | 3. Removed Denverton.                                      |
+|                | 4. Removed NSH_SFC.                                        |
 |                |                                                            |
 +----------------+------------------------------------------------------------+
 | .07            | Initial version                                            |
index 02eff7d..2bf066e 100644 (file)
@@ -60,16 +60,16 @@ Brief overview of test scenarios covered in this report:
    programming functionality of VPP. Tests cover a range of CRUD
    operations executed against VPP.
 
-..
-    #. **NSH_SFC Functional**: NSH_SFC functional tests are executed in
-       virtual FD.io testbeds focusing on VPP nsh-plugin data plane
-       functionality. Scapy is used as a traffic generator.
-
 #. **DMM Functional**: DMM functional tests are executed in virtual
    FD.io testbeds demonstrating a single server (DUT1) and single
    client (DUT2) scenario using DMM framework and Linux kernel TCP/IP
    stack.
 
+..
+    #. **NSH_SFC Functional**: NSH_SFC functional tests are executed in
+       virtual FD.io testbeds focusing on VPP nsh-plugin data plane
+       functionality. Scapy is used as a traffic generator.
+
 All CSIT test data included in this report is auto-
 generated from :abbr:`RF (Robot Framework)` :file:`output.xml` files
 produced by :abbr:`LF (Linux Foundation)` FD.io Jenkins jobs executed
index 36e4081..ac9583c 100644 (file)
         - 12  # NDRPDR sel
         - 13  # NDRPDR sel
         - 14  # NDRPDR sel
+        - 16  # NDRPDR sel
 
     plot-ligato-throughput-speedup-analysis-3n-hsw:
       # TODO: Add new data
         - 12  # NDRPDR sel
         - 13  # NDRPDR sel
         - 14  # NDRPDR sel
+        - 16  # NDRPDR sel
 
     plot-dpdk-throughput-latency-3n-hsw:
       csit-dpdk-perf-verify-1901-3n-hsw:
     # Results
 
     vpp-perf-results-3n-hsw:
-      # TODO: Add FULL data
       csit-vpp-perf-verify-1901-3n-hsw:
         - 38  # NDRPDR full
         - 43  # NDRPDR full
         - 45  # NDRPDR full
+        - 49  # NDRPDR full
 
     vpp-perf-results-3n-skx:
       csit-vpp-perf-verify-1901-3n-skx:
       - 38  # NDRPDR full
       - 43  # NDRPDR full
       - 45  # NDRPDR full
+      - 49  # NDRPDR full
       - 10  # NDRPDR sel
       - 19  # NDRPDR sel
       - 31  # NDRPDR sel
       - 12  # NDRPDR sel
       - 13  # NDRPDR sel
       - 14  # NDRPDR sel
+      - 16  # NDRPDR sel
     csit-dpdk-perf-verify-1807-3n-hsw:
       - 11
       - 12  # full