From feec48e01c729f4c719c1947429e1d0c3b0fcccb Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Wed, 20 Feb 2019 14:57:51 +0100 Subject: [PATCH] Report: add data Change-Id: I7387bdea66f8ddc58740908b2c69fc6b27b2b01c Signed-off-by: Tibor Frank --- docs/report/introduction/introduction.rst | 22 +++++++++++----------- docs/report/introduction/report_history.rst | 12 +++++++----- .../introduction/test_scenarios_overview.rst | 10 +++++----- resources/tools/presentation/specification.yaml | 6 +++++- 4 files changed, 28 insertions(+), 22 deletions(-) diff --git a/docs/report/introduction/introduction.rst b/docs/report/introduction/introduction.rst index 7ccc270c76..c5f37a68e7 100644 --- a/docs/report/introduction/introduction.rst +++ b/docs/report/introduction/introduction.rst @@ -96,17 +96,6 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for Honeycomb functional tests. -.. - #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - NSH_SFC functional tests. - #. DMM FUNCTIONAL: DMM functional tests executed in virtual FD.io testbeds. @@ -155,3 +144,14 @@ available for download. analytics module. - **CSIT RF Tags Descriptions**: CSIT RF Tags used for test suite and test case grouping and selection. + +.. + #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in + virtual FD.io testbeds. + + - **Overview**: Tested virtual topologies, test coverage and naming + specifics; + - **Release Notes**: Changes in |csit-release|, known issues. + - **Test Environment**: Functional test environment configuration. + - **Documentation**: Pointers to CSIT source code documentation for + NSH_SFC functional tests. diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index eb16e9fd49..62b0e7f4f4 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -11,17 +11,19 @@ FD.io CSIT-1901 Report history and per .[ww] revision changes are listed below. | | a. VPP on 3n-hsw testbed, | | | b. VPP on 3n-skx testbed, | | | c. VPP on 2n-skx testbed, | -| | d. DPDK on 3n-hsw testbed, | -| | e. DPDK on 3n-skx testbed, | -| | f. DPDK on 2n-skx testbed, | -| | g. VPP K8s Container Memif on 3n-hsw testbed, | -| | h. NFV VPP tests on 2n-skx testbed. | +| | d. VPP functional, | +| | e. DPDK on 3n-hsw testbed, | +| | f. DPDK on 3n-skx testbed, | +| | g. DPDK on 2n-skx testbed, | +| | h. VPP K8s Container Memif on 3n-hsw testbed, | +| | i. NFV VPP tests on 2n-skx testbed. | | | | | | 2. Methodology updated: | | | | | | a. :ref:`PLRsearch algorithm` | | | | | | 3. Removed Denverton. | +| | 4. Removed NSH_SFC. | | | | +----------------+------------------------------------------------------------+ | .07 | Initial version | diff --git a/docs/report/introduction/test_scenarios_overview.rst b/docs/report/introduction/test_scenarios_overview.rst index 02eff7de9f..2bf066e829 100644 --- a/docs/report/introduction/test_scenarios_overview.rst +++ b/docs/report/introduction/test_scenarios_overview.rst @@ -60,16 +60,16 @@ Brief overview of test scenarios covered in this report: programming functionality of VPP. Tests cover a range of CRUD operations executed against VPP. -.. - #. **NSH_SFC Functional**: NSH_SFC functional tests are executed in - virtual FD.io testbeds focusing on VPP nsh-plugin data plane - functionality. Scapy is used as a traffic generator. - #. **DMM Functional**: DMM functional tests are executed in virtual FD.io testbeds demonstrating a single server (DUT1) and single client (DUT2) scenario using DMM framework and Linux kernel TCP/IP stack. +.. + #. **NSH_SFC Functional**: NSH_SFC functional tests are executed in + virtual FD.io testbeds focusing on VPP nsh-plugin data plane + functionality. Scapy is used as a traffic generator. + All CSIT test data included in this report is auto- generated from :abbr:`RF (Robot Framework)` :file:`output.xml` files produced by :abbr:`LF (Linux Foundation)` FD.io Jenkins jobs executed diff --git a/resources/tools/presentation/specification.yaml b/resources/tools/presentation/specification.yaml index 36e40814bf..ac9583cbe6 100644 --- a/resources/tools/presentation/specification.yaml +++ b/resources/tools/presentation/specification.yaml @@ -181,6 +181,7 @@ - 12 # NDRPDR sel - 13 # NDRPDR sel - 14 # NDRPDR sel + - 16 # NDRPDR sel plot-ligato-throughput-speedup-analysis-3n-hsw: # TODO: Add new data @@ -191,6 +192,7 @@ - 12 # NDRPDR sel - 13 # NDRPDR sel - 14 # NDRPDR sel + - 16 # NDRPDR sel plot-dpdk-throughput-latency-3n-hsw: csit-dpdk-perf-verify-1901-3n-hsw: @@ -376,11 +378,11 @@ # Results vpp-perf-results-3n-hsw: - # TODO: Add FULL data csit-vpp-perf-verify-1901-3n-hsw: - 38 # NDRPDR full - 43 # NDRPDR full - 45 # NDRPDR full + - 49 # NDRPDR full vpp-perf-results-3n-skx: csit-vpp-perf-verify-1901-3n-skx: @@ -1366,6 +1368,7 @@ - 38 # NDRPDR full - 43 # NDRPDR full - 45 # NDRPDR full + - 49 # NDRPDR full - 10 # NDRPDR sel - 19 # NDRPDR sel - 31 # NDRPDR sel @@ -1509,6 +1512,7 @@ - 12 # NDRPDR sel - 13 # NDRPDR sel - 14 # NDRPDR sel + - 16 # NDRPDR sel csit-dpdk-perf-verify-1807-3n-hsw: - 11 - 12 # full -- 2.16.6