X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fintroduction%2Foverview.rst;h=2d5a1e06716cd78564679ea4be2b32990f0d5920;hb=ceb7c2545cda1bc7fe3d4bf35cdf75253efe8c6d;hp=180e73ff570b86cf630540d40a070f94dc302850;hpb=bbcaa22c4425c32c3e3d2bcde434cdefc6b9a992;p=csit.git diff --git a/docs/report/introduction/overview.rst b/docs/report/introduction/overview.rst index 180e73ff57..2d5a1e0671 100644 --- a/docs/report/introduction/overview.rst +++ b/docs/report/introduction/overview.rst @@ -5,6 +5,9 @@ This is the **F**\ast **D**\ata **I**/**O** Project (**FD.io**) **C**\ontinuous **S**\ystem **I**\ntegration and **T**\esting (**CSIT**) project report for CSIT |release| system testing of |vpp-release|. +This is the full html version, there is also a reduced +`PDF version of this report`_. + The report describes CSIT functional and performance tests and their continuous execution delivered in CSIT |release|. A high-level overview is provided for each CSIT test environment running in :abbr:`LF (Linux Foundation)` @@ -30,8 +33,11 @@ CSIT |release| report contains following main sections and sub-sections: tests, performance changes, environment or methodology changes, known CSIT issues; *Packet Throughput Graphs* and *Packet Latency Graphs* - plotted NDR, PDR throughput and latency results from multiple - test job executions; *Test Environment* - environment description; - *Documentation* - CSIT source code documentation for VPP performance tests. + test job executions; *Throughput Speedup Multi-Core* - plotted core + configuration speedup comparision; *Test Environment* - environment + description; *VPP HTTP Server Performance Results* - plotted HTTP Server + performance; *Documentation* - CSIT source code documentation for VPP + performance tests. #. **DPDK Performance Tests** - DPDK performance tests executed in physical FD.io testbeds; *Overview* - tested topologies, test coverage; @@ -55,19 +61,6 @@ CSIT |release| report contains following main sections and sub-sections: *Test Environment* - environment description ; *Documentation* - source code documentation for Honeycomb functional tests. -#. **Honeycomb Performance Tests** - Honeycomb performance tests executed in - physical FD.io testbeds; *Overview* - tested topologies, test - coverage and naming specifics; *CSIT Release Notes* - changes in CSIT - |release|, added tests, environment or methodology changes, known CSIT issues; - *Test Environment* - environment description ; - *Documentation* - source code documentation for Honeycomb performance tests. - -#. **VPP Unit Tests** - refers to VPP functional unit tests executed as - part of vpp make test verify option within the FD.io VPP project; listed in - this report to give a more complete view about executed VPP functional tests; - *Overview* - short overview of unit test framework and executed tests; - *Documentation* - source code documentation of VPP unit tests. - #. **NSH_SFC Functional Tests** - NSH_SFC functional tests executed in virtual FD.io testbeds; *Overview* - tested virtual topologies, test coverage and naming specifics; *CSIT Release Notes* - changes in CSIT @@ -87,3 +80,8 @@ CSIT |release| report contains following main sections and sub-sections: #. **Test Operational Data** - auto-generated DUT operational data from CSIT jobs executions using CSIT Robot Framework output files as source data; *VPP Performance Operational Data*. + +#. **CSIT Framework Documentation** - description of the overall CSIT + framework design hierarchy, CSIT test naming convention, followed by + description of Presentation and Analytics Layer (PAL) introduced in + CSIT |release|. \ No newline at end of file