X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fintroduction%2Foverview.rst;h=30f62a90e2153e16b6ecbab8b9759c602db34249;hp=ee1a91c174c878acfc00ce4868cab0ad8bc3e862;hb=10649b3ce07bbb3144d196c403d8c1fa65ddf116;hpb=da2aa127ee071e37bc4d6060dd39476179e65365 diff --git a/docs/report/introduction/overview.rst b/docs/report/introduction/overview.rst index ee1a91c174..30f62a90e2 100644 --- a/docs/report/introduction/overview.rst +++ b/docs/report/introduction/overview.rst @@ -3,17 +3,17 @@ Overview This is the **F**\ast **D**\ata **I**/**O** Project (**FD.io**) **C**\ontinuous **S**\ystem **I**\ntegration and **T**\esting (**CSIT**) project report for CSIT -|release| system testing of VPP-17.01 release. +|release| system testing of |vpp-release|. The report describes CSIT functional and performance tests and their continuous execution delivered in CSIT |release|. A high-level overview is provided for each CSIT test environment running in Linux Foundation (LF) FD.io Continuous Performance Labs. This is followed by summary of all executed tests -against the VPP-17.01 release and associated sub-systems (HoneyComb, DPDK), -CSIT |release| release notes, result highlights and known issues. More -detailed description of each environment, pointers to CSIT test code -documentation and detailed test resuls with links to the source data files are -also provided. +against the |vpp-release| and associated FD.io projects and sub-systems +(HoneyComb, DPDK), CSIT |release| release notes, result highlights and known +issues discovered in CSIT. More detailed description of each environment, +pointers to CSIT test code documentation and detailed test resuls with links to +the source data files are also provided. CSIT |release| report contains following main sections and sub-sections: @@ -28,19 +28,18 @@ CSIT |release| report contains following main sections and sub-sections: specifics, methodology for multi-core, packet throughput and latency, and KVM VM vhost tests; *CSIT Release Notes* - changes in CSIT |release|, added tests, performance changes, environment or methodology changes, known CSIT - issues, tests to be added; *Packet Throughput Graphs* and *Packet Latency + issues; *Packet Throughput Graphs* and *Packet Latency Graphs* - plotted NDR, PDR throughput and latency results from multiple - test job executions; *Test Environment* - environment description ; - *Documentation* - source code documentation for VPP performance tests. + test job executions; *Test Environment* - environment description; + *Documentation* - CSIT source code documentation for VPP performance tests. #. **Testpmd Performance Tests** - Testpmd performance tests executed in physical FD.io testbeds; *Overview* - tested topologies, test coverage; *CSIT Release Notes* - changes in CSIT |release|, any known CSIT issues; - *Tests to Be Added* - performance tests to be added in the next revision of - CSIT |release| report; *Packet Throughput Graphs* and *Packet Latency Graphs* + *Packet Throughput Graphs* and *Packet Latency Graphs* - plotted NDR, PDR throughput and latency results from multiple test job executions; *Test Environment* - environment description; *Documentation* - - source code documentation for Testpmd performance tests. + CSIT source code documentation for Testpmd performance tests. #. **VPP Functional Tests** - VPP functional tests executed in virtual FD.io testbeds; *Overview* - tested virtual topologies, test coverage and @@ -52,8 +51,8 @@ CSIT |release| report contains following main sections and sub-sections: #. **HoneyComb Functional Tests** - HoneyComb functional tests executed in virtual FD.io testbeds; *Overview* - tested virtual topologies, test coverage and naming specifics; *CSIT Release Notes* - changes in CSIT - |release|, added tests, environment or methodology changes, known CSIT issues, - tests to be added; *Test Environment* - environment description ; + |release|, added tests, environment or methodology changes, known CSIT issues; + *Test Environment* - environment description ; *Documentation* - source code documentation for Honeycomb functional tests. #. **VPP Unit Tests** - refers to VPP functional unit tests executed as @@ -66,3 +65,11 @@ CSIT |release| report contains following main sections and sub-sections: executions using CSIT Robot Framework output files as source data; *VPP Performance Results*, *Testpmd Performance Results*, *VPP Functional Results*, *HoneyComb Functional Results*, *VPPtest Functional Results*. + +#. **Test Configuration** - auto-generated DUT configuration data from CSIT jobs + executions using CSIT Robot Framework output files as source data; *VPP + Performance Test Configs*, *VPP Functional Test Configs*. + +#. **Test Operational Data** - auto-generated DUT operational data from CSIT jobs + executions using CSIT Robot Framework output files as source data; *VPP + Performance Operational Data*.