-**S**\ystem **I**\ntegration and **T**\esting (**CSIT**) project report for CSIT
-|release| system testing of |vpp-release|.
+**S**\ystem **I**\ntegration and **T**\esting (**CSIT**) project report for
+|csit-release| system testing of |vpp-release|.
This is the full html version, there is also a reduced
`PDF version of this report`_.
The report describes CSIT functional and performance tests and their
This is the full html version, there is also a reduced
`PDF version of this report`_.
The report describes CSIT functional and performance tests and their
provided for each CSIT test environment running in :abbr:`LF (Linux Foundation)`
FD.io Continuous Performance Labs. This is followed by summary of all executed
tests against the |vpp-release| and associated FD.io projects and sub-systems
provided for each CSIT test environment running in :abbr:`LF (Linux Foundation)`
FD.io Continuous Performance Labs. This is followed by summary of all executed
tests against the |vpp-release| and associated FD.io projects and sub-systems
-(Honeycomb, DPDK, NSH_SFC), CSIT |release| release notes, result highlights and
+(Honeycomb, DPDK, NSH_SFC), |csit-release| release notes, result highlights and
known issues discovered in CSIT. More detailed description of each environment,
pointers to CSIT test code documentation and detailed test resuls with links to
the source data files are also provided.
known issues discovered in CSIT. More detailed description of each environment,
pointers to CSIT test code documentation and detailed test resuls with links to
the source data files are also provided.
- this section; *CSIT Test Naming* - CSIT general naming convention for test
- suites and test cases, important to recognize the high-level test content
- and interpret reported results; *General Notes* - general notes related to
- this report.
+ this section; *General Notes* - general notes related to this report;
+ *Physical Testbeds* - Description of physical testbeds used in CSIT;
+ *Performance Test Methodology* - Methodologies used in CSIT.
FD.io testbeds; *Overview* - tested topologies, test coverage and naming
specifics, methodology for multi-core, packet throughput and latency, and
FD.io testbeds; *Overview* - tested topologies, test coverage and naming
specifics, methodology for multi-core, packet throughput and latency, and
tests, performance changes, environment or methodology changes, known CSIT
issues; *Packet Throughput Graphs* and *Packet Latency
Graphs* - plotted NDR, PDR throughput and latency results from multiple
tests, performance changes, environment or methodology changes, known CSIT
issues; *Packet Throughput Graphs* and *Packet Latency
Graphs* - plotted NDR, PDR throughput and latency results from multiple
*Packet Throughput Graphs* and *Packet Latency Graphs*
- plotted NDR, PDR throughput and latency results from multiple test job
executions; *Test Environment* - environment description; *Documentation* -
CSIT source code documentation for DPDK performance tests.
*Packet Throughput Graphs* and *Packet Latency Graphs*
- plotted NDR, PDR throughput and latency results from multiple test job
executions; *Test Environment* - environment description; *Documentation* -
CSIT source code documentation for DPDK performance tests.
tests, environment or methodology changes, known CSIT issues, tests to be
added; *Test Environment* - environment description ; *Documentation* -
source code documentation for VPP functional tests.
tests, environment or methodology changes, known CSIT issues, tests to be
added; *Test Environment* - environment description ; *Documentation* -
source code documentation for VPP functional tests.
virtual FD.io testbeds; *Overview* - tested virtual topologies, test
coverage and naming specifics; *CSIT Release Notes* - changes in CSIT
|release|, added tests, environment or methodology changes, known CSIT issues;
virtual FD.io testbeds; *Overview* - tested virtual topologies, test
coverage and naming specifics; *CSIT Release Notes* - changes in CSIT
|release|, added tests, environment or methodology changes, known CSIT issues;
virtual FD.io testbeds; *Overview* - tested virtual topologies, test
coverage and naming specifics; *CSIT Release Notes* - changes in CSIT
|release|, added tests, environment or methodology changes, known CSIT issues;
virtual FD.io testbeds; *Overview* - tested virtual topologies, test
coverage and naming specifics; *CSIT Release Notes* - changes in CSIT
|release|, added tests, environment or methodology changes, known CSIT issues;
executions using CSIT Robot Framework output files as source data; *VPP
Performance Results*, *DPDK Performance Results*, *VPP Functional
Results*, *Honeycomb Functional Results*, *VPPtest Functional Results*.
executions using CSIT Robot Framework output files as source data; *VPP
Performance Results*, *DPDK Performance Results*, *VPP Functional
Results*, *Honeycomb Functional Results*, *VPPtest Functional Results*.
#. **CSIT Framework Documentation** - description of the overall CSIT
framework design hierarchy, CSIT test naming convention, followed by
description of Presentation and Analytics Layer (PAL) introduced in
#. **CSIT Framework Documentation** - description of the overall CSIT
framework design hierarchy, CSIT test naming convention, followed by
description of Presentation and Analytics Layer (PAL) introduced in