X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fintroduction%2Fintroduction.rst;h=35b819d9e59b322a9482aa77fe3d345a03ac4e01;hp=5470cca4e9df8f955bc6264ab275be820c08f26b;hb=6533fa595faa39f3b966cc6ee82e99aa48c9a806;hpb=4dc14417a7c412520121178dd184eecaf292c5e1 diff --git a/docs/report/introduction/introduction.rst b/docs/report/introduction/introduction.rst index 5470cca4e9..35b819d9e5 100644 --- a/docs/report/introduction/introduction.rst +++ b/docs/report/introduction/introduction.rst @@ -61,6 +61,20 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for DPDK performance tests. +#. TREX PERFORMANCE: TREX performance tests executed in physical + FD.io testbeds. + + - **Overview**: Tested logical topologies, test coverage. + - **Release Notes**: Changes in |csit-release|, known issues. + - **Packet Throughput**: NDR, PDR throughput graphs based on results + from repeated same test job executions to verify repeatibility of + measurements. + - **Packet Latency**: Latency graphs based on results from test job + executions. + - **Throughput Trending**: References to regular TREX performance + trending. + - **Test Environment**: Performance test environment configuration. + #. VPP DEVICE: VPP functional tests executed in physical FD.io testbeds using containers. @@ -72,27 +86,6 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for VPP functional tests. -#. VPP FUNCTIONAL: VPP functional tests executed in virtual FD.io - testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, added tests, - environment or methodology changes, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - VPP functional tests. - -#. HONEYCOMB FUNCTIONAL: Honeycomb functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - Honeycomb functional tests. - #. DETAILED RESULTS: Detailed result tables auto-generated from CSIT test job executions using RF (Robot Framework) output files as sources. @@ -101,8 +94,6 @@ available for download. - **VPP Performance MRR**: VPP MRR throughput. - **DPDK Performance**: DPDK Testpmd and L3fwd NDR/PDR throughput and latency. - - **VPP Functional**: Detailed VPP functional results. - - **Honeycomb Functional**: Detailed HoneyComb functional results. #. TEST CONFIGURATION: VPP DUT configuration data based on VPP API Test (VAT) Commands History auto-generated from CSIT test job @@ -110,7 +101,6 @@ available for download. - **VPP Performance NDR/PDR**: Configuration data. - **VPP Performance MRR**: Configuration data. - - **VPP Functional**: Configuration data. #. TEST OPERATIONAL DATA: VPP DUT operational data auto-generated from CSIT test job executions using RFoutput files as sources. @@ -127,24 +117,3 @@ available for download. analytics module. - **CSIT RF Tags Descriptions**: CSIT RF Tags used for test suite and test case grouping and selection. - -.. - #. DMM FUNCTIONAL: DMM functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - DMM functional tests. - - #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - NSH_SFC functional tests.