X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fintroduction%2Fintroduction.rst;h=35b819d9e59b322a9482aa77fe3d345a03ac4e01;hp=d7897743cb3e0dcac70809f68bfb279aeb9b004d;hb=6533fa595faa39f3b966cc6ee82e99aa48c9a806;hpb=9c38db0a5c7721c1193aebc60e9d3c5e3a351310 diff --git a/docs/report/introduction/introduction.rst b/docs/report/introduction/introduction.rst index d7897743cb..35b819d9e5 100644 --- a/docs/report/introduction/introduction.rst +++ b/docs/report/introduction/introduction.rst @@ -32,13 +32,15 @@ available for download. executions. - **Soak Tests**: Long duration soak tests are executed using PLRsearch algorithm. + - **NFV Service Density**: Network Function Virtualization (NFV) service + density tests focus on measuring total per server throughput at varied NFV + service "packing" densities with vswitch providing host dataplane. - **Comparisons**: Performance comparisons between VPP releases and between different testbed types. - **Throughput Trending**: References to continuous VPP performance trending. - **Test Environment**: Performance test environment configuration. - - **Documentation**: Documentation of K8s Pod/Container orchestration - in CSIT and pointers to CSIT source code documentation for VPP + - **Documentation**: Pointers to CSIT source code documentation for VPP performance tests. #. DPDK PERFORMANCE: DPDK performance tests executed in physical @@ -59,6 +61,20 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for DPDK performance tests. +#. TREX PERFORMANCE: TREX performance tests executed in physical + FD.io testbeds. + + - **Overview**: Tested logical topologies, test coverage. + - **Release Notes**: Changes in |csit-release|, known issues. + - **Packet Throughput**: NDR, PDR throughput graphs based on results + from repeated same test job executions to verify repeatibility of + measurements. + - **Packet Latency**: Latency graphs based on results from test job + executions. + - **Throughput Trending**: References to regular TREX performance + trending. + - **Test Environment**: Performance test environment configuration. + #. VPP DEVICE: VPP functional tests executed in physical FD.io testbeds using containers. @@ -70,50 +86,14 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for VPP functional tests. -#. VPP FUNCTIONAL: VPP functional tests executed in virtual FD.io - testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, added tests, - environment or methodology changes, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - VPP functional tests. - -#. HONEYCOMB FUNCTIONAL: Honeycomb functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - Honeycomb functional tests. - -#. DMM FUNCTIONAL: DMM functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - DMM functional tests. - #. DETAILED RESULTS: Detailed result tables auto-generated from CSIT test job executions using RF (Robot Framework) output files as sources. - **VPP Performance NDR/PDR**: VPP NDR/PDR throughput and latency. - **VPP Performance MRR**: VPP MRR throughput. - - **VPP K8s Container Memif**: VPP K8s Container/Pod topologies - NDR/PDR throughput. - **DPDK Performance**: DPDK Testpmd and L3fwd NDR/PDR throughput and latency. - - **VPP Functional**: Detailed VPP functional results. - - **Honeycomb Functional**: Detailed HoneyComb functional results. - - **DMM Functional**: Detailed DMM functional results. #. TEST CONFIGURATION: VPP DUT configuration data based on VPP API Test (VAT) Commands History auto-generated from CSIT test job @@ -121,8 +101,6 @@ available for download. - **VPP Performance NDR/PDR**: Configuration data. - **VPP Performance MRR**: Configuration data. - - **VPP K8s Container Memif**: Configuration data. - - **VPP Functional**: Configuration data. #. TEST OPERATIONAL DATA: VPP DUT operational data auto-generated from CSIT test job executions using RFoutput files as sources. @@ -139,14 +117,3 @@ available for download. analytics module. - **CSIT RF Tags Descriptions**: CSIT RF Tags used for test suite and test case grouping and selection. - -.. - #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - NSH_SFC functional tests.