X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fintroduction%2Fintroduction.rst;h=80f926e83a4eb1528a28353a275ee912286501b3;hp=e08edc048671c9c373d3fdc060e725ed89cda58b;hb=4c8b382e0034ed2660d749cbd01d5b304aeb54bc;hpb=0546e1656070b734ec57a4d8f732392bcafee0df diff --git a/docs/report/introduction/introduction.rst b/docs/report/introduction/introduction.rst index e08edc0486..80f926e83a 100644 --- a/docs/report/introduction/introduction.rst +++ b/docs/report/introduction/introduction.rst @@ -1,20 +1,20 @@ -Introduction -============ +Report Structure +================ FD.io |csit-release| report contains system performance and functional -testing data for |vpp-release|. - -`PDF version of this report`_ is also available for download. +testing data of |vpp-release|. `PDF version of this report`_ is +available for download. |csit-release| report is structured as follows: -#. INTRODUCTION: General introduction to CSIT project. +#. INTRODUCTION: General introduction to FD.io |csit-release|. - **Introduction**: This section. - **Test Scenarios Overview**: A brief overview of test scenarios covered in this report. - **Physical Testbeds**: Description of physical testbeds. - - **Performance Test Methodology**: Benchmarking methodologies. + - **Test Methodology**: Performance benchmarking and functional test + methodologies. #. VPP PERFORMANCE: VPP performance tests executed in physical FD.io testbeds. @@ -26,10 +26,15 @@ testing data for |vpp-release|. - **Packet Throughput**: NDR, PDR throughput graphs based on results from repeated same test job executions to verify repeatibility of measurements. - - **Packet Latency**: Latency graphs based on results from test job - executions. - **Speedup Multi-Core**: NDR, PDR throughput multi-core speedup graphs based on results from test job executions. + - **Packet Latency**: Latency graphs based on results from test job + executions. + - **Soak Tests**: Long duration soak tests are executed using PLRsearch + algorithm. + - **NFV Service Density**: Network Function Virtualization (NFV) service + density tests focus on measuring total per server throughput at varied NFV + service "packing" densities with vswitch providing host dataplane. - **HTTP/TCP Performance**: HTTP/TCP VPP test server performance graphs. - **Comparisons**: Performance comparisons between VPP releases and @@ -59,6 +64,17 @@ testing data for |vpp-release|. - **Documentation**: Pointers to CSIT source code documentation for DPDK performance tests. +#. VPP DEVICE: VPP functional tests executed in physical FD.io + testbeds using containers. + + - **Overview**: Tested virtual topologies, test coverage and naming + specifics; + - **Release Notes**: Changes in |csit-release|, added tests, + environment or methodology changes, known issues. + - **Integration Tests**: Functional test environment configuration. + - **Documentation**: Pointers to CSIT source code documentation for + VPP functional tests. + #. VPP FUNCTIONAL: VPP functional tests executed in virtual FD.io testbeds. @@ -70,7 +86,7 @@ testing data for |vpp-release|. - **Documentation**: Pointers to CSIT source code documentation for VPP functional tests. -#. HONEYCOMBE FUNCTIONAL: Honeycomb functional tests executed in +#. HONEYCOMB FUNCTIONAL: Honeycomb functional tests executed in virtual FD.io testbeds. - **Overview**: Tested virtual topologies, test coverage and naming