CSIT 1701 report files and script AD1

[csit.git] / docs / report / testpmd_performance_tests_hw / overview.rst

diff --git a/docs/report/testpmd_performance_tests_hw/overview.rst b/docs/report/testpmd_performance_tests_hw/overview.rst
index 5bd81ab..4ef3982 100644 (file)
--- a/docs/report/testpmd_performance_tests_hw/overview.rst
+++ b/docs/report/testpmd_performance_tests_hw/overview.rst
@@ -1,11 +1,13 @@
 Overview
 ========
 
 Overview
 ========
 

-Testpmd Performance Test Topologies
------------------------------------
+Tested Topologies HW
+--------------------

 
 CSIT Testpmd performance tests are executed on physical baremetal servers hosted
 
 CSIT Testpmd performance tests are executed on physical baremetal servers hosted

-by LF FD.io project. Testbed physical topology is shown in the figure below.::
+by LF FD.io project. Testbed physical topology is shown in the figure below.
+
+::

 
     +------------------------+           +------------------------+
     |                        |           |                        |
 
     +------------------------+           +------------------------+
     |                        |           |                        |


@@ -25,13 +27,14 @@ by LF FD.io project. Testbed physical topology is shown in the figure below.::
                              |           |
                              +-----------+
 
                              |           |
                              +-----------+
 

-SUT1 and SUT2 are two System Under Test servers (Cisco UCS C240, each with two
-Intel XEON CPUs), TG is a Traffic Generator (TG, another Cisco UCS C240, with
-two Intel XEON CPUs). SUTs run Testpmd SW application in Linux user-mode as a
-Device Under Test (DUT). TG runs TRex SW application as a packet Traffic
-Generator. Physical connectivity between SUTs and to TG is provided using
-different NIC models that need to be tested for performance. Currently
-installed and tested NIC models include:
+SUT1 and SUT2 are two System Under Test servers (currently Cisco UCS C240,
+each with two Intel XEON CPUs), TG is a Traffic Generator (TG, currently
+another Cisco UCS C240, with two Intel XEON CPUs). SUTs run Testpmd SW
+application in Linux user-mode as a Device Under Test (DUT). TG runs TRex SW
+application as a packet Traffic Generator. Physical connectivity between SUTs
+and to TG is provided using direct links (no L2 switches) connecting different
+NIC models that need to be tested for performance. Currently installed and
+tested NIC models include:

 
 #. 2port10GE X520-DA2 Intel.
 #. 2port10GE X710 Intel.
 
 #. 2port10GE X520-DA2 Intel.
 #. 2port10GE X710 Intel.


@@ -39,26 +42,39 @@ installed and tested NIC models include:
 #. 2port40GE VIC1385 Cisco.
 #. 2port40GE XL710 Intel.
 
 #. 2port40GE VIC1385 Cisco.
 #. 2port40GE XL710 Intel.
 

-Detailed LF FD.io test bed specification and topology is described on `CSIT LF
-testbed wiki page <https://wiki.fd.io/view/CSIT/CSIT_LF_testbed>`_.
+Detailed LF FD.io test bed specification and topology is described in
+`wiki CSIT LF testbed <https://wiki.fd.io/view/CSIT/CSIT_LF_testbed>`_.

 
 

-Testpmd Performance Tests Overview
-----------------------------------
+Testing Summary
+---------------

 
 

-Performance tests are split into two main categories:
+Performance tests are split into the two main categories:

 
 - Throughput discovery - discovery of packet forwarding rate using binary search
 
 - Throughput discovery - discovery of packet forwarding rate using binary search

-  in accordance to RFC2544.
+  in accordance with RFC2544.

 
 

-  - NDR - discovery of Non Drop Rate, zero packet loss.
-  - PDR - discovery of Partial Drop Rate, with specified non-zero packet loss.
+  - NDR - discovery of Non Drop Rate packet throughput, at zero packet loss;
+    followed by packet one-way latency measurements at 10%, 50% and 100% of
+    discovered NDR throughput.
+  - PDR - discovery of Partial Drop Rate, with specified non-zero packet loss
+    currently set to 0.5%; followed by packet one-way latency measurements at
+    100% of discovered PDR throughput.

 
 - Throughput verification - verification of packet forwarding rate against
 
 - Throughput verification - verification of packet forwarding rate against

-  previously discovered throughput rate. These tests are currently done against
+  previously discovered NDR throughput. These tests are currently done against

   0.9 of reference NDR, with reference rates updated periodically.
 
   0.9 of reference NDR, with reference rates updated periodically.
 

-CSIT |release| includes following performance test suites:
+CSIT |release| includes following performance test suites, listed per NIC type:

 
 - 2port10GE X520-DA2 Intel
 
 
 - 2port10GE X520-DA2 Intel
 

-  - **L2XC** - L2 Cross-Connect forwarding of untagged Ethernet frames.
+  - **L2IntLoop** - L2 Interface Loop forwarding any Ethernet frames between
+    two Interfaces.
+
+Execution of performance tests takes time, especially the throughput discovery
+tests. Due to limited HW testbed resources available within FD.io labs hosted
+by Linux Foundation, the number of tests for NICs other than X520 (a.k.a.
+Niantic) has been limited to few baseline tests. Over time we expect the HW
+testbed resources to grow, and will be adding complete set of performance
+tests for all models of hardware to be executed regularly and(or)
+continuously.