-L2 Ethernet Looping\r
-===================\r
-\r
-Following sections provide a summary of VPP Phy-to-Phy L2 Ethernet Looping\r
-performance illustrating NDR throughput (zero packet loss) and PDR throughput\r
-(<0.5% packet loss). Performance is reported for Testpmd running in multiple\r
-Testpmd worker thread (a.k.a. VPP data plane thread) and physical CPU core\r
-configurations.\r
-\r
-*Title of each graph* is a regex (regular expression) matching all plotted\r
-throughput test cases, *X-axis labels* are indeces of csit-dpdk-perf-1701 jobs\r
-that created result output files used as data sources for the graph,\r
-*Y-axis labels* are measured Packets Per Second [pps] values, and the *graph\r
-legend* identifes the plotted test suites.\r
-\r
-.. note::\r
-\r
- Sources of test results data: i) FD.io executor jobs `csit-dpdk-perf-1701-all\r
- <https://jenkins.fd.io/view/csit/job/csit-dpdk-perf-1701-all/>`_ and\r
- `csit-dpdk-perf-1701-long\r
- <https://jenkins.fd.io/view/csit/job/csit-dpdk-perf-1701-long/>`_, ii)\r
- FD.io jobs archieved result files.\r
-\r
-NDR Throughput\r
-~~~~~~~~~~~~~~\r
-\r
-NDR throughput of Testpmd - running in configuration of **one worker thread\r
-(1t) on one physical core (1c)** - is presented in the figure below.\r
-\r
-.. raw:: html\r
-\r
- <iframe width="700" height="700" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-1t1c-l2-ndrdisc.html"></iframe>\r
-\r
-*Figure 1. Testpmd 1thread 1core - NDR Throughput for Phy-to-Phy L2 Ethernet\r
-Looping.*\r
-\r
-CSIT test cases used to generate results presented above can be found in CSIT\r
-git repository by filtering with specified regex as follows:\r
-\r
-.. code-block:: bash\r
-\r
- $ csit/dpdk-tests/perf\r
- $ grep -E "64B-1t1c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-ndrdisc" *\r
-\r
- 10ge2p1x520-eth-l2xcbase-ndrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-ndrdisc\r
-\r
-NDR throughput of Testpmd - running in configuration of **two worker threads\r
-(2t) on two physical cores (2c)** - is presented in the figure below.\r
-\r
-.. raw:: html\r
-\r
- <iframe width="700" height="700" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-2t2c-l2-ndrdisc.html"></iframe>\r
-\r
-*Figure 2. Testpmd 2threads 2cores - NDR Throughput for Phy-to-Phy L2 Ethernet\r
-Looping.*\r
-\r
-CSIT test cases used to generate results presented above can be found in CSIT\r
-git repository by filtering with specified regex as follows:\r
-\r
-.. code-block:: bash\r
-\r
- $ csit/dpdk-tests/perf\r
- $ grep -E "64B-2t2c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-ndrdisc" *\r
-\r
- 10ge2p1x520-eth-l2xcbase-ndrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-ndrdisc\r
-\r
-NDR throughput of Testpmd - running in configuration of **four worker threads\r
-(4t) on four physical cores (4c)** - is presented in the figure below.\r
-\r
-.. raw:: html\r
-\r
- <iframe width="700" height="700" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-4t4c-l2-ndrdisc.html"></iframe>\r
-\r
-*Figure 3. Testpmd 4threads 4cores - NDR Throughput for Phy-to-Phy L2 Ethernet\r
-Looping.*\r
-\r
-CSIT test cases used to generate results presented above can be found in CSIT\r
-git repository by filtering with specified regex as follows:\r
-\r
-.. code-block:: bash\r
-\r
- $ csit/dpdk-tests/perf\r
- $ grep -E "64B-4t4c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-ndrdisc" *\r
-\r
- 10ge2p1x520-eth-l2xcbase-ndrdisc.robot:| tc13-64B-4t4c-eth-l2xcbase-ndrdisc\r
-\r
-PDR Throughput\r
-~~~~~~~~~~~~~~\r
-\r
-PDR throughput of Testpmd - running in configuration of **one worker thread\r
-(1t) on one physical core (1c)** - is presented in the figure below. PDR at\r
-below 0.5% packet loss ratio.\r
-\r
-.. raw:: html\r
-\r
- <iframe width="700" height="700" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-1t1c-l2-pdrdisc.html"></iframe>\r
-\r
-*Figure 4. Testpmd 1thread 1core - PDR Throughput for Phy-to-Phy L2 Ethernet\r
-Looping.*\r
-\r
-CSIT test cases used to generate results presented above can be found in CSIT\r
-git repository by filtering with specified regex as follows:\r
-\r
-.. code-block:: bash\r
-\r
- $ csit/tests/perf\r
- $ grep -E "64B-1t1c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-pdrdisc" *\r
-\r
- 10ge2p1x520-eth-l2xcbase-ndrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-pdrdisc\r
-\r
-PDR throughput of Testpmd - running in configuration of **two worker threads\r
-(2t) on two physical cores (2c)** - is presented in the figure below.\r
-\r
-.. raw:: html\r
-\r
- <iframe width="700" height="700" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-2t2c-l2-pdrdisc.html"></iframe>\r
-\r
-*Figure 5. Testpmd 2thread 2core - PDR Throughput for Phy-to-Phy L2 Ethernet\r
-Looping.*\r
-\r
-CSIT test cases used to generate results presented above can be found in CSIT\r
-git repository by filtering with specified regex as follows:\r
-\r
-.. code-block:: bash\r
-\r
- $ csit/tests/perf\r
- $ grep -E "64B-2t2c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-pdrdisc" *\r
-\r
- 10ge2p1x520-eth-l2xcbase-ndrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-pdrdisc\r
-\r
-PDR throughput of Testpmd - running in configuration of **four worker threads\r
-(4t) on four physical cores (4c)** - is presented in the figure below.\r
-\r
-.. raw:: html\r
-\r
- <iframe width="700" height="700" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-4t4c-l2-pdrdisc.html"></iframe>\r
-\r
-*Figure 6. Testpmd 4thread 4core - PDR Throughput for Phy-to-Phy L2 Ethernet\r
-Looping.*\r
-\r
-CSIT test cases used to generate results presented above can be found in CSIT\r
-git repository by filtering with specified regex as follows:\r
-\r
-.. code-block:: bash\r
-\r
- $ csit/tests/perf\r
- $ grep -E "64B-4t4c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-pdrdisc" *\r
-\r
- 10ge2p1x520-eth-l2xcbase-ndrdisc.robot:| tc14-64B-4t4c-eth-l2xcbase-pdrdisc\r
+L2 Ethernet Interface Loop
+==========================
+
+Following sections include summary graphs of DPDK Testpmd Phy-to-Phy performance
+with L2 Ethernet Interface Loop, including NDR throughput (zero packet loss)
+and PDR throughput (<0.5% packet loss). Performance is reported for Testpmd
+running in multiple configurations of Testpmd pmd thread(s), a.k.a. Testpmd
+data plane thread(s), and their physical CPU core(s) placement.
+
+Results are generated by multiple executions of the same CSIT tests.
+In order to display variation in measured throughput values, Box-and-
+whisker plots are used to show their quartiles (Min, 1st quartile / 25th
+percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / 75th
+percentile, Max). Outliers are plotted as individual points.
+
+*Title of each graph* is a regex (regular expression) matching all
+throughput test cases plotted on this graph, *X-axis labels* are indices
+of individual test suites executed by csit-dpdk-perf-1704-all jobs that
+created result output files used as data sources for the graph, *Y-axis
+labels* are measured Packets Per Second [pps] values, and the *Graph
+legend* lists the plotted test suites and their indices.
+
+.. note::
+
+ Test results have been generated by FD.io test executor jobs
+ `csit-dpdk-perf-1704-all
+ <https://jenkins.fd.io/view/csit/job/csit-dpdk-perf-1704-all/>`_,
+ with Robot Framework result files csit-dpdk-perf-1704-all-<id>.zip
+ `archived here <../../_static/archive/>`_
+
+NDR Throughput
+~~~~~~~~~~~~~~
+
+Testpmd NDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented
+in the graph below.
+
+.. raw:: html
+
+ <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-1t1c-l2-ndrdisc.html"></iframe>
+
+*Figure 1. Testpmd 1thread 1core - NDR Throughput for Phy-to-Phy L2 Ethernet
+Looping.*
+
+CSIT source code for the test cases used for above plots can be found in CSIT
+git repository:
+
+.. code-block:: bash
+
+ $ $CSIT/dpdk-tests/perf
+ $ grep -E "64B-1t1c-eth-l2xcbase-testpmd-ndrdisc" *
+
+ 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-testpmd-ndrdisc
+ 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-testpmd-ndrdisc
+ 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-testpmd-ndrdisc
+
+Testpmd NDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented
+in the graph below.
+
+.. raw:: html
+
+ <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-2t2c-l2-ndrdisc.html"></iframe>
+
+*Figure 2. Testpmd 2threads 2cores - NDR Throughput for Phy-to-Phy L2 Ethernet
+Looping.*
+
+CSIT source code for the test cases used for above plots can be found in CSIT
+git repository:
+
+.. code-block:: bash
+
+ $ $CSIT/dpdk-tests/perf
+ $ grep -E "64B-2t2c-eth-l2xcbase-testpmd-ndrdisc" *
+
+ 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-testpmd-ndrdisc
+ 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-testpmd-ndrdisc
+ 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-testpmd-ndrdisc
+
+PDR Throughput
+~~~~~~~~~~~~~~
+
+Testpmd PDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented
+in the graph below. PDR measured for 0.5% packet loss ratio.
+
+.. raw:: html
+
+ <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-1t1c-l2-pdrdisc.html"></iframe>
+
+*Figure 3. Testpmd 1thread 1core - PDR Throughput for Phy-to-Phy L2 Ethernet
+Looping.*
+
+CSIT source code for the test cases used for above plots can be found in CSIT
+git repository:
+
+.. code-block:: bash
+
+ $ csit/tests/perf
+ $ grep -E "64B-1t1c-eth-l2xcbase-testpmd-pdrdisc" *
+
+ 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-testpmd-pdrdisc
+ 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-testpmd-pdrdisc
+ 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-testpmd-pdrdisc
+
+Testpmd PDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented
+in the graph below. PDR measured for 0.5% packet loss ratio.
+
+.. raw:: html
+
+ <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/testpmd/64B-2t2c-l2-pdrdisc.html"></iframe>
+
+*Figure 4. Testpmd 2thread 2core - PDR Throughput for Phy-to-Phy L2 Ethernet
+Looping.*
+
+CSIT source code for the test cases used for above plots can be found in CSIT
+git repository:
+
+.. code-block:: bash
+
+ $ csit/tests/perf
+ $ grep -E "64B-2t2c-eth-l2xcbase-testpmd-pdrdisc" *
+
+ 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-testpmd-pdrdisc
+ 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-testpmd-pdrdisc
+ 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-testpmd-pdrdisc
+
Code Review / csit.git / blobdiff