4 Changes in |csit-release|
5 -------------------------
7 #. **DPDK release version change**
9 - |csit-release| tested DPDK-18.05, as used by |vpp-release|.
11 #. **DPDK performance tests**
13 - **MRR Throughput**: MRR (Maximum Receive Rate) test code has now
14 configurable trial duration and number of consecutive executions.
15 Coverage of MRR tests has been extended across more test
16 scenarios. MRR tests are used for continuous performance trending
17 and for comparison between DPDK releases.
19 - **MLRsearch Throughput**: MLRsearch algorithm has been introduced
20 for all NDR and PDR throughput tests. All tests that previously
21 used binary search got converted to MLRsearch. Coverage of NDR/PDR
22 tests has been extended across more test scenarios.
24 - **2-Node Tests**: A new set of 2-node tests covering DPDK Testpmd
25 and L3fwd, running on new Xeon Skylake testbeds.
27 - **More NICs**: Increased coverage of NIC models tested: Intel-
28 xxv710-da2, Intel-x710-da4.
30 - **Generated tests**: Simplified and unified test structure, semi-
31 autogenerated by generator script. Test generator is currently
32 able to create test combinations with various frame size and
33 cores combinations. All existing test cases were converted to new
36 #. **Presentation and Analytics Layer**
38 - **Performance trending**: Added continuous performance trending with
39 anomaly detection and analysis for DPDK.
44 Relative performance changes in measured NDR, PDR and MRR packet
45 throughput in |csit-release| are calculated against the test results
46 from |csit-release-1| report, for tests running on 3-Node Intel Xeon
47 Haswell testbeds (3n-hsw) in 1-core, 2-core and 4-core (MRR only)
50 Listed mean and standard deviation values are computed based on a series
51 of the same tests executed against respective VPP releases to verify
52 test results repeatability, with percentage change calculated for mean
58 NDR throughput changes between releases are available in CSV and pretty
61 - `CSV 1t1c NDR changes <../_static/dpdk/performance-changes-1t1c-ndr.csv>`_,
62 - `CSV 2t2c NDR changes <../_static/dpdk/performance-changes-2t2c-ndr.csv>`_,
63 - `ASCII 1t1c NDR changes <../_static/dpdk/performance-changes-1t1c-ndr.txt>`_,
64 - `ASCII 2t2c NDR changes <../_static/dpdk/performance-changes-2t2c-ndr.txt>`_.
68 Test results have been generated by
69 `FD.io test executor dpdk performance job 3n-hsw`_
71 files csit-dpdk-perf-|srelease|-\*.zip
72 `archived here <../_static/archive/>`_.
77 PDR throughput changes between releases are available in CSV and pretty
80 - `CSV 1t1c PDR changes <../_static/dpdk/performance-changes-1t1c-pdr.csv>`_,
81 - `CSV 2t2c PDR changes <../_static/dpdk/performance-changes-2t2c-pdr.csv>`_,
82 - `ASCII 1t1c PDR changes <../_static/dpdk/performance-changes-1t1c-pdr.txt>`_,
83 - `ASCII 2t2c PDR changes <../_static/dpdk/performance-changes-2t2c-pdr.txt>`_.
87 Test results have been generated by
88 `FD.io test executor dpdk performance job 3n-hsw`_
90 files csit-dpdk-perf-|srelease|-\*.zip
91 `archived here <../_static/archive/>`_.
93 Skx vs. Hsw Comparison
94 ----------------------
96 Relative performance changes in measured packet throughput on 3-Node Skx testbed
97 are calculated against the results measured on 3-Node Hsw testbed.
102 NDR throughput changes between testbeds are available in a CSV and pretty ASCII
105 - `CSV 1c NDR comparison <../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-ndr.csv>`_,
106 - `ASCII 1c NDR comparison <../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-ndr.txt>`_.
110 Test results have been generated by
111 `FD.io test executor dpdk performance job 3n-hsw`_ and
112 `FD.io test executor dpdk performance job 3n-skx`_
114 files csit-dpdk-perf-|srelease|-\*.zip
115 `archived here <../_static/archive/>`_.
120 PDR throughput changes between testbeds are available in a CSV and pretty ASCII
123 - `CSV 1c PDR comparison <../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-pdr.csv>`_,
124 - `ASCII 1c PDR comparison <../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-pdr.txt>`_.
128 Test results have been generated by
129 `FD.io test executor dpdk performance job 3n-hsw`_ and
130 `FD.io test executor dpdk performance job 3n-skx`_
132 files csit-dpdk-perf-|srelease|-\*.zip
133 `archived here <../_static/archive/>`_.
138 MRR throughput changes between testbeds are available in a
139 CSV and pretty ASCII formats:
141 - `CSV 1c MRR comparison <../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_,
142 - `ASCII 1c MRR comparison <../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_.
146 Test results have been generated by
147 `FD.io test executor dpdk performance job 3n-hsw`_ and
148 `FD.io test executor dpdk performance job 3n-skx`_
150 files csit-vpp-perf-|srelease|-\*.zip
151 `archived here <../_static/archive/>`_.