- `HTML 4t2c NDR comparison <performance-changes-2n-skx-4t2c-ndr.html>`_
- `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_
- `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_
- - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density NDR comparison <performance-changes-nfv-2n-skx-2t1c-ndr.html>`_
- `ASCII 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.txt>`_
- `ASCII 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.txt>`_
- `ASCII 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.txt>`_
- - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.csv>`_
- - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.csv>`_
- - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.csv>`_
+ - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 4t2c PDR comparison <performance-changes-2n-skx-4t2c-pdr.html>`_
- `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_
- `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_
- - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density PDR comparison <performance-changes-nfv-2n-skx-2t1c-pdr.html>`_
- `ASCII 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-pdr.txt>`_
- `ASCII 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-pdr.txt>`_
- `ASCII 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-pdr.txt>`_
- - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-pdr.csv>`_
- - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-pdr.csv>`_
- - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-pdr.csv>`_
+ - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-pdr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_
- `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_
- `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_
- - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_
- - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_
- - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_
+ - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density MRR comparison <performance-changes-nfv-2n-skx-2t1c-mrr.html>`_
- `ASCII 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-mrr.txt>`_
- `ASCII 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-mrr.txt>`_
- `ASCII 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-mrr.txt>`_
- - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-mrr.csv>`_
- - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-mrr.csv>`_
- - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-mrr.csv>`_
+ - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-mrr-csv.csv>`_
3n-skx
~~~~~~
- `HTML 4t2c NDR comparison <performance-changes-3n-skx-4t2c-ndr.html>`_
- `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_
- `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_
- - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 4t2c PDR comparison <performance-changes-3n-skx-4t2c-pdr.html>`_
- `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_
- `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_
- - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_
- `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_
- `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_
- - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_
- - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_
- - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_
+ - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr-csv.csv>`_
2n-clx-xxv710
~~~~~~~~~~~~~
- `HTML 4t2c NDR comparison <performance-changes-2n-clx-xxv710-4t2c-ndr.html>`_
- `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr.txt>`_
- `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr.csv>`_
- - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr.csv>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-ndr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density NDR comparison <performance-changes-nfv-2n-clx-xxv710-2t1c-ndr.html>`_
- `ASCII 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-ndr.txt>`_
- `ASCII 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-ndr.txt>`_
- `ASCII 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-ndr.txt>`_
- - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-ndr.csv>`_
- - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-ndr.csv>`_
- - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-ndr.csv>`_
+ - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-ndr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 4t2c PDR comparison <performance-changes-2n-clx-xxv710-4t2c-pdr.html>`_
- `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr.txt>`_
- `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr.csv>`_
- - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr.csv>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-pdr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density PDR comparison <performance-changes-nfv-2n-clx-xxv710-2t1c-pdr.html>`_
- `ASCII 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-pdr.txt>`_
- `ASCII 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-pdr.txt>`_
- `ASCII 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-pdr.txt>`_
- - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-pdr.csv>`_
- - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-pdr.csv>`_
- - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-pdr.csv>`_
+ - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-pdr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr.txt>`_
- `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr.txt>`_
- `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr.txt>`_
- - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr.csv>`_
- - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr.csv>`_
- - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr.csv>`_
+ - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-xxv710-8t4c-mrr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density MRR comparison <performance-changes-nfv-2n-clx-xxv710-2t1c-mrr.html>`_
- `ASCII 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-mrr.txt>`_
- `ASCII 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-mrr.txt>`_
- `ASCII 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-mrr.txt>`_
- - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-mrr.csv>`_
- - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-mrr.csv>`_
- - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-mrr.csv>`_
+ - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-xxv710-8t4c-mrr-csv.csv>`_
2n-clx-x556
~~~~~~~~~~~
- `HTML 4t2c NDR comparison <performance-changes-2n-clx-x556-4t2c-ndr.html>`_
- `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-ndr.txt>`_
- `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-ndr.csv>`_
- - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-ndr.csv>`_
+ - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-ndr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density NDR comparison <performance-changes-nfv-2n-clx-x556-2t1c-ndr.html>`_
- `ASCII 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-ndr.txt>`_
- `ASCII 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-ndr.txt>`_
- `ASCII 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-ndr.txt>`_
- - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-ndr.csv>`_
- - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-ndr.csv>`_
- - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-ndr.csv>`_
+ - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-ndr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-ndr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 4t2c PDR comparison <performance-changes-2n-clx-x556-4t2c-pdr.html>`_
- `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-pdr.txt>`_
- `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-pdr.csv>`_
- - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-pdr.csv>`_
+ - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-pdr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density PDR comparison <performance-changes-nfv-2n-clx-x556-2t1c-pdr.html>`_
- `ASCII 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-pdr.txt>`_
- `ASCII 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-pdr.txt>`_
- `ASCII 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-pdr.txt>`_
- - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-pdr.csv>`_
- - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-pdr.csv>`_
- - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-pdr.csv>`_
+ - `CSV 2t1c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-pdr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-pdr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-mrr.txt>`_
- `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-mrr.txt>`_
- `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-8t4c-mrr.txt>`_
- - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-mrr.csv>`_
- - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-mrr.csv>`_
- - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-8t4c-mrr.csv>`_
+ - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-clx-x556-8t4c-mrr-csv.csv>`_
..
- `HTML 2t1c NFV Service Density MRR comparison <performance-changes-nfv-2n-clx-x556-2t1c-mrr.html>`_
- `ASCII 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-mrr.txt>`_
- `ASCII 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-mrr.txt>`_
- `ASCII 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-mrr.txt>`_
- - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-mrr.csv>`_
- - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-mrr.csv>`_
- - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-mrr.csv>`_
+ - `CSV 2t1c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-2t1c-mrr-csv.csv>`_
+ - `CSV 4t2c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-4t2c-mrr-csv.csv>`_
+ - `CSV 8t4c NFV Service Density MRR comparison <../../_static/vpp/performance-changes-nfv-2n-clx-x556-8t4c-mrr-csv.csv>`_
3n-hsw
~~~~~~
- `HTML 2t2c NDR comparison <performance-changes-3n-hsw-2t2c-ndr.html>`_
- `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.txt>`_
- `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr.csv>`_
- - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr.csv>`_
+ - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-ndr-csv.csv>`_
+ - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 2t2c PDR comparison <performance-changes-3n-hsw-2t2c-pdr.html>`_
- `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.txt>`_
- `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.csv>`_
- - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.csv>`_
+ - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr-csv.csv>`_
+ - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_
- `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_
- `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_
- - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_
- - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_
- - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_
+ - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr-csv.csv>`_
+ - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr-csv.csv>`_
+ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr-csv.csv>`_
2n-dnv
~~~~~~
- `HTML 2t2c NDR comparison <performance-changes-2n-dnv-2t2c-ndr.html>`_
- `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_
- `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.csv>`_
- - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.csv>`_
+ - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr-csv.csv>`_
+ - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 2t2c PDR comparison <performance-changes-2n-dnv-2t2c-pdr.html>`_
- `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_
- `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.csv>`_
- - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.csv>`_
+ - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr-csv.csv>`_
+ - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_
- `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_
- `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_
- - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.csv>`_
- - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.csv>`_
- - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.csv>`_
+ - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr-csv.csv>`_
+ - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr-csv.csv>`_
+ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr-csv.csv>`_
3n-dnv
~~~~~~
- `HTML 2t2c NDR comparison <performance-changes-3n-dnv-2t2c-ndr.html>`_
- `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr.txt>`_
- `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr.csv>`_
- - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr.csv>`_
+ - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-ndr-csv.csv>`_
+ - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 2t2c PDR comparison <performance-changes-3n-dnv-2t2c-pdr.html>`_
- `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr.txt>`_
- `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr.csv>`_
- - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr.csv>`_
+ - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-pdr-csv.csv>`_
+ - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr.txt>`_
- `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr.txt>`_
- `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr.txt>`_
- - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr.csv>`_
- - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr.csv>`_
- - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr.csv>`_
+ - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-1t1c-mrr-csv.csv>`_
+ - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-2t2c-mrr-csv.csv>`_
+ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-dnv-4t4c-mrr-csv.csv>`_
3n-tsh
~~~~~~
- `HTML 2t2c NDR comparison <performance-changes-3n-tsh-2t2c-ndr.html>`_
- `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr.txt>`_
- `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr.csv>`_
- - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr.csv>`_
+ - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-ndr-csv.csv>`_
+ - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-ndr-csv.csv>`_
PDR Comparison
``````````````
- `HTML 2t2c PDR comparison <performance-changes-3n-tsh-2t2c-pdr.html>`_
- `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr.txt>`_
- `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr.csv>`_
- - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr.csv>`_
+ - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-pdr-csv.csv>`_
+ - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-pdr-csv.csv>`_
MRR Comparison
``````````````
- `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr.txt>`_
- `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr.txt>`_
- `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr.txt>`_
- - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr.csv>`_
- - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr.csv>`_
- - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr.csv>`_
+ - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-1t1c-mrr-csv.csv>`_
+ - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-2t2c-mrr-csv.csv>`_
+ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-tsh-4t4c-mrr-csv.csv>`_
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-1t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-1t1c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-hsw 2t2c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-2t2c-pdr-rca1.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-hsw-2t2c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-hsw 1t1c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-1t1c-ndr-rca2.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-1t1c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-2t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-2t2c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-hsw 1t1c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-1t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-1t1c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-hsw-1t1c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-hsw 2t2c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-2t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-2t2c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-hsw-2t2c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-hsw 1t1c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-1t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-1t1c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-hsw-1t1c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-hsw 2t2c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-2t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-2t2c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-hsw-2t2c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-hsw with xl710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 2t1c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-2t1c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-2t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-2t1c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-2t1c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 4t2c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-4t2c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-4t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-4t2c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-4t2c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 2t1c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-2t1c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-2t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-2t1c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-2t1c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 4t2c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-4t2c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-4t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-4t2c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-4t2c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 2t1c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-skx-2t1c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-2t1c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-2t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-2t1c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-skx-2t1c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-skx-2t1c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 4t2c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-skx-4t2c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-4t2c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-4t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-4t2c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-skx-4t2c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-skx-4t2c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 2t1c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-skx-2t1c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-2t1c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-2t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-2t1c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-skx-2t1c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-skx-2t1c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-skx 4t2c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-skx-4t2c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-4t2c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-4t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-4t2c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-skx-4t2c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-skx-4t2c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 2t1c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-2t1c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-2t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-2t1c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-2t1c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 4t2c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-4t2c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-4t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-4t2c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-4t2c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 2t1c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-2t1c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-2t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-2t1c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-2t1c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 4t2c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-4t2c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-4t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-4t2c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-4t2c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 2t1c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-2n-skx-2t1c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-2t1c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-2t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-2t1c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-skx-2t1c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-skx-2t1c-pdr-rca3.yaml"
+
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 4t2c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-2n-skx-4t2c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-4t2c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-4t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-4t2c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-skx-4t2c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-skx-4t2c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 2t1c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-2n-skx-2t1c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-2t1c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-2t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-2t1c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-skx-2t1c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-skx-2t1c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-skx 4t2c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-2n-skx-4t2c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-4t2c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-4t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-4t2c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-skx-4t2c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-skx-4t2c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 2t1c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-2t1c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-2t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-2t1c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-2t1c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 4t2c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-4t2c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-4t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-4t2c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-4t2c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 2t1c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-2t1c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-2t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-2t1c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-2t1c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 4t2c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-4t2c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-4t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-4t2c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-4t2c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 2t1c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-2n-clx-2t1c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-2t1c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-2t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-2t1c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-clx-2t1c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-clx-2t1c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 4t2c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-2n-clx-4t2c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-4t2c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-4t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-4t2c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-clx-4t2c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-clx-4t2c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 2t1c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-2n-clx-2t1c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-2t1c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-2t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-2t1c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-clx-2t1c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-clx-2t1c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-xxv710 4t2c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-2n-clx-4t2c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 1
compare: 2
+ rca-file: "rca/rca-2005-2n-clx-4t2c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-4t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-4t2c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-2n-clx-4t2c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-2n-clx-4t2c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 2n-clx-x556 2t1c pdr
- type: "table"
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-clx with x556.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
# - ' RCA1: root cause analysis reference for 2001.0-4 vs 2001.0-2.'
# VPP Performance Changes 2n-clx-x556 4t2c pdr
- ''
- 'Test Case: Test cases executed for: PDR throughput on 2n-clx with x556.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
# - ' RCA1: root cause analysis reference for 2001.0-4 vs 2001.0-2.'
# VPP Performance Changes 2n-clx-x556 2t1c ndr
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-clx with x556.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
# - ' RCA1: root cause analysis reference for 2001.0-4 vs 2001.0-2.'
# VPP Performance Changes 2n-clx-x556 4t2c ndr
- ''
- 'Test Case: Test cases executed for: NDR throughput on 2n-clx with x556.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
# - ' RCA1: root cause analysis reference for 2001.0-4 vs 2001.0-2.'
# VPP Performance Changes 2n-dnv 1t1c pdr
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-1t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-1t1c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 2t2c pdr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-pdr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-2t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-2t2c-pdr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-pdr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 1t1c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-1t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-1t1c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 2t2c ndr
- type: "table"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-ndr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-2t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-2t2c-ndr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-ndr-rca2.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA2: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 1t1c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-1t1c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-1t1c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-tsh-1t1c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 2t2c pdr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-pdr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-pdr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-2t2c-pdr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-2t2c-pdr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-tsh-2t2c-pdr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-pdr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 1t1c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-1t1c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-1t1c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-tsh-1t1c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Performance Changes 3n-tsh 2t2c ndr-full
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 4
compare: 5
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-ndr-rca1.yaml"
- title: "2001.0-4 vs 2001.0-2"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-ndr-rca2.yaml"
- title: "2005.0-4 vs 2001.0-4"
reference: 3
compare: 5
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-2t2c-ndr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-2t2c-ndr-rca2.yaml"
-# - title: "RCA3"
-# data: "rca/rca-2005-3n-tsh-2t2c-ndr-rca3.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-ndr-rca3.yaml"
legend:
- ''
- 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.'
- 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base.'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
- '2005.0-4 vs 2005.0-3: Compares CSIT environments "4" to "3". "3" was discarded as it substantially changed TRex behaviour due to higher number of TRex workers used.'
- '2001.0-4 vs 2001.0-2: Compares CSIT environment current vs previous with previous VPP code.'
- '2005.0-4 vs 2001.0-4: Compares VPP code current vs previous in the current CSIT environment.'
-# - 'RCA1: Root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - 'RCA2: Root cause analysis reference for 2001.0-4 vs 2001.0-2.'
-# - 'RCA3: Root cause analysis reference for 2005.0-4 vs 2001.0-4.'
# VPP Comparison Across Testbeds 3n-hsw to 3n-skx 1c ndr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-1t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-1t1c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-1t1c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-hsw with xl710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-hsw 2t2c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-2t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-2t2c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-2t2c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-hsw with xl710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-hsw 4t4c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-3n-hsw-4t4c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-4t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-4t4c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-hsw-4t4c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-hsw with xl710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-skx 2t1c mrr
- type: "table"
include-tests: "MRR" # "PDR" | "NDR" | "MRR"
filter: "'2T1C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
columns:
-# - title: "1908"
-# data-set: "vpp-performance-changes-3n-skx-mrr-h1"
- title: "2001.0-2"
data-set: "vpp-performance-changes-3n-skx-mrr-ref"
- title: "2005.0-3"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-2t1c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-2t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-2t1c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-2t1c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-skx 4t2c mrr
- type: "table"
include-tests: "MRR" # "PDR" | "NDR" | "MRR"
filter: "'4T2C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
columns:
-# - title: "1908"
-# data-set: "vpp-performance-changes-3n-skx-mrr-h1"
- title: "2001.0-2"
data-set: "vpp-performance-changes-3n-skx-mrr-ref"
- title: "2005.0-3"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-4t2c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-4t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-4t2c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-4t2c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-skx 8t4c mrr
- type: "table"
include-tests: "MRR" # "PDR" | "NDR" | "MRR"
filter: "'8T4C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
columns:
-# - title: "1908"
-# data-set: "vpp-performance-changes-3n-skx-mrr-h1"
- title: "2001.0-2"
data-set: "vpp-performance-changes-3n-skx-mrr-ref"
- title: "2005.0-3"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-3n-skx-8t4c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-8t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-8t4c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-skx-8t4c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-skx 2t1c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-2t1c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-2t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-2t1c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-2t1c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-skx 4t2c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-4t2c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-4t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-4t2c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-4t2c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-skx 8t4c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-skx-8t4c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-8t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-8t4c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-skx-8t4c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-clx-xxv710 2t1c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-clx-2t1c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-2t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-2t1c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-2t1c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-clx-xxv710 4t2c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-clx-4t2c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-4t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-4t2c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-4t2c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-clx-xxv710 8t4c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 2
compare: 3
+ rca-file: "rca/rca-2005-2n-clx-8t4c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 1
compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-8t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-8t4c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-2n-clx-8t4c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with xxv710.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 2n-clx-clx-x556 2t1c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-1t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-1t1c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-1t1c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-tsh with x520.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-tsh 2t2c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-2t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-2t2c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-2t2c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-tsh with x520.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Performance Changes 3n-tsh 4t4c mrr
- type: "table"
- title: "2005.0-4 vs 2005.0-3"
reference: 3
compare: 4
+ rca-file: "rca/rca-2005-3n-tsh-4t4c-mrr-rca1.yaml"
- title: "2005.0-4 vs 2001.0-2"
reference: 2
compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-4t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-4t4c-mrr-rca2.yaml"
+ rca-file: "rca/rca-2005-3n-tsh-4t4c-mrr-rca2.yaml"
legend:
- ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
+ - 'Test Case: Test cases executed for: MRR throughput on 3n-tsh with x520.'
+ - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
+ - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.'
+ - '2005.0-4 vs 2005.0-3: Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
+ - '2005.0-4 vs 2001.0-2: Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
# VPP Comparison Across Testbeds 3n-hsw to 3n-skx 1c mrr
- type: "table"