- `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_
- `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_
- `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_
+
+2n-dnv
+~~~~~~
+
+NDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+ - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_
+ - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_
+ - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.csv>`_
+ - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.csv>`_
+
+PDR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+ - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_
+ - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_
+ - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.csv>`_
+ - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.csv>`_
+
+MRR Comparison
+``````````````
+
+Comparison tables in ASCII and CSV formats:
+
+ - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_
+ - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_
+ - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_
+ - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.csv>`_
+ - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.csv>`_
+ - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.csv>`_
#. VPP PERFORMANCE TESTS
- - **Service density 2n-skx tests**: Network Function Virtualization (NFV)
- service density tests focus on measuring total per server throughput at
- varied NFV service *packing* densities with vswitch providing host
- dataplane. The goal is to compare and contrast performance of a shared
- vswitch for different network topologies and virtualization technologies,
- and their impact on vswitch performance and efficiency in a range of NFV
- service configurations.
-
- **Experimental Soak Tests**: Added performamce soak tests framework
code for extended time duration tests and throughput discovery
at given PLR and at give total test time e.g. minutes, hours,
| 4 | `CSIT-1431 | AVF 4 cores tests are sporadically failing. Under investigation. |
| | <https://jira.fd.io/browse/CSIT-1431>`_ | |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
-| 5 | `CSIT-1465 | 4c VPP VM vhost tests failing on 3n-skx. Under investigation. |
+| 5 | `CSIT-1465 | 4c VPP VM vhost tests failing on 3n-skx. Under investigation. |
| | <https://jira.fd.io/browse/CSIT-1465>`_ | |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
| 6 | `CSIT-1466 | IPSecHW scale tests failing due to VPP reset. Under investigation. |
urls:
URL[JENKINS,CSIT]: "https://jenkins.fd.io/view/csit/job"
URL[JENKINS,HC]: "https://jenkins.fd.io/view/hc2vpp/job"
- URL[VIRL,DNV]: "http://10.30.51.28/download/denverton/1901/robot-plugin.zip"
+ URL[VIRL,DNV]: "http://10.30.51.28/download/denverton/{release}/robot-plugin.zip"
# URL[VIRL,DNV]: "http://download.it/from/nexus"
URL[NEXUS]: "https://docs.fd.io/csit"
DIR[NEXUS]: "report/_static/archive"
# Denverton:
intel-dnv-vpp:
- # Not used
intel-dnv-vpp-release-1901:
- 1
# Performance changes
+ intel-dnv-vpp-changes-2n-dnv-ref:
+ intel-dnv-vpp-release-1810:
+ - 1
+ intel-dnv-vpp-changes-2n-dnv-cmp:
+ intel-dnv-vpp-release-1901:
+ - 1
+ intel-dnv-vpp-changes-2n-dnv:
+ - "intel-dnv-vpp-changes-2n-dnv-ref"
+ - "intel-dnv-vpp-changes-2n-dnv-cmp"
+
vpp-performance-changes-3n-hsw-h1:
csit-vpp-perf-verify-1807-3n-hsw:
- 11 # NDRPDR full 1
builds:
- # Not used
intel-dnv-vpp-release-1901:
- 1
+ intel-dnv-vpp-release-1810:
+ - 1
+
csit-vpp-perf-verify-1807-3n-hsw:
- 8 # MRR full
- 9 # MRR sel
################################################################################
# VPP
+# VPP Performance Changes 2n-dnv 1t1c pdr
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 1t1c pdr"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-1t1c-pdr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "PDR"
+ filter: "'1T1C' and ('NDRPDR' or 'NDRPDRDISC')"
+ parameters:
+ - "name"
+ - "parent"
+ - "throughput"
+
+# VPP Performance Changes 2n-dnv 2t2c pdr
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 2t2c pdr"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-2t2c-pdr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "PDR"
+ filter: "'2T2C' and ('NDRPDR' or 'NDRPDRDISC')"
+ parameters:
+ - "name"
+ - "parent"
+ - "throughput"
+
+# VPP Performance Changes 2n-dnv 1t1c ndr
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 1t1c ndr"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-1t1c-ndr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "NDR"
+ filter: "'1T1C' and ('NDRPDR' or 'NDRPDRDISC')"
+ parameters:
+ - "name"
+ - "parent"
+ - "throughput"
+
+# VPP Performance Changes 2n-dnv 2t2c ndr
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 2t2c ndr"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-2t2c-ndr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "NDR"
+ filter: "'2T2C' and ('NDRPDR' or 'NDRPDRDISC')"
+ parameters:
+ - "name"
+ - "parent"
+ - "throughput"
+
+
+# VPP Performance Changes 2n-dnv 1t1c MRR
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 1t1c MRR"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-1t1c-mrr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "MRR"
+ filter: "'1T1C' and 'MRR'"
+ parameters:
+ - "name"
+ - "parent"
+ - "result"
+
+# VPP Performance Changes 2n-dnv 2t2c MRR
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 2t2c MRR"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-2t2c-mrr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "MRR"
+ filter: "'2T2C' and 'MRR'"
+ parameters:
+ - "name"
+ - "parent"
+ - "result"
+
+# VPP Performance Changes 2n-dnv 4t4c MRR
+-
+ type: "table"
+ title: "VPP Performance Changes 2n-dnv 4t4c MRR"
+ algorithm: "table_performance_comparison"
+ output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-4t4c-mrr"
+ reference:
+ title: "rls1810"
+ data: "intel-dnv-vpp-changes-2n-dnv-ref"
+ compare:
+ title: "rls1901.1"
+ data: "intel-dnv-vpp-changes-2n-dnv-cmp"
+ data: "intel-dnv-vpp-changes-2n-dnv"
+ include-tests: "MRR"
+ filter: "'4T4C' and 'MRR'"
+ parameters:
+ - "name"
+ - "parent"
+ - "result"
+
# VPP Performance Changes 3n-hsw 1t1c pdr
-
type: "table"