- title: "VPP Performance Changes 3n-hsw 1t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-hsw-1t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'1T1C' and 'MRR' and 'NIC_Intel-XL710' and not 'NF_DENSITY'"
- columns:
- - title: "1908.1-2"
- data-set: "vpp-performance-changes-3n-hsw-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-hsw-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-hsw-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-hsw-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 3
- compare: 4
- - title: "2005.0-4 vs 2001.0-2"
- reference: 2
- compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-1t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-1t1c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 3n-hsw 2t2c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-hsw 2t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-hsw-2t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T2C' and 'MRR' and 'NIC_Intel-XL710' and not 'NF_DENSITY'"
- columns:
- - title: "1908.1-2"
- data-set: "vpp-performance-changes-3n-hsw-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-hsw-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-hsw-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-hsw-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 3
- compare: 4
- - title: "2005.0-4 vs 2001.0-2"
- reference: 2
- compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-2t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-2t2c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 3n-hsw 4t4c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-hsw 4t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-hsw-4t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T4C' and 'MRR' and 'NIC_Intel-XL710' and not 'NF_DENSITY'"
- columns:
- - title: "1908.1-2"
- data-set: "vpp-performance-changes-3n-hsw-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-hsw-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-hsw-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-hsw-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 3
- compare: 4
- - title: "2005.0-4 vs 2001.0-2"
- reference: 2
- compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-hsw-4t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-hsw-4t4c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-hsw with xl710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-
-# VPP Performance Changes 3n-skx 2t1c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-skx 2t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-skx-2t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T1C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
-# - title: "1908"
-# data-set: "vpp-performance-changes-3n-skx-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-skx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-skx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-skx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-2t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-2t1c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 3n-skx 4t2c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-skx 4t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-skx-4t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T2C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
-# - title: "1908"
-# data-set: "vpp-performance-changes-3n-skx-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-skx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-skx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-skx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-4t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-4t2c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 3n-skx 8t4c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-skx 8t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-skx-8t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'8T4C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
-# - title: "1908"
-# data-set: "vpp-performance-changes-3n-skx-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-skx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-skx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-skx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-skx-8t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-skx-8t4c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-skx 2t1c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-skx 2t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-skx-2t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T1C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-2n-skx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-2n-skx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-2n-skx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-2t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-2t1c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-skx 4t2c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-skx 4t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-skx-4t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T2C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-2n-skx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-2n-skx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-2n-skx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-4t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-4t2c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-skx 8t4c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-skx 8t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-skx-8t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'8T4C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-2n-skx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-2n-skx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-2n-skx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-skx-8t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-skx-8t4c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-clx-xxv710 2t1c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-clx-xxv710 2t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-clx-xxv710-2t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T1C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-2n-clx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-2t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-2t1c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-clx-xxv710 4t2c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-clx-xxv710 4t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-clx-xxv710-4t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T2C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-2n-clx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-4t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-4t2c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-clx-xxv710 8t4c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-clx-xxv710 8t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-clx-xxv710-8t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'8T4C' and 'MRR' and 'NIC_Intel-XXV710' and not 'NF_DENSITY'"
- columns:
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-2n-clx-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 2
- compare: 3
- - title: "2005.0-4 vs 2001.0-2"
- reference: 1
- compare: 3
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-2n-clx-8t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-2n-clx-8t4c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 2n-clx-clx-x556 2t1c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-clx-clx-x556 2t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-clx-clx-x556-2t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T1C' and 'MRR' and 'NIC_Mellanox-CX556A' and not 'NF_DENSITY'"
- columns:
- - title: "2001"
- data-set: "vpp-performance-changes-2n-clx-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 2n-clx-clx-x556 4t2c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-clx-clx-x556 4t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-clx-clx-x556-4t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T2C' and 'MRR' and 'NIC_Mellanox-CX556A' and not 'NF_DENSITY'"
- columns:
- - title: "2001"
- data-set: "vpp-performance-changes-2n-clx-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 2n-clx-clx-x556 8t4c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-clx-clx-x556 8t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-clx-clx-x556-8t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'8T4C' and 'MRR' and 'NIC_Mellanox-CX556A' and not 'NF_DENSITY'"
- columns:
- - title: "2001"
- data-set: "vpp-performance-changes-2n-clx-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-2n-clx-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 2n-dnv 1t1c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-dnv 1t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-1t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'1T1C'"
- columns:
- - title: "1908"
- data-set: "vpp-performance-changes-2n-dnv-mrr-h1"
- - title: "2001"
- data-set: "vpp-performance-changes-2n-dnv-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-2n-dnv-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 2
- compare: 3
- legend:
- - ""
- - "1908, 2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 2n-dnv 2t2c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-dnv 2t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-2t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T2C'"
- columns:
- - title: "1908"
- data-set: "vpp-performance-changes-2n-dnv-mrr-h1"
- - title: "2001"
- data-set: "vpp-performance-changes-2n-dnv-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-2n-dnv-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 2
- compare: 3
- legend:
- - ""
- - "1908, 2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 2n-dnv 4t4c mrr
-- type: "table"
- title: "VPP Performance Changes 2n-dnv 4t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-2n-dnv-4t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T4C'"
- columns:
- - title: "1908"
- data-set: "vpp-performance-changes-2n-dnv-mrr-h1"
- - title: "2001"
- data-set: "vpp-performance-changes-2n-dnv-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-2n-dnv-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 2
- compare: 3
- legend:
- - ""
- - "1908, 2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 3n-dnv 1t1c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-dnv 1t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-dnv-1t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'1T1C'"
- columns:
- - title: "1908"
- data-set: "vpp-performance-changes-3n-dnv-mrr-h1"
- - title: "2001"
- data-set: "vpp-performance-changes-3n-dnv-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-3n-dnv-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 2
- compare: 3
- legend:
- - ""
- - "1908, 2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 3n-dnv 2t2c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-dnv 2t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-dnv-2t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T2C'"
- columns:
- - title: "1908"
- data-set: "vpp-performance-changes-3n-dnv-mrr-h1"
- - title: "2001"
- data-set: "vpp-performance-changes-3n-dnv-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-3n-dnv-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 2
- compare: 3
- legend:
- - ""
- - "1908, 2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 3n-dnv 4t4c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-dnv 4t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-dnv-4t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T4C'"
- columns:
- - title: "1908"
- data-set: "vpp-performance-changes-3n-dnv-mrr-h1"
- - title: "2001"
- data-set: "vpp-performance-changes-3n-dnv-mrr-ref"
- - title: "2005"
- data-set: "vpp-performance-changes-3n-dnv-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 2
- compare: 3
- legend:
- - ""
- - "1908, 2001, 2005 - VPP versions tested."
- - "Diff - difference between 2001 and 2005 VPP version."
-
-# VPP Performance Changes 3n-tsh 1t1c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-tsh 1t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-tsh-1t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'1T1C'"
- columns:
- - title: "1908.1-2"
- data-set: "vpp-performance-changes-3n-tsh-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-tsh-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-tsh-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-tsh-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 3
- compare: 4
- - title: "2005.0-4 vs 2001.0-2"
- reference: 2
- compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-1t1c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-1t1c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 3n-tsh 2t2c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-tsh 2t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-tsh-2t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T2C'"
- columns:
- - title: "1908.1-2"
- data-set: "vpp-performance-changes-3n-tsh-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-tsh-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-tsh-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-tsh-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 3
- compare: 4
- - title: "2005.0-4 vs 2001.0-2"
- reference: 2
- compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-2t2c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-2t2c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Performance Changes 3n-tsh 4t4c mrr
-- type: "table"
- title: "VPP Performance Changes 3n-tsh 4t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-changes-3n-tsh-4t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T4C'"
- columns:
- - title: "1908.1-2"
- data-set: "vpp-performance-changes-3n-tsh-mrr-h1"
- - title: "2001.0-2"
- data-set: "vpp-performance-changes-3n-tsh-mrr-ref"
- - title: "2005.0-3"
- data-set: "vpp-performance-changes-3n-tsh-mrr-cmp"
- - title: "2005.0-4"
- data-set: "vpp-performance-changes-3n-tsh-mrr-cmp-2"
- comparisons:
- - title: "2005.0-4 vs 2005.0-3"
- reference: 3
- compare: 4
- - title: "2005.0-4 vs 2001.0-2"
- reference: 2
- compare: 4
-# rca:
-# - title: "RCA1"
-# data: "rca/rca-2005-3n-tsh-4t4c-mrr-rca1.yaml"
-# - title: "RCA2"
-# data: "rca/rca-2005-3n-tsh-4t4c-mrr-rca2.yaml"
- legend:
- - ''
- - ' Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.'
- - ' YYMM.V-E: [Mpps +- StDev] results for VPP version (YY year, MM month, V minor version) tested in CSIT environment version (E environment version, "2" for 2020-03-27, "3" for 2020-06-11, "4" for 2020-06-24).'
- - '2005.0-4 vs 2005.0-3: [% +- StDev] Relative difference, latter is the base. Environment version "3" was found to be incompatible with "2" due to higher number of TRex workers used.'
- - '2005.0-4 vs 2001.0-2: [% +- StDev] Relative difference, latter is the base. Used as a reference to compare benchmark results of VPP current release v20.05.0 vs previous release v20.01.0.'
-# - ' RCA1: root cause analysis reference for 2005.0-4 vs 2005.0-3.'
-# - ' RCA2: root cause analysis reference for 2005.0-4 vs 2001.0-2.'
-
-# VPP Comparison Across Testbeds 3n-hsw to 3n-skx 1c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 3n-hsw to 3n-skx 1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-hsw-3n-skx-1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "('NIC_Intel-XXV710' or 'NIC_Intel-XL710') and 'MRR' and '1C'"
- columns:
- - title: "3n-hsw xl710"
- data-set: "vpp-compare-testbeds-mrr-ref"
- tag: "NIC_Intel-XL710"
- - title: "3n-skx xxv710"
- data-set: "vpp-compare-testbeds-mrr-cmp"
- tag: "NIC_Intel-XXV710"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-hsw xl710, 3n-skx xxv710 - testbeds and NICs tested."
- - "Diff - difference between 3n-hsw xl710 and 3n-skx xxv710 testbeds."
-
-# VPP Comparison Across Testbeds 3n-hsw to 3n-skx 2c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 3n-hsw to 3n-skx 2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-hsw-3n-skx-2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "('NIC_Intel-XXV710' or 'NIC_Intel-XL710') and 'MRR' and '2C'"
- columns:
- - title: "3n-hsw xl710"
- data-set: "vpp-compare-testbeds-mrr-ref"
- tag: "NIC_Intel-XL710"
- - title: "3n-skx xxv710"
- data-set: "vpp-compare-testbeds-mrr-cmp"
- tag: "NIC_Intel-XXV710"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-hsw xl710, 3n-skx xxv710 - testbeds and NICs tested."
- - "Diff - difference between 3n-hsw xl710 and 3n-skx xxv710 testbeds."
-
-# VPP Comparison Across Testbeds 3n-hsw to 3n-skx 4c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 3n-hsw to 3n-skx 4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-hsw-3n-skx-4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "('NIC_Intel-XXV710' or 'NIC_Intel-XL710') and 'MRR' and '4C'"
- columns:
- - title: "3n-hsw xl710"
- data-set: "vpp-compare-testbeds-mrr-ref"
- tag: "NIC_Intel-XL710"
- - title: "3n-skx xxv710"
- data-set: "vpp-compare-testbeds-mrr-cmp"
- tag: "NIC_Intel-XXV710"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-hsw xl710, 3n-skx xxv710 - testbeds and NICs tested."
- - "Diff - difference between 3n-hsw xl710 and 3n-skx xxv710 testbeds."
-
-# VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'2T1C' and 'NIC_Intel-XXV710'"
- columns:
- - title: "2n-skx"
- data-set: "vpp-compare-testbeds-mrr-skx-clx-ref"
- - title: "2n-clx"
- data-set: "vpp-compare-testbeds-mrr-skx-clx-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "2n-skx, 2n-clx - testbeds and NICs tested."
- - "Diff - difference between 2n-skx and 2n-clx testbeds."
-
-# VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'4T2C' and 'NIC_Intel-XXV710'"
- columns:
- - title: "2n-skx"
- data-set: "vpp-compare-testbeds-mrr-skx-clx-ref"
- - title: "2n-clx"
- data-set: "vpp-compare-testbeds-mrr-skx-clx-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "2n-skx, 2n-clx - testbeds and NICs tested."
- - "Diff - difference between 2n-skx and 2n-clx testbeds."
-
-# VPP Comparison Across Testbeds 2n-skx to 2n-clx 8t4c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 8t4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-8t4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'8T4C' and 'NIC_Intel-XXV710'"
- columns:
- - title: "2n-skx"
- data-set: "vpp-compare-testbeds-mrr-skx-clx-ref"
- - title: "2n-clx"
- data-set: "vpp-compare-testbeds-mrr-skx-clx-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "2n-skx, 2n-clx - testbeds and NICs tested."
- - "Diff - difference between 2n-skx and 2n-clx testbeds."
-
-# VPP Comparison Across Topologies 3n-skx to 2n-skx 1c mrr
-- type: "table"
- title: "VPP Comparison Across Topologies 3n-skx to 2n-skx 1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-topologies-3n-skx-2n-skx-1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'MRR' and '1C' and 'NIC_Intel-XXV710'"
- columns:
- - title: "3n-skx"
- data-set: "vpp-compare-topologies-mrr-ref"
- - title: "2n-skx"
- data-set: "vpp-compare-topologies-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-skx, 2n-skx - topologies tested."
- - "Diff - difference between 3n-skx and 2n-skx topologies."
-
-# VPP Comparison Across Topologies 3n-skx to 2n-skx 2c mrr
-- type: "table"
- title: "VPP Comparison Across Topologies 3n-skx to 2n-skx 2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-topologies-3n-skx-2n-skx-2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'MRR' and '2C' and 'NIC_Intel-XXV710'"
- columns:
- - title: "3n-skx"
- data-set: "vpp-compare-topologies-mrr-ref"
- - title: "2n-skx"
- data-set: "vpp-compare-topologies-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-skx, 2n-skx - topologies tested."
- - "Diff - difference between 3n-skx and 2n-skx topologies."
-
-# VPP Comparison Across Topologies 3n-skx to 2n-skx 4c mrr
-- type: "table"
- title: "VPP Comparison Across Topologies 3n-skx to 2n-skx 4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-topologies-3n-skx-2n-skx-4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "'MRR' and '4C' and 'NIC_Intel-XXV710'"
- columns:
- - title: "3n-skx"
- data-set: "vpp-compare-topologies-mrr-ref"
- - title: "2n-skx"
- data-set: "vpp-compare-topologies-mrr-cmp"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-skx, 2n-skx - topologies tested."
- - "Diff - difference between 3n-skx and 2n-skx topologies."
-
-# VPP Comparison Across Testbeds 3n-hsw to 2n-clx 1c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 3n-hsw to 2n-clx 1c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-hsw-2n-clx-1c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "('NIC_Intel-XXV710' or 'NIC_Intel-XL710') and 'MRR' and '1C'"
- columns:
- - title: "3n-hsw xl710"
- data-set: "vpp-compare-testbeds-mrr-hsw-clx-ref"
- tag: "NIC_Intel-XL710"
- - title: "2n-clx xxv710"
- data-set: "vpp-compare-testbeds-mrr-hsw-clx-cmp"
- tag: "NIC_Intel-XXV710"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-hsw xl710, 2n-clx xxv710 - testbeds and NICs tested."
- - "Diff - difference between 3n-hsw xl710 and 2n-clx xxv710 testbeds."
-
-# VPP Comparison Across Testbeds 3n-hsw to 2n-clx 2c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 3n-hsw to 2n-clx 2c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-hsw-2n-clx-2c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "('NIC_Intel-XXV710' or 'NIC_Intel-XL710') and 'MRR' and '2C'"
- columns:
- - title: "3n-hsw xl710"
- data-set: "vpp-compare-testbeds-mrr-hsw-clx-ref"
- tag: "NIC_Intel-XL710"
- - title: "2n-clx xxv710"
- data-set: "vpp-compare-testbeds-mrr-hsw-clx-cmp"
- tag: "NIC_Intel-XXV710"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-hsw xl710, 2n-clx xxv710 - testbeds and NICs tested."
- - "Diff - difference between 3n-hsw xl710 and 2n-clx xxv710 testbeds."
-
-# VPP Comparison Across Testbeds 3n-hsw to 2n-clx 4c mrr
-- type: "table"
- title: "VPP Comparison Across Testbeds 3n-hsw to 2n-clx 4c mrr"
- algorithm: "table_comparison"
- output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-hsw-2n-clx-4c-mrr"
- include-tests: "MRR" # "PDR" | "NDR" | "MRR"
- filter: "('NIC_Intel-XXV710' or 'NIC_Intel-XL710') and 'MRR' and '4C'"
- columns:
- - title: "3n-hsw xl710"
- data-set: "vpp-compare-testbeds-mrr-hsw-clx-ref"
- tag: "NIC_Intel-XL710"
- - title: "2n-clx xxv710"
- data-set: "vpp-compare-testbeds-mrr-hsw-clx-cmp"
- tag: "NIC_Intel-XXV710"
- comparisons:
- - title: "Diff"
- reference: 1
- compare: 2
- legend:
- - ""
- - "3n-hsw xl710, 2n-clx xxv710 - testbeds and NICs tested."
- - "Diff - difference between 3n-hsw xl710 and 2n-clx xxv710 testbeds."
-
-# Detailed Test Results - VPP Performance Results 3n-hsw
-- type: "table"
- title: "Detailed Test Results - VPP Performance Results 3n-hsw"
- algorithm: "table_merged_details"
- output-file: "{DIR[DTR,PERF,VPP,3N,HSW]}/"
- columns:
- - title: " |prein| Test Name |preout| "
- data: "data name"
- - title: " |prein| Throughput: |br| 1. Mpps Gbps (NDR) |br| 2. Mpps Gbps (PDR) |br| |br| One-Way Latency Percentiles in uSec at %PDR load, |br| one set per each direction: |br| 3. P50 P90 P99 P50 P90 P99 (10% PDR) |br| 4. P50 P90 P99 P50 P90 P99 (50% PDR) |br| 5. P50 P90 P99 P50 P90 P99 (90% PDR) |preout| "
- data: "data msg"
- data: "vpp-perf-results-3n-hsw"
- filter: "all"
- parameters:
- - "name"
- - "parent"
- - "msg"
-
-# Detailed Test Results - VPP Performance Results 3n-skx
-- type: "table"
- title: "Detailed Test Results - VPP Performance Results 3n-skx"
- algorithm: "table_merged_details"
- output-file: "{DIR[DTR,PERF,VPP,3N,SKX]}/"
- columns:
- - title: " |prein| Test Name |preout| "
- data: "data name"
- - title: " |prein| Throughput: |br| 1. Mpps Gbps (NDR) |br| 2. Mpps Gbps (PDR) |br| |br| One-Way Latency Percentiles in uSec at %PDR load, |br| one set per each direction: |br| 3. P50 P90 P99 P50 P90 P99 (10% PDR) |br| 4. P50 P90 P99 P50 P90 P99 (50% PDR) |br| 5. P50 P90 P99 P50 P90 P99 (90% PDR) |preout| "
- data: "data msg"
- data: "vpp-perf-results-3n-skx"
- filter: "all"
- remove-ndr: False
- parameters:
- - "name"
- - "parent"
- - "msg"
-
-# Detailed Test Results - VPP Performance Results 2n-skx
-- type: "table"
- title: "Detailed Test Results - VPP Performance Results 2n-skx"
- algorithm: "table_merged_details"
- output-file: "{DIR[DTR,PERF,VPP,2N,SKX]}/"
- columns:
- - title: " |prein| Test Name |preout| "
- data: "data name"
- - title: " |prein| Throughput: |br| 1. Mpps Gbps (NDR) |br| 2. Mpps Gbps (PDR) |br| |br| One-Way Latency Percentiles in uSec at %PDR load, |br| one set per each direction: |br| 3. P50 P90 P99 P50 P90 P99 (10% PDR) |br| 4. P50 P90 P99 P50 P90 P99 (50% PDR) |br| 5. P50 P90 P99 P50 P90 P99 (90% PDR) |preout| "
- data: "data msg"
- data: "vpp-perf-results-2n-skx"
- filter: "all"
- remove-ndr: False
- parameters:
- - "name"
- - "parent"
- - "msg"
-
-# Detailed Test Results - VPP Performance Results 2n-clx
-- type: "table"
- title: "Detailed Test Results - VPP Performance Results 2n-clx"
- algorithm: "table_merged_details"
- output-file: "{DIR[DTR,PERF,VPP,2N,CLX]}/"