From: Maciek Konstantynowicz Date: Thu, 27 Apr 2017 09:03:31 +0000 (+0100) Subject: csit rls1704 report: updates to csit_release_notes.rst files. X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=commitdiff_plain;h=38850b1710c99c2d981cd9ccd6a474c0a017b91f csit rls1704 report: updates to csit_release_notes.rst files. Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz --- diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst index 25ca27c03f..4b682209d6 100644 --- a/docs/report/vpp_functional_tests/csit_release_notes.rst +++ b/docs/report/vpp_functional_tests/csit_release_notes.rst @@ -29,38 +29,38 @@ Here is the list of known issues in CSIT |release| for VPP functional tests in V | # | Issue | Jira ID | Description | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when | -| | sent with different XID | | received DHCPv4 OFFER message with different (wrong) | +| | sent with different XID. | | received DHCPv4 OFFER message with different (wrong) | | | | | XID. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in | -| | destination address when IPv4 prefix is 0 | | case that IPv4 prefix is equal to 0 and IPv6 prefix | +| | destination address when IPv4 prefix is 0. | | case that IPv4 prefix is equal to 0 and IPv6 prefix | | | | | is less than 40. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix | -| | incorrect parameters provided | | length of IPv4 prefix and PSID length is greater | +| | incorrect parameters provided. | | length of IPv4 prefix and PSID length is greater | | | | | than EA bits length. IPv6 destination address | | | | | contains bits writen with PSID over the EA-bit | | | | | length when IPv4 packet is sent. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in | -| | response to ICMPv6 Router Solicitation | | ICMPv6 Router Advertisement packet sent as a | +| | response to ICMPv6 Router Solicitation. | | ICMPv6 Router Advertisement packet sent as a | | | | | response to received ICMPv6 Router Solicitation | | | | | packet. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of | -| | IPv6_dst | | IPv6_dst when classify session is configured with | +| | IPv6_dst. | | IPv6_dst when classify session is configured with | | | | | IPv6 destination address. Anyhow the correct IPv6 | | | | | destination address is reported. | +---+-------------------------------------------------+----------+------------------------------------------------------+ -| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 | -| | work with virtio driver | | routing on interface binded to virtio driver. Issue | -| | | | with VIRL test simulation environment | +| 6 | IPv4 + VLAN: Processing of tagged frame does | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 | +| | not work with virtio driver. | | routing on interface binded to virtio driver. Issue | +| | | | with VIRL test simulation environment. | +---+-------------------------------------------------+----------+------------------------------------------------------+ -| 7 | Vhost-user: QEMU reconnect doesn't work | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user | +| 7 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user | | | | | reconnect. It requires moving CSIT VIRL environment | | | | | to QEMU 2.7.0. | +---+-------------------------------------------------+----------+------------------------------------------------------+ -| 8 | Centos7: LISP and VXLAN sporadic test failures | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP | +| 8 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP | | | | | and VXLAN test executions, what leads to failure of | | | | | all other tests in the suite. NOTE: After upgrading | | | | | one of the VIRL servers host from Ubuntu14.04 to | diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index b4fc9de3c9..8aa4533972 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -45,10 +45,11 @@ Changes in CSIT |release| Performance Improvements ------------------------ -Some performance improvements in measured packet throughput have been observed -in a number of CSIT |release| tests listed below. Relative improvements are -calculated against the test results in CSIT rls1701 report. VPP-16.09 and -VPP-17.01 numbers are provided for reference. +Substantial improvements in measured packet throughput have been +observed in a number of CSIT |release| tests listed below, with relative +increase of double-digit percentage points. Relative improvements are +calculated against the test results listed in CSIT rls1701 report. +VPP-16.09 numbers are provided for reference. NDR Throughput ~~~~~~~~~~~~~~ @@ -59,31 +60,19 @@ Non-Drop Rate Throughput discovery tests: | VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 | | | | [Mpps] | [Mpps] | [Mpps] | Relative Change | +===================+=================================================================+============+===========+===========+=================+ -| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.4 | 12.7 | 13.4 | 6% | -+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| L2XC | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.5 | 12.2 | 12.4 | 2% | -+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc | 7.4 | 8.8 | 9.3 | 6% | -+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc | 7.5 | 8.8 | 9.2 | 5% | -+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc | 5.4 | 6.5 | 6.8 | 5% | -+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ | L2XC-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-ndrdisc | 0.5 | 2.8 | 3.2 | 14% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc | 7.8 | 10.4 | 10.8 | 4% | +| L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4 | 2.7 | 3.1 | 15% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4 | 2.7 | 3.4 | 26% | -+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc | 8.7 | 9.7 | 10.6 | 9% | +| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc | 0.3 | 2.6 | 3.1 | 19% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc | 7.1 | 8.3 | 9.0 | 8% | +| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc | 4.4 | 4.8 | 5.5 | 15% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc | 6.9 | 7.6 | 8.3 | 9% | +| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc | 3.0 | 7.3 | 8.1 | 11% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc | 0.3 | 2.6 | 3.1 | 19% | +| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc | 6.1 | 6.1 | 6.9 | 13% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ -| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc | 3.0 | 7.3 | 8.1 | 11% | +| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc | 6.5 | 6.1 | 6.9 | 13% | +-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ PDR Throughput @@ -95,29 +84,19 @@ Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%: | VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 | | | | [Mpps] | [Mpps] | [Mpps] | Relative Change | +===================+=================================================================+===========+===========+===========+=================+ -| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc | 9.4 | 12.7 | 13.4 | 6% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc | 7.4 | 8.8 | 9.3 | 6% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc | 7.5 | 8.8 | 9.5 | 8% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc | 5.4 | 6.5 | 6.8 | 5% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | L2XC-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc | 2.6 | 3.2 | 3.2 | 0% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc | 7.8 | 10.6 | 11.1 | 5% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-pdrdisc | 2.1 | 2.9 | 3.2 | 10% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc | 8.7 | 9.7 | 10.6 | 9% | +| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc | 2.0 | 2.7 | 3.1 | 15% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc | 7.1 | 8.3 | 9.2 | 11% | +| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc | 4.6 | 4.8 | 5.5 | 15% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc | 7.1 | 7.6 | 8.3 | 9% | +| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc | 7.7 | 7.3 | 8.1 | 11% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc | 2.0 | 2.7 | 3.2 | 19% | +| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc | 6.1 | 6.1 | 6.9 | 13% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc | 7.7 | 7.3 | 8.1 | 11% | +| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc | 6.5 | 6.1 | 6.9 | 13% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ Measured improvements are in line with VPP code optimizations listed in @@ -134,69 +113,91 @@ Other Performance Changes ------------------------- Other changes in measured packet throughput, with either minor relative -increase or decrease, have been observed in a number of CSIT |release| tests -listed below. Relative changes are calculated against the test results in CSIT -rls1701 report. +increase or decrease, have been observed in a number of CSIT |release| +tests listed below. Relative changes are calculated against the test +results listed in CSIT rls1701 report. NDR Throughput ~~~~~~~~~~~~~~ Non-Drop Rate Throughput discovery tests: ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 | +| | | [Mpps] | [Mpps] | [Mpps] | Relative Change | ++===================+=================================================================+============+===========+===========+=================+ +| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.4 | 12.7 | 13.1 | 3% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| L2XC | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.5 | 12.2 | 12.4 | 2% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc | 7.4 | 8.8 | 9.1 | 3% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc | 7.5 | 8.8 | 9.2 | 5% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc | 5.4 | 6.5 | 6.8 | 5% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc | 7.8 | 10.4 | 10.8 | 4% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc | 8.7 | 9.7 | 10.6 | 9% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc | 7.1 | 8.3 | 9.0 | 8% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc | 6.9 | 7.6 | 8.3 | 9% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 FIB 200k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc | 8.5 | 9.0 | 9.7 | 8% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 FIB 20k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc | 8.5 | 9.0 | 9.4 | 4% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc | 8.5 | 7.8 | 8.1 | 4% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv4 Policer | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc | 6.9 | 7.4 | 8.1 | 9% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv6 FIB 200k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc | 6.5 | 5.3 | 5.3 | 0% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv6 FIB 20k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc | 6.9 | 6.5 | 6.9 | 6% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ +| IPv6 FIB 2M | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc | 5.3 | 4.2 | 4.6 | 10% | ++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+ + +PDR Throughput +~~~~~~~~~~~~~~ + +Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%: + +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 | | | | [Mpps] | [Mpps] | [Mpps] | Relative Change | +===================+=================================================================+===========+===========+===========+=================+ -| IPv4 FIB 200k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc | 8.5 | 9.0 | 9.7 | 8% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 FIB 20k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc | 8.5 | 9.0 | 9.4 | 4% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc | 8.5 | 7.8 | 8.1 | 4% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 Policer | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc | 6.9 | 7.4 | 8.1 | 9% | +| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc | 9.4 | 12.7 | 13.4 | 6% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc | 4.4 | 4.8 | 5.5 | 15% | +| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc | 7.4 | 8.8 | 9.3 | 6% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc | 6.1 | 6.1 | 6.9 | 13% | +| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc | 7.5 | 8.8 | 9.2 | 5% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 FIB 200k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc | 6.5 | 5.3 | 5.3 | 0% | +| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc | 5.4 | 6.5 | 6.8 | 5% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 FIB 20k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc | 6.9 | 6.5 | 6.9 | 6% | +| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc | 7.8 | 10.6 | 10.8 | 2% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 FIB 2M | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc | 5.3 | 4.2 | 4.6 | 10% | +| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc | 8.7 | 9.7 | 10.4 | 7% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc | 6.5 | 6.1 | 6.9 | 13% | +| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc | 7.1 | 8.3 | 9.2 | 11% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ - -PDR Throughput -~~~~~~~~~~~~~~ - -Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%: - +| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc | 7.1 | 7.6 | 8.3 | 9% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 | -| | | [Mpps] | [Mpps] | [Mpps] | Relative Change | -+===================+=================================================================+===========+===========+===========+=================+ | IPv4 FIB 200k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-pdrdisc | 8.5 | 9.0 | 9.7 | 8% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | IPv4 FIB 20k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-pdrdisc | 8.5 | 9.0 | 9.7 | 8% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc | 8.3 | 8.1 | 8.3 | 2% | +| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc | 8.3 | 8.1 | 8.1 | 0% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | IPv4 Policer | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-pdrdisc | 7.1 | 7.4 | 8.1 | 9% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc | 4.6 | 4.8 | 5.5 | 15% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc | 6.1 | 6.1 | 6.9 | 13% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | IPv6 FIB 200k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-pdrdisc | 6.9 | 5.3 | 5.3 | 0% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | IPv6 FIB 20k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-pdrdisc | 6.9 | 6.5 | 6.9 | 6% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ | IPv6 FIB 2M | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-pdrdisc | 5.3 | 4.2 | 4.6 | 10% | +-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ -| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc | 6.5 | 6.1 | 6.9 | 13% | -+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+ Known Issues ------------ @@ -210,14 +211,15 @@ Here is the list of known issues in CSIT |release| for VPP performance tests: | | for ip4scale200k, ip4scale2m scale IPv4 routed- | | Observed frequency: all test runs. | | | forwarding tests. ip4scale20k tests are fine. | | | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 2 | VAT API timeouts during ip6scale2m scale IPv6 | VPP-712 | Needs fixing VPP VAT API timeouts for large volume of IPv6 | -| | routed-forwarding tests when volume adding IPv6 | | routes. | -| | routes - 2M in this case. ip6scale2kk works. | | | +| 2 | Sporadic VAT API timeouts during ip6scale2m | VPP-712 | Needs fixing VPP VAT API timeouts for large volume of IPv6 | +| | scale IPv6 routed-forwarding tests when volume | | routes. | +| | adding IPv6 routes - 2M in this case. | | | +| | ip6scale200k works. | | | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 3 | Vic1385 and Vic1227 low performance | VPP-664 | Low NDR performance. | +| 3 | Vic1385 and Vic1227 low performance. | VPP-664 | Low NDR performance. | | | | | | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 4 | Sporadic NDR discovery test failures on x520 | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF | +| 4 | Sporadic NDR discovery test failures on x520. | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF | | | | | infrastructure. Issue can't be replicated outside LF. | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ | 5 | VPP in 2t2c setups - large variation | CSIT-568 | Suspected NIC firmware or DPDK driver issue affecting NDR |