CSIT rls1704 report - update to handcrafted sections:
[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst
index 4c942e1..193f685 100644 (file)
@@ -1,7 +1,7 @@
 CSIT Release Notes\r
 ==================\r
 \r
-Changes in CSIT |release|\r
+Changes in CSIT |release| - to be updated\r
 -------------------------\r
 \r
 #. VPP performance test environment changes\r
@@ -9,7 +9,7 @@ Changes in CSIT |release|
     - further VM and vhost-user test environment optimizations - Qemu virtio queue size increased from default value of 256 to 1024\r
     - addition of HW cryptodev devices in all three LF FD.io physical testbeds\r
 \r
-#. Added tests\r
+#. Added tests (to be updated)\r
 \r
     - NICs\r
 \r
@@ -29,7 +29,7 @@ Changes in CSIT |release|
       - L2 Bridge Domain switched-forwarding with vhost-user, VM and Intel x520\r
         NIC\r
 \r
-Performance Improvements\r
+Performance Improvements - to be updated\r
 ------------------------\r
 \r
 Substantial improvements in measured packet throughput, with relative increase\r
@@ -42,68 +42,70 @@ NDR Throughput
 \r
 Non-Drop Rate Throughput discovery tests:\r
 \r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01       | Relative Improvement |\r
-+===================+=================================================================+===========+=================+======================+\r
-| L2XC              | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc                      | 9.4 Mpps  | 12.7 Mpps       | 35%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC              | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc                     | 9.5 Mpps  | 12.2..12.4 Mpps | 28..30%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC dot1ad       | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc                   | 7.4 Mpps  | 8.8..9.0 Mpps   | 19..23%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC dot1q        | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc                    | 7.5 Mpps  | 8.8..9.0 Mpps   | 17..20%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC VxLAN        | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc              | 5.4 Mpps  | 6.5 Mpps        | 20%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-ndrdisc       | 0.5 Mpps  | 2.8..3.2 Mpps   | 460..540%            |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2BD              | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc                | 7.8 Mpps  | 10.4..10.6 Mpps | 33..36%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2BD-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4 Mpps  | 2.7..2.8 Mpps   | 575..600%            |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4              | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc                    | 8.7 Mpps  | 9.7 Mpps        | 12%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 COP          | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc     | 7.1 Mpps  | 8.3..8.5 Mpps   | 17..20%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 iAcl         | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc        | 6.9 Mpps  | 7.6..7.8 Mpps   | 10..13%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 vhost        | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc     | 0.3 Mpps  | 2.6 Mpps        | 767%                 |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6              | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc                    | 3.0 Mpps  | 7.3..7.7 Mpps   | 143..157%            |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
++-------------------+-----------------------------------------------------------------+------------+-----------+----------------------------+\r
+| VPP Functionality | Test Name                                                       | VPP-16.09  | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |\r
+|                   |                                                                 |   [Mpps]   |  [Mpps]   |   [Mpps]  |  Improvement   |\r
++===================+=================================================================+============+===========+===========+================+\r
+| L2XC              | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc                      | 9.4        | 12.7      | 13.4      | 6%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2XC              | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc                     | 9.5        | 12.2      | 12.4      | 2%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2XC dot1ad       | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc                   | 7.4        | 8.8       | 9.3       | 6%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2XC dot1q        | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc                    | 7.5        | 8.8       | 9.2       | 5%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2XC VxLAN        | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc              | 5.4        | 6.5       | 6.8       | 5%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2XC-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-ndrdisc       | 0.5        | 2.8       | 3.2       | 14%            |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2BD              | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc                | 7.8        | 10.4      | 10.8      | 4%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| L2BD-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4        | 2.7       | 3.4       | 26%            |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| IPv4              | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc                    | 8.7        | 9.7       | 10.6      | 9%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| IPv4 COP          | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc     | 7.1        | 8.3       | 9.0       | 8%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| IPv4 iAcl         | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc        | 6.9        | 7.6       | 8.3       | 9%             |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| IPv4 vhost        | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc     | 0.3        | 2.6       | 3.1       | 19%            |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
+| IPv6              | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc                    | 3.0        | 7.3       | 8.5       | 16%            |\r
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+----------------+\r
 \r
 PDR Throughput\r
 ~~~~~~~~~~~~~~\r
 \r
 Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:\r
 \r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01       | Relative Improvement |\r
-+===================+=================================================================+===========+=================+======================+\r
-| L2XC              | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc                      | 9.4 Mpps  | 12.7..12.9 Mpps | 35..37%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC dot1ad       | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc                   | 7.4 Mpps  | 8.8..9.1 Mpps   | 19..23%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC dot1q        | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc                    | 7.5 Mpps  | 8.8..9.0 Mpps   | 17..20%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC VxLAN        | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc              | 5.4 Mpps  | 6.5 Mpps        | 20%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2XC-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc       | 2.6 Mpps  | 3.2..3.3 Mpps   | 23..26%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2BD              | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc                | 7.8 Mpps  | 10.6 Mpps       | 36%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| L2BD-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-pdrdisc | 2.1 Mpps  | 2.9 Mpps        | 38%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4              | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc                    | 8.7 Mpps  | 9.7 Mpps        | 11%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 COP          | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc     | 7.1 Mpps  | 8.3..8.5 Mpps   | 17..20%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 vhost        | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc     | 2.0 Mpps  | 2.7 Mpps        | 35%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-------------------------+\r
+| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | Relative    |\r
+|                   |                                                                 |   [Mpps]  |  [Mpps]   |   [Mpps]  | Improvement |\r
++===================+=================================================================+===========+===========+===========+=============+\r
+| L2XC              | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc                      | 9.4       | 12.7      | 13.4      |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| L2XC dot1ad       | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc                   | 7.4       | 8.8       | 9.3       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| L2XC dot1q        | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc                    | 7.5       | 8.8       | 9.5       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| L2XC VxLAN        | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc              | 5.4       | 6.5       | 6.8       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| L2XC-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc       | 2.6       | 3.2       | 3.2       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| L2BD              | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc                | 7.8       | 10.6      | 11.1      |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| L2BD-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-pdrdisc | 2.1       | 2.9       | 3.2       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4              | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc                    | 8.7       | 9.7       | 10.6      |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 COP          | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc     | 7.1       | 8.3       | 9.2       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 vhost        | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc     | 2.0       | 2.7       | 3.2       |   %         |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
 \r
 Measured improvements are in line with VPP code optimizations listed in\r
-`VPP-17.01 release notes\r
-<https://docs.fd.io/vpp/17.01/release_notes_1701.html>`_.\r
+`VPP-17.04 release notes\r
+<https://docs.fd.io/vpp/17.04/release_notes_1704.html>`_.\r
 \r
 Additionally, vhost-VM performance improvements are due to both VPP code\r
 optimizations as well as due to the FD.io CSIT Linux KVM test environment\r
@@ -111,7 +113,7 @@ optimizations for vhost-VM tests - see section "2.1.7. Methodology: KVM VM
 vhost".\r
 \r
 \r
-Other Performance Changes\r
+Other Performance Changes - to be updated\r
 -------------------------\r
 \r
 Other changes in measured packet throughput, with either minor relative\r
@@ -124,67 +126,69 @@ NDR Throughput
 \r
 Non-Drop Rate Throughput discovery tests:\r
 \r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01       | Relative Change      |\r
-+===================+=================================================================+===========+=================+======================+\r
-| IPv4 FIB 200k     | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc               | 8.5 Mpps  | 9.0 Mpps        | 6%                   |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 FIB 20k      | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc                | 8.5 Mpps  | 9.0..9.2 Mpps   | 6..8%                |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 FIB 2M       | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc                 | 8.5 Mpps  | 7.8..8.1 Mpps   | -8..-5%              |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 Policer      | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc    | 6.9 Mpps  | 7.4..7.6 Mpps   | 7..10%               |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 LISP         | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc             | 4.4 Mpps  | 4.8 Mpps        | 9%                   |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 COP          | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc     | 6.1 Mpps  | 6.1..6.5 Mpps   | 0..7%                |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 FIB 200k     | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc               | 6.5 Mpps  | 5.3..5.7 Mpps   | -18..-12%            |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 FIB 20k      | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc                | 6.9 Mpps  | 6.5 Mpps        | -6%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 FIB 2M       | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc                 | 5.3 Mpps  | 4.2 Mpps        | -21%                 |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 iAcl         | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc        | 6.5 Mpps  | 6.1..6.5 Mpps   | -6..0%               |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-------------------------+\r
+| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | Relative    |\r
+|                   |                                                                 |   [Mpps]  |  [Mpps]   |   [Mpps]  | Change      |\r
++===================+=================================================================+===========+===========+===========+=============+\r
+| IPv4 FIB 200k     | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc               | 8.5       | 9.0       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 FIB 20k      | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc                | 8.5       | 9.0       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 FIB 2M       | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc                 | 8.5       | 7.8       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 Policer      | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc    | 6.9       | 7.4       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 LISP         | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc             | 4.4       | 4.8       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 COP          | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc     | 6.1       | 6.1       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 FIB 200k     | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc               | 6.5       | 5.3       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 FIB 20k      | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc                | 6.9       | 6.5       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 FIB 2M       | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc                 | 5.3       | 4.2       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 iAcl         | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc        | 6.5       | 6.1       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
 \r
 PDR Throughput\r
 ~~~~~~~~~~~~~~\r
 \r
 Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:\r
 \r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01       | Relative Change      |\r
-+===================+=================================================================+===========+=================+======================+\r
-| IPv4 FIB 200k     | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-pdrdisc               | 8.5 Mpps  | 9.0 Mpps        | 6%                   |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 FIB 20k      | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-pdrdisc                | 8.5 Mpps  | 9.0..9.2 Mpps   | 6..8%                |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 FIB 2M       | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc                 | 8.3 Mpps  | 8.1 Mpps        | -2%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 iAcl         | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc        | 7.1 Mpps  | 7.6..7.8 Mpps   | 7..10%               |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 Policer      | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-pdrdisc    | 7.1 Mpps  | 7.4..7.6 Mpps   | 4..7%                |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv4 LISP         | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc             | 4.6 Mpps  | 4.8 Mpps        | 9%                   |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6              | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc                    | 7.7 Mpps  | 7.3..7.7 Mpps   | -5..0%               |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 COP          | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc     | 6.1 Mpps  | 6.1..6.5 Mpps   | 0..7%                |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 FIB 200k     | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-pdrdisc               | 6.9 Mpps  | 5.3..5.7 Mpps   | -23..-17%            |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 FIB 20k      | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-pdrdisc                | 6.9 Mpps  | 6.5 Mpps        | -6%                  |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 FIB 2M       | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-pdrdisc                 | 5.3 Mpps  | 4.2 Mpps        | -21%                 |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-| IPv6 iAcl         | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc        | 6.5 Mpps  | 6.1..6.5 Mpps   | -6..0%               |\r
-+-------------------+-----------------------------------------------------------------+-----------+-----------------+----------------------+\r
-\r
-Known Issues\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-------------------------+\r
+| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | Relative    |\r
+|                   |                                                                 |   [Mpps]  |  [Mpps]   |   [Mpps]  | Change      |\r
++===================+=================================================================+===========+===========+===========+=============+\r
+| IPv4 FIB 200k     | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-pdrdisc               | 8.5       | 9.0       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 FIB 20k      | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-pdrdisc                | 8.5       | 9.0       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 FIB 2M       | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc                 | 8.3       | 8.1       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 iAcl         | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc        | 7.1       | 7.6       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 Policer      | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-pdrdisc    | 7.1       | 7.4       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv4 LISP         | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc             | 4.6       | 4.8       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6              | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc                    | 7.7       | 7.3       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 COP          | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc     | 6.1       | 6.1       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 FIB 200k     | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-pdrdisc               | 6.9       | 5.3       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 FIB 20k      | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-pdrdisc                | 6.9       | 6.5       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 FIB 2M       | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-pdrdisc                 | 5.3       | 4.2       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+| IPv6 iAcl         | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc        | 6.5       | 6.1       |           |  %          |\r
++-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-------------+\r
+\r
+Known Issues - to be updated\r
 ------------\r
 \r
-Here is the list of known issues in CSIT |release| for VPP performance tests:\r
+Here is the list of known issues in CSIT |release| for VPP performance tests: (to be updated)\r
 \r
 +---+-------------------------------------------------+-----------------------------------------------------------------+\r
 | # | Issue                                           | Description                                                     |\r
@@ -192,9 +196,6 @@ Here is the list of known issues in CSIT |release| for VPP performance tests:
 | 1 | Sporadic IPv4 routed-forwarding NDR discovery   | Suspected issue with DPDK IPv4 checksum calculation.            |\r
 |   | test failures for 1518B frame size              | Observed frequency: sporadic, ca. 20% to 30% of test runs.      |\r
 +---+-------------------------------------------------+-----------------------------------------------------------------+\r
-| 2 | Vic1385 and Vic1227 NICs jumbo frames test      | Suspected issue with VIC DPDK drivers that do not support jumbo |\r
-|   | failures (9000B)                                | frames (dropped rx-miss). Observed frequency: 100%.             |\r
-+---+-------------------------------------------------+-----------------------------------------------------------------+\r
 | 3 | Vic1385 and Vic1227 performance                 | Low performance of NDR results. Big difference between NDR and  |\r
 |   |                                                 | PDR.                                  .                         |\r
 +---+-------------------------------------------------+-----------------------------------------------------------------+\r