\r
#. VPP performance test framework changes\r
\r
- - Added VAT command history collection for every test case as part of teardown.\r
+ - Added VAT command history collection for every test case as part of\r
+ teardown.\r
\r
#. Added VPP performance tests\r
\r
\r
- **vhost-user tests with one VM**\r
\r
- - L2 Bridge Domain switched-forwarding with Intel x710 NIC, Intel x520 NIC,\r
- Intel xl710 NIC.\r
+ - L2 Bridge Domain switched-forwarding with Intel x710 NIC, Intel x520\r
+ NIC, Intel xl710 NIC.\r
- VXLAN and L2 Bridge Domain switched-forwarding with Intel x520 NIC.\r
\r
- **vhost-user tests with two VMs service chain**\r
\r
- - L2 cross-connect switched-forwarding with Intel x520 NIC, Intel xl710 NIC.\r
- - L2 Bridge Domain switched-forwarding with Intel x520 NIC, Intel xl710 NIC.\r
+ - L2 cross-connect switched-forwarding with Intel x520 NIC, Intel xl710\r
+ NIC.\r
+ - L2 Bridge Domain switched-forwarding with Intel x520 NIC, Intel xl710\r
+ NIC.\r
- IPv4 routed-forwarding with Intel x520 NIC, Intel xl710 NIC.\r
\r
- **IPSec encryption with**\r
Substantial improvements in measured packet throughput have been\r
observed in a number of CSIT |release| tests listed below, with relative\r
increase of double-digit percentage points. Relative improvements are\r
-calculated against the test results listed in CSIT rls1701 report.\r
+calculated against the test results listed in CSIT |release-1| report.\r
VPP-16.09 numbers are provided for reference.\r
\r
NDR Throughput\r
| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |\r
| | | [Mpps] | [Mpps] | [Mpps] | Relative Change |\r
+===================+=================================================================+===========+===========+===========+=================+\r
-| L2XC-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc | 2.6 | 3.2 | 3.7 | 15% |\r
+| L2XC-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc | 2.6 | 3.2 | 3.7 | 15% |\r
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+\r
| L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-pdrdisc | 2.1 | 2.9 | 3.3 | 14% |\r
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+\r
Other changes in measured packet throughput, with either minor relative\r
increase or decrease, have been observed in a number of CSIT |release|\r
tests listed below. Relative changes are calculated against the test\r
-results listed in CSIT rls1701 report.\r
+results listed in CSIT |release-1| report.\r
\r
NDR Throughput\r
~~~~~~~~~~~~~~\r
| | for ip4scale200k, ip4scale2m scale IPv4 routed- | | Observed frequency: all test runs. |\r
| | forwarding tests. ip4scale20k tests are fine. | | |\r
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
-| 2 | Sporadic VAT API timeouts during ip6scale2m | VPP-712 | Needs fixing VPP VAT API timeouts for large volume of IPv6 |\r
-| | scale IPv6 routed-forwarding tests when volume | | routes. |\r
-| | adding IPv6 routes - 2M in this case. | | |\r
-| | ip6scale200k works. | | |\r
-+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
-| 3 | Vic1385 and Vic1227 low performance. | VPP-664 | Low NDR performance. |\r
+| 2 | Vic1385 and Vic1227 low performance. | VPP-664 | Low NDR performance. |\r
| | | | |\r
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
-| 4 | Sporadic NDR discovery test failures on x520. | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF |\r
+| 3 | Sporadic NDR discovery test failures on x520. | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF |\r
| | | | infrastructure. Issue can't be replicated outside LF. |\r
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
-| 5 | VPP in 2t2c setups - large variation | CSIT-568 | Suspected NIC firmware or DPDK driver issue affecting NDR |\r
+| 4 | VPP in 2t2c setups - large variation | CSIT-568 | Suspected NIC firmware or DPDK driver issue affecting NDR |\r
| | of discovered NDR throughput values across | | throughput. Applies to XL710 and X710 NICs, x520 NICs are fine. |\r
| | multiple test runs with xl710 and x710 NICs. | | |\r
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
-| 6 | Lower than expected NDR and PDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and |\r
+| 5 | Lower than expected NDR and PDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and |\r
| | xl710 and x710 NICs, compared to x520 NICs. | | PDR throughput. Applies to XL710 and X710 NICs. |\r
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+\r
\r