- - **Service density 2n-skx tests**: Network Function Virtualization (NFV)
- service density tests focus on measuring total per server throughput at
- varied NFV service *packing* densities with vswitch providing host
- dataplane. The goal is to compare and contrast performance of a shared
- vswitch for different network topologies and virtualization technologies,
- and their impact on vswitch performance and efficiency in a range of NFV
- service configurations.
-
- - **Experimental Soak Tests**: Added performamce soak tests framework
- code for extended time duration tests and throughput discovery
- at given PLR and at give total test time e.g. minutes, hours,
- days, weeks, months, years. See updated
- :ref:`test_methodology` section for more details.
+ - **Intel Xeon 2n-skx, 3n-skx testbeds**: VPP performance test data
+ is provided using a different CSIT test environment compared to
+ CSIT-1908.1 and CSIT-1908. The changes were applied during the
+ CSIT-2001 development cycle.
+
+ - CSIT test environment is now versioned, with ver. 1 associated
+ with CSIT rls1908 git branch as of 2019-08-21, and ver. 2
+ associated with CSIT rls2001 git branch as of 2020-03-27.
+
+ - To identify performance changes due to VPP code changes from
+ v19.08.1 to v19.08.2, both have been tested in CSIT
+ environment ver. 2. See
+ :ref:`vpp_compare_current_vs_previous_release` and
+ :ref:`vpp_known_issues`.
+
+ - **Intel Xeon 2n-clx testbeds**: VPP performance test data is now
+ included in this report. See :ref:`vpp_known_issues`.
+
+ - **Service density 2n-skx tests**: Added higher NF density tests with
+ 802.1q (vlan) and VXLAN encapsulation from Traffic Generator.
+
+ - **GBP tests**: Added GBP (Group Based Policy) routing test cases
+ with 802.1q (vlan) external traffic.
+
+ - **AVF IPv4 scale tests**: Increased coverage of AVF IPv4 base and
+ scale test cases (Fortville NICs only).
+
+ - **2n-skx tests**: Increased coverage of selected (COP, iACL,
+ Policer) test cases.
+
+ - **IPsec scale tests**: Added IPsec interface mode scale tests with
+ 1, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 IPsec tunnels.
+ Removed DPDK backend dependency. Major IPsec test code
+ refactoring.
+
+ - **Hoststack TCP/IP tests**: Major refactor of Hoststack TCP
+ performance tests using WRK generator talking to the VPP HTTP
+ static server plugin measuring connections per second and
+ requests per second.
+
+ - **Changed methodology of dot1q tests in 2-Node testbeds**: dot1q
+ encapsulation is now used on both links of SUT. Previously dot1q
+ was used only on a single link with the other link carrying
+ untagged Ethernet frames. This change results in slightly lower
+ throughput in CSIT-1908 for all dot1q tests in all 2-Node
+ testbeds.
+
+ - **KVM VM vhost-user tests**: completed move to Kernel-VM for all
+ tests. In addition to running DPDK Testpmd as VM workload, new
+ tests created with VPP as VM workload. VPP in VM is the same
+ version as the DUT VPP (acting as vSwitch) and its configuration
+ depends on the test type. For all L2 Ethernet Switching tests
+ it's vpp-l2xc (L2 cross-connect), for all IPv4 Routing tests it's
+ vpp-ip4 (VPP IPv4 routing).