docs/report/vpp_performance_tests/csit_release_notes.rst

   1 Release Notes
   2 =============
   3
   4 Changes in |csit-release|
   5 -------------------------
   6
   7 #. VPP PERFORMANCE TESTS
   8
   9    - **Service density 2n-skx tests**: Added higher NF density tests with
  10      802.1q (vlan) and 802.1ad (vxlan) encapsulation from Traffic Generator.
  11
  12    - **GBP tests**: Added GBP routing test cases with 802.1q (vlan) external
  13      traffic.
  14
  15    - **AVF IPv4 scale tests**: Increased coverage of AVF IPv4 base and scale
  16      test cases.
  17
  18    - **2n-skx tests**: Increased coverage of selected (COP, iACL, Policer)
  19      test cases.
  20
  21    - **IPsec scale tests**: Added IPsec interface mode scale tests with
  22      1, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 tunnels. Removed DPDK
  23      backend dependency.
  24
  25    - **Hoststack TCP tests**: Added Hoststack TCP performance tests
  26      using WRK to the HTTP static server plugin measuring connections
  27      per second and requests per second.
  28
  29    - **Changed methodology of dot1q 2n tests**: dot1q encapsulation is now used
  30      on both links of SUT. Previously dot1q was used only on a single link with
  31      the other link carrying untagged Ethernet frames. This change results in
  32      slightly lower throughput in CSIT-1908 for these tests.
  33
  34 #. TEST FRAMEWORK
  35
  36    - **CSIT PAPI Support**: Finished conversion of CSIT VAT L1 keywords to
  37      PAPI L1 KWs in CSIT using VPP Python bindings. Redesign of key components
  38      of PAPI Executor and PAPI history. Currently the only exception is
  39      usage of VAT command for scale configuration.
  40
  41    - **General Code Housekeeping**: Ongoing RF keywords optimizations,
  42      removal of redundant RF keywords and aligning of suite/test
  43      setup/teardowns.
  44
  45
  46 #. PRESENTATION AND ANALYTICS LAYER
  47
  48    - **Graphs Layout Improvements**: Improved performance graphs layout
  49      for better readibility and maintenance: test grouping, axis
  50      labels, descriptions, other informative decoration.
  51
  52 .. raw:: latex
  53
  54     \clearpage
  55
  56 .. _vpp_known_issues:
  57
  58 Known Issues
  59 ------------
  60
  61 List of known issues in |csit-release| for VPP performance tests:
  62
  63 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  64 | #  | JiraID                                  | Issue Description                                                                                        |
  65 +====+=========================================+==========================================================================================================+
  66 | 1  | `CSIT-570                               | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue.  |
  67 |    | <https://jira.fd.io/browse/CSIT-570>`_  | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds.    |
  68 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  69 | 2  | `CSIT-1503                              | [`TRex-519 <https://trex-tgn.cisco.com/youtrack/issue/trex-519>`_] XL710/XXV710 with FW 6.0.1 will have  |
  70 |    | <https://jira.fd.io/browse/CSIT-1503>`_ | Rx drop rate of 27MPPS.                                                                                  |
  71 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  72 | 3  | `CSIT-1499                              | AVF tests are sporadically failing on initialization of AVF interface.                                   |
  73 |    | <https://jira.fd.io/browse/CSIT-1499>`_ |                                                                                                          |
  74 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+