docs/report/vpp_performance_tests/csit_release_notes.rst

   1 Release Notes
   2 =============
   3
   4 Changes in |csit-release|
   5 -------------------------
   6
   7 #. VPP PERFORMANCE TESTS
   8
   9    - **Service density 2n-skx tests**: Added higher NF density tests with
  10      802.1q (vlan) and 802.1ad (vxlan) encapsulation from Traffic Generator.
  11
  12    - **GBP tests**: Added GBP routing test cases with 802.1q (vlan) external
  13      traffic.
  14
  15    - **AVF IPv4 scale tests**: Increased coverage of AVF IPv4 base and scale
  16      test cases.
  17
  18    - **2n-skx tests**: Increased coverage of selected (COP, iACL, Policer)
  19      test cases.
  20
  21    - **IPsec scale tests**: Added IPsec interface mode scale tests with
  22      1, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 tunnels. Removed DPDK
  23      backend dependency.
  24
  25    - **Hoststack TCP tests**: Added Hoststack TCP performance tests
  26      using WRK to the HTTP static server plugin measuring connections
  27      per second and requests per second.
  28
  29 #. TEST FRAMEWORK
  30
  31    - **CSIT PAPI Support**: Finished conversion of CSIT VAT L1 keywords to
  32      PAPI L1 KWs in CSIT using VPP Python bindings. Redesign of key components
  33      of PAPI Executor and PAPI history. Currently the only exception is
  34      usage of VAT command for scale configuration.
  35
  36    - **General Code Housekeeping**: Ongoing RF keywords optimizations,
  37      removal of redundant RF keywords and aligning of suite/test
  38      setup/teardowns.
  39
  40
  41 #. PRESENTATION AND ANALYTICS LAYER
  42
  43    - **Graphs Layout Improvements**: Improved performance graphs layout
  44      for better readibility and maintenance: test grouping, axis
  45      labels, descriptions, other informative decoration.
  46
  47 .. raw:: latex
  48
  49     \clearpage
  50
  51 .. _vpp_known_issues:
  52
  53 Known Issues
  54 ------------
  55
  56 List of known issues in |csit-release| for VPP performance tests:
  57
  58 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  59 | #  | JiraID                                  | Issue Description                                                                                        |
  60 +====+=========================================+==========================================================================================================+
  61 | 1  | `CSIT-570                               | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue.  |
  62 |    | <https://jira.fd.io/browse/CSIT-570>`_  | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds.    |
  63 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  64 | 2  | `CSIT-1503                              | [`TRex-519 <https://trex-tgn.cisco.com/youtrack/issue/trex-519>`_] XL710/XXV710 with FW 6.0.1 will have  |
  65 |    | <https://jira.fd.io/browse/CSIT-1503>`_ | Rx drop rate of 27MPPS.                                                                                  |
  66 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  67 | 3  | `CSIT-1499                              | AVF tests are sporadically failing on initialization of AVF interface.                                   |
  68 |    | <https://jira.fd.io/browse/CSIT-1499>`_ |                                                                                                          |
  69 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+