docs/report/vpp_performance_tests/csit_release_notes.rst

   1 Release Notes
   2 =============
   3
   4 Changes in |csit-release|
   5 -------------------------
   6
   7 #. VPP PERFORMANCE TESTS
   8
   9    - **Service density 2n-skx tests**: Added higher NF density tests with
  10      802.1q (vlan) and 802.1ad (vxlan) encapsulation from Traffic Generator.
  11
  12    - **GBP tests**: Added GBP routing test cases with 802.1q (vlan) external
  13      traffic.
  14
  15    - **AVF IPv4 scale tests**: Increased coverage of AVF IPv4 base and scale
  16      test cases.
  17
  18    - **2n-skx tests**: Increased coverage of selected (COP, iACL, Policer)
  19      test cases.
  20
  21    - **IPsec scale tests**: Added IPsec interface mode scale tests with
  22      1, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 tunnels. Removed DPDK
  23      backend dependency.
  24
  25 #. TEST FRAMEWORK
  26
  27    - **CSIT PAPI Support**: Finished conversion of CSIT VAT L1 keywords to
  28      PAPI L1 KWs in CSIT using VPP Python bindings. Redesign of key components
  29      of PAPI Executor and PAPI history. Currently the only exception is
  30      usage of VAT command for scale configuration.
  31
  32    - **General Code Housekeeping**: Ongoing RF keywords optimizations,
  33      removal of redundant RF keywords and aligning of suite/test
  34      setup/teardowns.
  35
  36
  37 #. PRESENTATION AND ANALYTICS LAYER
  38
  39    - **Graphs Layout Improvements**: Improved performance graphs layout
  40      for better readibility and maintenance: test grouping, axis
  41      labels, descriptions, other informative decoration.
  42
  43 .. raw:: latex
  44
  45     \clearpage
  46
  47 .. _vpp_known_issues:
  48
  49 Known Issues
  50 ------------
  51
  52 List of known issues in |csit-release| for VPP performance tests:
  53
  54 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  55 | #  | JiraID                                  | Issue Description                                                                                        |
  56 +====+=========================================+==========================================================================================================+
  57 | 1  | `CSIT-570                               | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue.  |
  58 |    | <https://jira.fd.io/browse/CSIT-570>`_  | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds.    |
  59 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  60 | 2  | `CSIT-1503                              | [`TRex-519 <https://trex-tgn.cisco.com/youtrack/issue/trex-519>`_] XL710/XXV710 with FW 6.0.1 will have  |
  61 |    | <https://jira.fd.io/browse/CSIT-1503>`_ | Rx drop rate of 27MPPS.                                                                                  |
  62 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
  63 | 3  | `CSIT-1499                              | AVF tests are sporadically failing on initialization of AVF interface.                                   |
  64 |    | <https://jira.fd.io/browse/CSIT-1499>`_ |                                                                                                          |
  65 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+