docs/report/vpp_performance_tests/csit_release_notes.rst

   1 Release Notes
   2 =============
   3
   4 Changes in |csit-release|
   5 -------------------------
   6
   7 #. VPP PERFORMANCE TESTS
   8
   9    - **Experimental Soak Tests**: Added performamce soak tests framework
  10      code for extended time duration tests and throughput discovery
  11      at given PLR and at give total test time e.g. minutes, hours,
  12      days, weeks, months, years. See updated
  13      :ref:`test_methodology` section for more details.
  14
  15 #. TEST FRAMEWORK
  16
  17    - **Container code optimizations**: Optimized container library allows to
  18      run containre_memif tests faster.
  19
  20    - **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to
  21      PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away
  22      from VAT.
  23
  24    - **General Code Housekeeping**: Ongoing RF keywords optimizations,
  25      removal of redundant RF keywords.
  26
  27 #. PRESENTATION AND ANALYTICS LAYER
  28
  29    - **Graphs Layout Improvements**: Improved performance graphs layout
  30      for better readibility and maintenance: test grouping, axis
  31      labels, descriptions, other informative decoration.
  32
  33 #. MISCELLANEOUS
  34
  35    - **2n-dnv Tests (3rd Party)**: Published performance tests for 2n-
  36      dnv (2-Node Atom Denverton) from 3rd party testbeds running FD.io
  37      |csit-release| automated testing code.
  38      Only graphs for Packet Throughput and Speedup Multi-core and not
  39      for Packet Latency were published as there are no results for Packet
  40      Latency available.
  41
  42 .. raw:: latex
  43
  44     \clearpage
  45
  46 .. _vpp_known_issues:
  47
  48 Known Issues
  49 ------------
  50
  51 List of known issues in |csit-release| for VPP performance tests:
  52
  53 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
  54 | #  | JiraID                                  | Issue Description                                                                                                               |
  55 +====+=========================================+=================================================================================================================================+
  56 | 1  | `CSIT-570                               | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue.                         |
  57 |    | <https://jira.fd.io/browse/CSIT-570>`_  | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds.                           |
  58 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
  59 | 2  | `VPP-1563                               | AVF L2patch tests are failing for all packet size and core combination. Reason: null-node blackholed packets in show error.     |
  60 |    | <https://jira.fd.io/browse/VPP-1563>`_  |                                                                                                                                 |
  61 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
  62 | 3  | `CSIT-1234                              | VPP IPSecHW/IPSecsW scale interface mode, low NDR and PDR 64B throughput in 3n-hsw testbeds, in CSIT-19.01 vs. CSIT-18.10.      |
  63 |    | <https://jira.fd.io/browse/CSIT-1234>`_ |                                                                                                                                 |
  64 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
  65 | 4  | `CSIT-1431                              | AVF 4 cores tests are sporadically failing. Under investigation.                                                                |
  66 |    | <https://jira.fd.io/browse/CSIT-1431>`_ |                                                                                                                                 |
  67 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
  68 | 5  | `CSIT-1465                              | 4c VPP VM vhost tests failing on 3n-skx. Under investigation.                                                                   |
  69 |    | <https://jira.fd.io/browse/CSIT-1465>`_ |                                                                                                                                 |
  70 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
  71 | 6  | `CSIT-1466                              | IPSecHW scale tests failing due to VPP reset. Under investigation.                                                              |
  72 |    | <https://jira.fd.io/browse/CSIT-1466>`_ |                                                                                                                                 |
  73 +----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+