53b9395746fbc78dee877411f898c3a0e4b2a858
[csit.git] / docs / report / vpp_performance_tests / csit_release_notes.rst
1 Release Notes
2 =============
3
4 Changes in |csit-release|
5 -------------------------
6
7 #. VPP PERFORMANCE TESTS
8
9    - **Service density 2n-skx tests**: Added higher NF density tests with two
10      NFs' data-plane threads sharing a physical core. VPP IPv4 routing is now
11      used as a VNF payload similar to CNF tests.
12
13    - **Soak Tests**: Optimized performamce soak tests framework
14      code for extended time duration tests and throughput discovery
15      at given PLR and at give total test time e.g. minutes, hours,
16      days, weeks. See updated
17      :ref:`test_methodology` section for more details.
18
19 #. TEST FRAMEWORK
20
21    - **Qemu code refactor**: Complete code refactor of the key components of
22      QemuUtil.py and QemuManager.py (L1 and L2 KW counterparts). Added
23      implementation of kernel-image-kvm based VM replacing the previously used
24      NestedVM images. Added ability to run VPP as a payload in VNF.
25
26    - **CSIT PAPI Support**: Continued conversion of CSIT VAT L1 keywords to
27      PAPI L1 KWs in CSIT using VPP Python bindings. Redesign of key components
28      of PAPI Executor and PAPI history.
29
30    - **General Code Housekeeping**: Ongoing RF keywords optimizations,
31      removal of redundant RF keywords.
32
33    - **Test suite generator**: Added capability to generate suites for
34      different NIC models as well as throughput search algorithm types. Uses
35      base tests suites as source.
36
37    - **TOX verification**: Added verifications for test suite generator.
38
39 #. PRESENTATION AND ANALYTICS LAYER
40
41    - **Graphs Layout Improvements**: Improved performance graphs layout
42      for better readibility and maintenance: test grouping, axis
43      labels, descriptions, other informative decoration.
44
45 ..
46     #. MISCELLANEOUS
47
48        - **2n-dnv Tests (3rd Party)**: Published performance tests for 2n-
49          dnv (2-Node Atom Denverton) from 3rd party testbeds running FD.io
50          |csit-release| automated testing code.
51          Only graphs for Packet Throughput and Speedup Multi-core and not
52          for Packet Latency were published as there are no results for Packet
53          Latency available.
54
55 .. raw:: latex
56
57     \clearpage
58
59 .. _vpp_known_issues:
60
61 Known Issues
62 ------------
63
64 List of known issues in |csit-release| for VPP performance tests:
65
66 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
67 | #  | JiraID                                  | Issue Description                                                                                        |
68 +====+=========================================+==========================================================================================================+
69 | 1  | `CSIT-570                               | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue.  |
70 |    | <https://jira.fd.io/browse/CSIT-570>`_  | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds.    |
71 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
72 | 2  | `CSIT-1501                              | Sporadic crypto backend fails loading `VPP-1670 <https://jira.fd.io/browse/VPP-1670>`_                   |
73 |    | <https://jira.fd.io/browse/CSIT-1501>`_ |                                                                                                          |
74 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
75 | 3  | `CSIT-1427                              | Sporadic HW aes-128-cbc-sha1 tunnel-interface tests are failing.                                         |
76 |    | <https://jira.fd.io/browse/CSIT-1427>`_ | `VPP-1671 <https://jira.fd.io/browse/VPP-1671>`_                                                         |
77 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
78 | 4  | `CSIT-1498                              | Memif tests are sporadically failing on initialization of memif connection.                              |
79 |    | <https://jira.fd.io/browse/CSIT-1498>`_ |                                                                                                          |
80 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
81 | 5  | `CSIT-1499                              | AVF tests are sporadically failing on initialization of AVF interface.                                   |
82 |    | <https://jira.fd.io/browse/CSIT-1499>`_ |                                                                                                          |
83 +----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.