report 1807: list and table formatting fixes.
[csit.git] / docs / report / vpp_functional_tests / csit_release_notes.rst
index fd71d78..84cb3b6 100644 (file)
@@ -1,73 +1,51 @@
-CSIT Release Notes
-==================
+Release Notes
+=============
 
-Changes in CSIT |release|
+Changes in |csit-release|
 -------------------------
 
-#. VPP functional test framework changes:
+#. **CSIT Framework**
 
-   - Upgrade of tb4-virl1 and tb4-virl2 hosts;
+   - Few test case bug fixes.
 
-     - OS version to Ubuntu 16.04.02;
+#. **Test Case Porting to VPP_make_test**
 
-     - VIRL version to Mitaka;
+   - Implementation of VIRL functional integration tests in
+     VPP_make_test.
 
-   - Implemented load balance mechanism for VIRL hosts;
-
-   - Implemented waiting mechanism on VIRL host if there is not enough resources
-     available to successfully start simulation;
-
-#. Code updates and optimizations in CSIT functional framework:
-
-   - Complete CSIT framework code revision and optimizations as descried
-     on CSIT wiki page
-     _`Design_Optimizations <https://wiki.fd.io/view/CSIT/Design_Optimizations>`_;
-
-   - For more detail see the CSIT Framework Design section in this
-     report;
+   - All VIRL tests identified by FD.io VPP and CSIT projects as
+     Priority-0 ported to VPP_make_test.
+     Ref. `CSIT_VIRL migration progress
+     <https://docs.google.com/spreadsheets/d/1PciV8XN9v1qHbIRUpFJoqyES29_vik7lcFDl73G1usc/edit?usp=sharing>`_.
 
 Known Issues
 ------------
 
-Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL:
+List of known issues in |csit-release| for VPP functional tests in VIRL:
 
 +---+-------------------------------------------------+----------+------------------------------------------------------+
-| # | Issue                                           | Jira ID  | Description                                          |
-+---+-------------------------------------------------+----------+------------------------------------------------------+
+| # | .. centered:: Issue                             | Jira ID  | .. centered:: Description                            |
++===+=================================================+==========+======================================================+
 | 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when      |
-|   | sent with different XID.                        |          | received DHCPv4 OFFER message with different (wrong) |
+|   | sent with different XID.                        | VPP-99   | received DHCPv4 OFFER message with different (wrong) |
 |   |                                                 |          | XID.                                                 |
 +---+-------------------------------------------------+----------+------------------------------------------------------+
 | 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in    |
-|   | destination address when IPv4 prefix is 0.      |          | case that IPv4 prefix is equal to 0 and IPv6 prefix  |
+|   | destination address when IPv4 prefix is 0.      | VPP-380  | case that IPv4 prefix is equal to 0 and IPv6 prefix  |
 |   |                                                 |          | is less than 40.                                     |
 +---+-------------------------------------------------+----------+------------------------------------------------------+
 | 3 | Softwire - MAP-E: Map domain is created when    | CSIT-399 | Map domain is created in case that the sum of suffix |
-|   | incorrect parameters provided.                  |          | length of IPv4 prefix and PSID length is greater     |
+|   | incorrect parameters provided.                  | VPP-435  | length of IPv4 prefix and PSID length is greater     |
 |   |                                                 |          | than EA bits length. IPv6 destination address        |
 |   |                                                 |          | contains bits writen with PSID over the EA-bit       |
 |   |                                                 |          | length when IPv4 packet is sent.                     |
 +---+-------------------------------------------------+----------+------------------------------------------------------+
 | 4 | IPv6 RA: Incorrect IPv6 destination address in  | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in  |
-|   | response to ICMPv6 Router Solicitation.         |          | ICMPv6 Router Advertisement packet sent as a         |
+|   | response to ICMPv6 Router Solicitation.         | VPP-406  | ICMPv6 Router Advertisement packet sent as a         |
 |   |                                                 |          | response to received  ICMPv6 Router Solicitation     |
 |   |                                                 |          | packet.                                              |
 +---+-------------------------------------------------+----------+------------------------------------------------------+
-| 5 | Vhost-user: QEMU reconnect does not work.       | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user    |
-|   |                                                 |          | reconnect. It requires moving CSIT VIRL environment  |
+| 5 | Vhost-user: QEMU reconnect does not work.       | CSIT-565 | Used QEMU 2.5.0 does not support vhost-user          |
+|   |                                                 |          | reconnect. Requires upgrading CSIT VIRL environment  |
 |   |                                                 |          | to QEMU 2.7.0.                                       |
 +---+-------------------------------------------------+----------+------------------------------------------------------+
-| 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP    |
-|   |                                                 |          | and VXLAN test executions, what leads to failure of  |
-|   |                                                 |          | all other tests in the suite. NOTE: After upgrading  |
-|   |                                                 |          | one of the VIRL servers host from Ubuntu14.04 to     |
-|   |                                                 |          | 16.04, DUT1 VM stops crashing, but tests keep        |
-|   |                                                 |          | failing sporadically 1-in-100. Possible root cause   |
-|   |                                                 |          | identified - unexpected IPv6 RA packets upsetting    |
-|   |                                                 |          | some test component. Currently suspecting            |
-|   |                                                 |          | environment or CSIT issue, but can not exclude VPP,  |
-|   |                                                 |          | further troubleshooting in progress.                 |
-+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 7 | IPSEC: Tests cover old crypto code path         |    --    | There are used default conf settings so IPSEC tests  |
-|   |                                                 |          | use old security code not the new Crypto SW code.    |
-+---+-------------------------------------------------+----------+------------------------------------------------------+