Code Review / csit.git / blobdiff
? search:
summary | shortlog | log | commit | commitdiff | review | tree
raw | inline | side by side
CSIT rls1704 report - small updates
[csit.git] / docs / report / vpp_functional_tests / csit_release_notes.rst
diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst
index 7c4202e..25ca27c 100644 (file)
--- a/docs/report/vpp_functional_tests/csit_release_notes.rst
+++ b/docs/report/vpp_functional_tests/csit_release_notes.rst
@@ -4,63 +4,70 @@ CSIT Release Notes
 Changes in CSIT |release|
 -------------------------
 
 Changes in CSIT |release|
 -------------------------
 
-#. Introduction of Centos7 tests
+#. VPP functional test environment changes
 
 
-#. Added VPP functional tests
+    - Implemented VAT command history collection for every test case as part of teardown.
+    - Introduction of Centos7 tests in VIRL environment.
+
+#. VPP functional test framework changes
 
 
-    - IPv4 routed-forwarding with dot1q VLAN sub-interfaces
-    - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM
-    - IPv4 routed-forwarding with vhost-user interfaces to VM
-    - Vhost-User interface re-connect tests
+    - Added VAT command history collection for every test case as part of teardown.
 
 
-#. Implemented VAT command history collection for every test case as part of teardown.
+#. Added VPP functional tests
 
 
+    - IPv4 routed-forwarding with dot1q VLAN sub-interfaces.
+    - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM.
+    - IPv4 routed-forwarding with vhost-user interfaces to VM.
+    - Vhost-user interface re-connect tests.
 
 Known Issues
 ------------
 
 Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL:
 
 
 Known Issues
 ------------
 
 Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL:
 
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| # | Issue                                           | Description                                                     |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | Client replies with DHCPv4 REQUEST message when received DHCPv4 |
-|   | sent with different XID                         | OFFER message with different (wrong) XID.                       |
-|   |                                                 | Jira: ` CSIT-129 <https://jira.fd.io/browse/CSIT-129>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | IPv6 destination address is wrongly calculated in case that     |
-|   | destination address when IPv4 prefix is 0       | IPv4 prefix is equal to 0 and IPv6 prefix is less than 40.      |
-|   |                                                 | Jira: ` CSIT-398 <https://jira.fd.io/browse/CSIT-398>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 3 | Softwire - MAP-E: Map domain is created when    | Map domain is created in case that the sum of suffix length of  |
-|   | incorrect parameters provided                   | IPv4 prefix and PSID length is greater than EA bits length.     |
-|   |                                                 | IPv6 destination address contains bits writen with PSID over    |
-|   |                                                 | the EA-bit length when IPv4 packet is sent.                     |
-|   |                                                 | Jira: ` CSIT-399 <https://jira.fd.io/browse/CSIT-399>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 4 | IPv6 RA: Incorrect IPv6 destination address in  | Wrong IPv6 destination address (ff02::1) is used in ICMPv6      |
-|   | response to ICMPv6 Router Solicitation          | Router Advertisement packet sent as a response to received      |
-|   |                                                 | ICMPv6 Router Solicitation packet.                              |
-|   |                                                 | Jira: ` CSIT-409 <https://jira.fd.io/browse/CSIT-409>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 5 | IPFIX: IPv6_src key name reported instead of    | The report contains IPv6_src key name instead of IPv6_dst when  |
-|   | IPv6_dst                                        | classify session is configured with IPv6 destination address.   |
-|   |                                                 | Anyhow the correct IPv6 destination address is reported.        |
-|   |                                                 | Jira: ` CSIT-402 <https://jira.fd.io/browse/CSIT-402>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | Dot1q tagged packets are thrown away in case of IPv4 routing on |
-|   | work with virtio driver                         | interface binded to virtio driver.                              |
-|   |                                                 | Jira: ` CSIT-564 <https://jira.fd.io/browse/CSIT-564>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 7 | VHOST-user: QEMU re-connect doesn't work        | Used QEMU 2.5.0 doesn't support re-connection. Usage of QEMU    |
-|   |                                                 | 2.7.0 is not recommended by vpp-dev team at the moment.         |
-|   |                                                 | Jira: ` CSIT-565 <https://jira.fd.io/browse/CSIT-565>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 8 | Centos7: LISP and VXLAN test failures           | We can observe crash of SUT1 VM during LISP tests execution,    |
-|   |                                                 | that leads to failure of all other tests (sometimes observed    |
-|   |                                                 | during VXLAN tests execution too).                              |
-|   |                                                 | NOTE: Possible root cause identified after upgrade of one of    |
-|   |                                                 | VIRL servers. When fix is confirmed in a short time it will be  |
-|   |                                                 | merged to CSIT rls1704 branch.                                  |
-|   |                                                 | Jira: ` CSIT-566 <https://jira.fd.io/browse/CSIT-566>`_         |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| # | Issue                                           | Jira ID  | Description                                          |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when      |
+|   | sent with different XID                         |          | received DHCPv4 OFFER message with different (wrong) |
+|   |                                                 |          | XID.                                                 |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in    |
+|   | destination address when IPv4 prefix is 0       |          | case that IPv4 prefix is equal to 0 and IPv6 prefix  |
+|   |                                                 |          | is less than 40.                                     |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 3 | Softwire - MAP-E: Map domain is created when    | CSIT-399 | Map domain is created in case that the sum of suffix |
+|   | incorrect parameters provided                   |          | length of IPv4 prefix and PSID length is greater     |
+|   |                                                 |          | than EA bits length. IPv6 destination address        |
+|   |                                                 |          | contains bits writen with PSID over the EA-bit       |
+|   |                                                 |          | length when IPv4 packet is sent.                     |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 4 | IPv6 RA: Incorrect IPv6 destination address in  | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in  |
+|   | response to ICMPv6 Router Solicitation          |          | ICMPv6 Router Advertisement packet sent as a         |
+|   |                                                 |          | response to received  ICMPv6 Router Solicitation     |
+|   |                                                 |          | packet.                                              |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 5 | IPFIX: IPv6_src key name reported instead of    | CSIT-402 | The report contains IPv6_src key name instead of     |
+|   | IPv6_dst                                        |          | IPv6_dst when classify session is configured with    |
+|   |                                                 |          | IPv6 destination address. Anyhow the correct IPv6    |
+|   |                                                 |          | destination address is reported.                     |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
+|   | work with virtio driver                         |          | routing on interface binded to virtio driver. Issue  |
+|   |                                                 |          | with VIRL test simulation environment                |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 7 | Vhost-user: QEMU reconnect doesn't work         | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user    |
+|   |                                                 |          | reconnect. It requires moving CSIT VIRL environment  |
+|   |                                                 |          | to QEMU 2.7.0.                                       |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 8 | Centos7: LISP and VXLAN sporadic test failures  | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP    |
+|   |                                                 |          | and VXLAN test executions, what leads to failure of  |
+|   |                                                 |          | all other tests in the suite. NOTE: After upgrading  |
+|   |                                                 |          | one of the VIRL servers host from Ubuntu14.04 to     |
+|   |                                                 |          | 16.04, DUT1 VM stops crashing, but tests keep        |
+|   |                                                 |          | failing sporadically 1-in-100. Possible root cause   |
+|   |                                                 |          | identified - unexpected IPv6 RA packets upsetting    |
+|   |                                                 |          | some test component. Currently suspecting            |
+|   |                                                 |          | environment or CSIT issue, but can not exclude VPP,  |
+|   |                                                 |          | further troubleshooting in progress.                 |
++---+-------------------------------------------------+----------+------------------------------------------------------+
Integration tests