Changes in CSIT |release|
-------------------------
-#. Introduction of Centos7 tests
+#. VPP functional test framework changes:
-#. Implemented VAT command history collection for every test case as part of teardown
+ - Upgrade of tb4-virl1 and tb4-virl2 hosts;
-#. Added VPP functional tests
+ - OS version to Ubuntu 16.04.02;
- - IPv4 routed-forwarding with dot1q VLAN sub-interfaces
- - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM
- - IPv4 routed-forwarding with vhost-user interfaces to VM
- - Vhost-User interface re-connect tests
+ - VIRL version to Mitaka;
+
+ - Implemented load balance mechanism for VIRL hosts;
+
+ - Implemented waiting mechanism on VIRL host if there is not enough resources
+ available to successfully start simulation;
+
+#. Code updates and optimizations in CSIT functional framework:
+
+ - Complete CSIT framework code revision and optimizations as descried
+ on CSIT wiki page
+ `Design_Optimizations <https://wiki.fd.io/view/CSIT/Design_Optimizations>`_;
+
+ - For more detail see the :ref:`CSIT Framework Design <csit-design>` section
+ in this report;
Known Issues
------------
| # | Issue | Jira ID | Description |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when |
-| | sent with different XID | | received DHCPv4 OFFER message with different (wrong) |
+| | sent with different XID. | | received DHCPv4 OFFER message with different (wrong) |
| | | | XID. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in |
-| | destination address when IPv4 prefix is 0 | | case that IPv4 prefix is equal to 0 and IPv6 prefix |
+| | destination address when IPv4 prefix is 0. | | case that IPv4 prefix is equal to 0 and IPv6 prefix |
| | | | is less than 40. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix |
-| | incorrect parameters provided | | length of IPv4 prefix and PSID length is greater |
+| | incorrect parameters provided. | | length of IPv4 prefix and PSID length is greater |
| | | | than EA bits length. IPv6 destination address |
| | | | contains bits writen with PSID over the EA-bit |
| | | | length when IPv4 packet is sent. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in |
-| | response to ICMPv6 Router Solicitation | | ICMPv6 Router Advertisement packet sent as a |
+| | response to ICMPv6 Router Solicitation. | | ICMPv6 Router Advertisement packet sent as a |
| | | | response to received ICMPv6 Router Solicitation |
| | | | packet. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of |
-| | IPv6_dst | | IPv6_dst when classify session is configured with |
-| | | | IPv6 destination address. Anyhow the correct IPv6 |
-| | | | destination address is reported. |
-+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
-| | work with virtio driver | | routing on interface binded to virtio driver. |
+| 5 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
+| | | | reconnect. It requires moving CSIT VIRL environment |
+| | | | to QEMU 2.7.0. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 7 | VHOST-user: QEMU re-connect doesn't work | CSIT-565 | Used QEMU 2.5.0 doesn't support re-connection. Usage |
-| | | | of QEMU 2.7.0 is not recommended by vpp-dev team at |
-| | | | the moment. |
+| 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
+| | | | and VXLAN test executions, what leads to failure of |
+| | | | all other tests in the suite. NOTE: After upgrading |
+| | | | one of the VIRL servers host from Ubuntu14.04 to |
+| | | | 16.04, DUT1 VM stops crashing, but tests keep |
+| | | | failing sporadically 1-in-100. Possible root cause |
+| | | | identified - unexpected IPv6 RA packets upsetting |
+| | | | some test component. Currently suspecting |
+| | | | environment or CSIT issue, but can not exclude VPP, |
+| | | | further troubleshooting in progress. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 8 | Centos7: LISP and VXLAN test failures | CSIT-566 | We can observe crash of SUT1 VM during LISP tests |
-| | | | execution, that leads to failure of all other tests |
-| | | | (sometimes observed during VXLAN tests execution |
-| | | | too). NOTE: Possible root cause identified after |
-| | | | upgrade of one of VIRL servers. When fix is |
-| | | | confirmed in a short time it will be merged to CSIT |
-| | | | rls1704 branch. |
+| 7 | IPSEC: Tests cover old crypto code path | CSIT-733 | There are used default conf settings so IPSEC tests |
+| | | | use old security code not the new Crypto SW code. |
+---+-------------------------------------------------+----------+------------------------------------------------------+