Changes in CSIT |release|
-------------------------
-#. Introduction of Centos7 tests
+#. VPP functional test environment changes
+
+ - Implemented VAT command history collection for every test case as part of teardown.
+ - Introduction of Centos7 tests in VIRL environment.
+
+#. VPP functional test framework changes
+
+ - Added VAT command history collection for every test case as part of teardown.
#. Added VPP functional tests
- - more VM vhost-user tests incl. two VM four vhost interface tests
- - more LISP tests
- - more IPSec crypto tests
- - IPv4 and IPv6 Equal-Cost Multi-Path routing tests
- - Telemetry:
- - IPFIX tests
- - SPAN tests
+ - IPv4 routed-forwarding with dot1q VLAN sub-interfaces.
+ - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM.
+ - IPv4 routed-forwarding with vhost-user interfaces to VM.
+ - Vhost-user interface re-connect tests.
-Known Issues - to be updated
+Known Issues
------------
-Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL: (to be updated)
-
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| # | Issue | Description |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | Client replies with DHCPv4 REQUEST message when received DHCPv4 |
-| | sent with different XID | OFFER message with different (wrong) XID. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | IPv6 destination address is wrongly calculated in case that |
-| | destination address when IPv4 prefix is 0 | IPv4 prefix is equal to 0 and IPv6 prefix is less than 40. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 3 | Softwire - MAP-E: Map domain is created when | Map domain is created in case that the sum of suffix length of |
-| | incorrect parameters provided | IPv4 prefix and PSID length is greater than EA bits length. |
-| | | IPv6 destination address contains bits writen with PSID over |
-| | | the EA-bit length when IPv4 packet is sent. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 4 | IPv6 RA: Incorrect IPv6 destination address in | Wrong IPv6 destination address (ff02::1) is used in ICMPv6 |
-| | response to ICMPv6 Router Solicitation | Router Advertisement packet sent as a response to received |
-| | | ICMPv6 Router Solicitation packet. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 5 | IPFIX: IPv6_src key name reported instead of | The report contains IPv6_src key name instead of IPv6_dst when |
-| | IPv6_dst | classify session is configured with IPv6 destination address. |
-| | | Anyhow the correct IPv6 destination address is reported. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 6 | SPAN: Tx traffic is not mirrored | Tx traffic is not mirrored from SPAN source port to SPAN |
-| | | destination port. |
-| | | NOTE: Fix is going to be merged in vpp stable/1701. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
-| 7 | SPAN: Packet trace always contains local0 as | There is reported wrong destination port in the traffic trace: |
-| | destination port | SPAN: mirrored GigabitEthernet0/5/0 -> local0 |
-| | | The (Rx) traffic is mirrored to correct destination port. |
-+---+-------------------------------------------------+-----------------------------------------------------------------+
+Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL:
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| # | Issue | Jira ID | Description |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when |
+| | sent with different XID | | received DHCPv4 OFFER message with different (wrong) |
+| | | | XID. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in |
+| | destination address when IPv4 prefix is 0 | | case that IPv4 prefix is equal to 0 and IPv6 prefix |
+| | | | is less than 40. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix |
+| | incorrect parameters provided | | length of IPv4 prefix and PSID length is greater |
+| | | | than EA bits length. IPv6 destination address |
+| | | | contains bits writen with PSID over the EA-bit |
+| | | | length when IPv4 packet is sent. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in |
+| | response to ICMPv6 Router Solicitation | | ICMPv6 Router Advertisement packet sent as a |
+| | | | response to received ICMPv6 Router Solicitation |
+| | | | packet. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of |
+| | IPv6_dst | | IPv6_dst when classify session is configured with |
+| | | | IPv6 destination address. Anyhow the correct IPv6 |
+| | | | destination address is reported. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
+| | work with virtio driver | | routing on interface binded to virtio driver. Issue |
+| | | | with VIRL test simulation environment |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 7 | Vhost-user: QEMU reconnect doesn't work | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
+| | | | reconnect. It requires moving CSIT VIRL environment |
+| | | | to QEMU 2.7.0. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
+| 8 | Centos7: LISP and VXLAN sporadic test failures | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
+| | | | and VXLAN test executions, what leads to failure of |
+| | | | all other tests in the suite. NOTE: After upgrading |
+| | | | one of the VIRL servers host from Ubuntu14.04 to |
+| | | | 16.04, DUT1 VM stops crashing, but tests keep |
+| | | | failing sporadically 1-in-100. Possible root cause |
+| | | | identified - unexpected IPv6 RA packets upsetting |
+| | | | some test component. Currently suspecting |
+| | | | environment or CSIT issue, but can not exclude VPP, |
+| | | | further troubleshooting in progress. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
Code Review / csit.git / blobdiff