X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_functional_tests%2Fcsit_release_notes.rst;h=25ca27c03f45719b28f5dbfc0856976e6ec20bdb;hp=7c4202ed05c20841d355e36367cea0485ecfe57a;hb=f6c04897464c868c034237729bfe738a95d43b25;hpb=4d06f1b783ab600c1284113e748a708a1b73583c diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst index 7c4202ed05..25ca27c03f 100644 --- a/docs/report/vpp_functional_tests/csit_release_notes.rst +++ b/docs/report/vpp_functional_tests/csit_release_notes.rst @@ -4,63 +4,70 @@ CSIT Release Notes Changes in CSIT |release| ------------------------- -#. Introduction of Centos7 tests +#. VPP functional test environment changes -#. Added VPP functional tests + - Implemented VAT command history collection for every test case as part of teardown. + - Introduction of Centos7 tests in VIRL environment. + +#. VPP functional test framework changes - - IPv4 routed-forwarding with dot1q VLAN sub-interfaces - - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM - - IPv4 routed-forwarding with vhost-user interfaces to VM - - Vhost-User interface re-connect tests + - Added VAT command history collection for every test case as part of teardown. -#. Implemented VAT command history collection for every test case as part of teardown. +#. Added VPP functional tests + - IPv4 routed-forwarding with dot1q VLAN sub-interfaces. + - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM. + - IPv4 routed-forwarding with vhost-user interfaces to VM. + - Vhost-user interface re-connect tests. Known Issues ------------ Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL: -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| # | Issue | Description | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | Client replies with DHCPv4 REQUEST message when received DHCPv4 | -| | sent with different XID | OFFER message with different (wrong) XID. | -| | | Jira: ` CSIT-129 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | IPv6 destination address is wrongly calculated in case that | -| | destination address when IPv4 prefix is 0 | IPv4 prefix is equal to 0 and IPv6 prefix is less than 40. | -| | | Jira: ` CSIT-398 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 3 | Softwire - MAP-E: Map domain is created when | Map domain is created in case that the sum of suffix length of | -| | incorrect parameters provided | IPv4 prefix and PSID length is greater than EA bits length. | -| | | IPv6 destination address contains bits writen with PSID over | -| | | the EA-bit length when IPv4 packet is sent. | -| | | Jira: ` CSIT-399 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 4 | IPv6 RA: Incorrect IPv6 destination address in | Wrong IPv6 destination address (ff02::1) is used in ICMPv6 | -| | response to ICMPv6 Router Solicitation | Router Advertisement packet sent as a response to received | -| | | ICMPv6 Router Solicitation packet. | -| | | Jira: ` CSIT-409 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 5 | IPFIX: IPv6_src key name reported instead of | The report contains IPv6_src key name instead of IPv6_dst when | -| | IPv6_dst | classify session is configured with IPv6 destination address. | -| | | Anyhow the correct IPv6 destination address is reported. | -| | | Jira: ` CSIT-402 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | Dot1q tagged packets are thrown away in case of IPv4 routing on | -| | work with virtio driver | interface binded to virtio driver. | -| | | Jira: ` CSIT-564 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 7 | VHOST-user: QEMU re-connect doesn't work | Used QEMU 2.5.0 doesn't support re-connection. Usage of QEMU | -| | | 2.7.0 is not recommended by vpp-dev team at the moment. | -| | | Jira: ` CSIT-565 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 8 | Centos7: LISP and VXLAN test failures | We can observe crash of SUT1 VM during LISP tests execution, | -| | | that leads to failure of all other tests (sometimes observed | -| | | during VXLAN tests execution too). | -| | | NOTE: Possible root cause identified after upgrade of one of | -| | | VIRL servers. When fix is confirmed in a short time it will be | -| | | merged to CSIT rls1704 branch. | -| | | Jira: ` CSIT-566 `_ | -+---+-------------------------------------------------+-----------------------------------------------------------------+ ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| # | Issue | Jira ID | Description | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when | +| | sent with different XID | | received DHCPv4 OFFER message with different (wrong) | +| | | | XID. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in | +| | destination address when IPv4 prefix is 0 | | case that IPv4 prefix is equal to 0 and IPv6 prefix | +| | | | is less than 40. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix | +| | incorrect parameters provided | | length of IPv4 prefix and PSID length is greater | +| | | | than EA bits length. IPv6 destination address | +| | | | contains bits writen with PSID over the EA-bit | +| | | | length when IPv4 packet is sent. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in | +| | response to ICMPv6 Router Solicitation | | ICMPv6 Router Advertisement packet sent as a | +| | | | response to received ICMPv6 Router Solicitation | +| | | | packet. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of | +| | IPv6_dst | | IPv6_dst when classify session is configured with | +| | | | IPv6 destination address. Anyhow the correct IPv6 | +| | | | destination address is reported. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 | +| | work with virtio driver | | routing on interface binded to virtio driver. Issue | +| | | | with VIRL test simulation environment | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 7 | Vhost-user: QEMU reconnect doesn't work | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user | +| | | | reconnect. It requires moving CSIT VIRL environment | +| | | | to QEMU 2.7.0. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 8 | Centos7: LISP and VXLAN sporadic test failures | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP | +| | | | and VXLAN test executions, what leads to failure of | +| | | | all other tests in the suite. NOTE: After upgrading | +| | | | one of the VIRL servers host from Ubuntu14.04 to | +| | | | 16.04, DUT1 VM stops crashing, but tests keep | +| | | | failing sporadically 1-in-100. Possible root cause | +| | | | identified - unexpected IPv6 RA packets upsetting | +| | | | some test component. Currently suspecting | +| | | | environment or CSIT issue, but can not exclude VPP, | +| | | | further troubleshooting in progress. | ++---+-------------------------------------------------+----------+------------------------------------------------------+