X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_functional_tests%2Fcsit_release_notes.rst;h=c547258091a8f61dcbcdf4ff68a1305366ca2ac9;hp=3b2d02ebb11addb6fab69f58608ca0880338b1ac;hb=1e2bf354994a7ec53c1acee2d1c2fe2208f7c905;hpb=4e32bebc47a000b1424ed8a3141a5b4cd4d1f740 diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst index 3b2d02ebb1..c547258091 100644 --- a/docs/report/vpp_functional_tests/csit_release_notes.rst +++ b/docs/report/vpp_functional_tests/csit_release_notes.rst @@ -4,16 +4,27 @@ CSIT Release Notes Changes in CSIT |release| ------------------------- -#. Introduction of Centos7 tests +#. VPP functional test framework changes: -#. Implemented VAT command history collection for every test case as part of teardown + - Upgrade of tb4-virl1 and tb4-virl2 hosts; -#. Added VPP functional tests + - OS version to Ubuntu 16.04.02; - - IPv4 routed-forwarding with dot1q VLAN sub-interfaces - - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM - - IPv4 routed-forwarding with vhost-user interfaces to VM - - Vhost-User interface re-connect tests + - VIRL version to Mitaka; + + - Implemented load balance mechanism for VIRL hosts; + + - Implemented waiting mechanism on VIRL host if there is not enough resources + available to successfully start simulation; + +#. Code updates and optimizations in CSIT functional framework: + + - Complete CSIT framework code revision and optimizations as descried + on CSIT wiki page + `Design_Optimizations `_; + + - For more detail see the :ref:`CSIT Framework Design ` section + in this report; Known Issues ------------ @@ -24,41 +35,39 @@ Here is the list of known issues in CSIT |release| for VPP functional tests in V | # | Issue | Jira ID | Description | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when | -| | sent with different XID | | received DHCPv4 OFFER message with different (wrong) | +| | sent with different XID. | | received DHCPv4 OFFER message with different (wrong) | | | | | XID. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in | -| | destination address when IPv4 prefix is 0 | | case that IPv4 prefix is equal to 0 and IPv6 prefix | +| | destination address when IPv4 prefix is 0. | | case that IPv4 prefix is equal to 0 and IPv6 prefix | | | | | is less than 40. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix | -| | incorrect parameters provided | | length of IPv4 prefix and PSID length is greater | +| | incorrect parameters provided. | | length of IPv4 prefix and PSID length is greater | | | | | than EA bits length. IPv6 destination address | | | | | contains bits writen with PSID over the EA-bit | | | | | length when IPv4 packet is sent. | +---+-------------------------------------------------+----------+------------------------------------------------------+ | 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in | -| | response to ICMPv6 Router Solicitation | | ICMPv6 Router Advertisement packet sent as a | +| | response to ICMPv6 Router Solicitation. | | ICMPv6 Router Advertisement packet sent as a | | | | | response to received ICMPv6 Router Solicitation | | | | | packet. | +---+-------------------------------------------------+----------+------------------------------------------------------+ -| 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of | -| | IPv6_dst | | IPv6_dst when classify session is configured with | -| | | | IPv6 destination address. Anyhow the correct IPv6 | -| | | | destination address is reported. | -+---+-------------------------------------------------+----------+------------------------------------------------------+ -| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 | -| | work with virtio driver | | routing on interface binded to virtio driver. | +| 5 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user | +| | | | reconnect. It requires moving CSIT VIRL environment | +| | | | to QEMU 2.7.0. | +---+-------------------------------------------------+----------+------------------------------------------------------+ -| 7 | VHOST-user: QEMU re-connect doesn't work | CSIT-565 | Used QEMU 2.5.0 doesn't support re-connection. Usage | -| | | | of QEMU 2.7.0 is not recommended by vpp-dev team at | -| | | | the moment. | +| 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP | +| | | | and VXLAN test executions, what leads to failure of | +| | | | all other tests in the suite. NOTE: After upgrading | +| | | | one of the VIRL servers host from Ubuntu14.04 to | +| | | | 16.04, DUT1 VM stops crashing, but tests keep | +| | | | failing sporadically 1-in-100. Possible root cause | +| | | | identified - unexpected IPv6 RA packets upsetting | +| | | | some test component. Currently suspecting | +| | | | environment or CSIT issue, but can not exclude VPP, | +| | | | further troubleshooting in progress. | +---+-------------------------------------------------+----------+------------------------------------------------------+ -| 8 | Centos7: LISP and VXLAN test failures | CSIT-566 | We can observe crash of SUT1 VM during LISP tests | -| | | | execution, that leads to failure of all other tests | -| | | | (sometimes observed during VXLAN tests execution | -| | | | too). NOTE: Possible root cause identified after | -| | | | upgrade of one of VIRL servers. When fix is | -| | | | confirmed in a short time it will be merged to CSIT | -| | | | rls1704 branch. | +| 7 | IPSEC: Tests cover old crypto code path | CSIT-733 | There are used default conf settings so IPSEC tests | +| | | | use old security code not the new Crypto SW code. | +---+-------------------------------------------------+----------+------------------------------------------------------+