X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Freport%2Fvpp_functional_tests%2Fcsit_release_notes.rst;h=c547258091a8f61dcbcdf4ff68a1305366ca2ac9;hp=9732a98ffea8631eb69e1b8e245296a5128ae1ef;hb=1e2bf354994a7ec53c1acee2d1c2fe2208f7c905;hpb=02f2a2176ec92efdf63399fb7dba1eb586465f38 diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst index 9732a98ffe..c547258091 100644 --- a/docs/report/vpp_functional_tests/csit_release_notes.rst +++ b/docs/report/vpp_functional_tests/csit_release_notes.rst @@ -1,54 +1,73 @@ CSIT Release Notes ================== -Changes in CSIT |release| - to be updated +Changes in CSIT |release| ------------------------- -#. Introduction of Centos7 tests +#. VPP functional test framework changes: -#. Added VPP functional tests + - Upgrade of tb4-virl1 and tb4-virl2 hosts; - - more VM vhost-user tests incl. two VM four vhost interface tests - - more LISP tests - - more IPSec crypto tests - - IPv4 and IPv6 Equal-Cost Multi-Path routing tests - - Telemetry: - - IPFIX tests - - SPAN tests + - OS version to Ubuntu 16.04.02; -Known Issues - to be updated + - VIRL version to Mitaka; + + - Implemented load balance mechanism for VIRL hosts; + + - Implemented waiting mechanism on VIRL host if there is not enough resources + available to successfully start simulation; + +#. Code updates and optimizations in CSIT functional framework: + + - Complete CSIT framework code revision and optimizations as descried + on CSIT wiki page + `Design_Optimizations `_; + + - For more detail see the :ref:`CSIT Framework Design ` section + in this report; + +Known Issues ------------ -Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL: (to be updated) - -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| # | Issue | Description | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | Client replies with DHCPv4 REQUEST message when received DHCPv4 | -| | sent with different XID | OFFER message with different (wrong) XID. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | IPv6 destination address is wrongly calculated in case that | -| | destination address when IPv4 prefix is 0 | IPv4 prefix is equal to 0 and IPv6 prefix is less than 40. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 3 | Softwire - MAP-E: Map domain is created when | Map domain is created in case that the sum of suffix length of | -| | incorrect parameters provided | IPv4 prefix and PSID length is greater than EA bits length. | -| | | IPv6 destination address contains bits writen with PSID over | -| | | the EA-bit length when IPv4 packet is sent. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 4 | IPv6 RA: Incorrect IPv6 destination address in | Wrong IPv6 destination address (ff02::1) is used in ICMPv6 | -| | response to ICMPv6 Router Solicitation | Router Advertisement packet sent as a response to received | -| | | ICMPv6 Router Solicitation packet. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 5 | IPFIX: IPv6_src key name reported instead of | The report contains IPv6_src key name instead of IPv6_dst when | -| | IPv6_dst | classify session is configured with IPv6 destination address. | -| | | Anyhow the correct IPv6 destination address is reported. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 6 | SPAN: Tx traffic is not mirrored | Tx traffic is not mirrored from SPAN source port to SPAN | -| | | destination port. | -| | | NOTE: Fix is going to be merged in vpp stable/1701. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ -| 7 | SPAN: Packet trace always contains local0 as | There is reported wrong destination port in the traffic trace: | -| | destination port | SPAN: mirrored GigabitEthernet0/5/0 -> local0 | -| | | The (Rx) traffic is mirrored to correct destination port. | -+---+-------------------------------------------------+-----------------------------------------------------------------+ +Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL: ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| # | Issue | Jira ID | Description | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when | +| | sent with different XID. | | received DHCPv4 OFFER message with different (wrong) | +| | | | XID. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in | +| | destination address when IPv4 prefix is 0. | | case that IPv4 prefix is equal to 0 and IPv6 prefix | +| | | | is less than 40. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix | +| | incorrect parameters provided. | | length of IPv4 prefix and PSID length is greater | +| | | | than EA bits length. IPv6 destination address | +| | | | contains bits writen with PSID over the EA-bit | +| | | | length when IPv4 packet is sent. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in | +| | response to ICMPv6 Router Solicitation. | | ICMPv6 Router Advertisement packet sent as a | +| | | | response to received ICMPv6 Router Solicitation | +| | | | packet. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 5 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user | +| | | | reconnect. It requires moving CSIT VIRL environment | +| | | | to QEMU 2.7.0. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP | +| | | | and VXLAN test executions, what leads to failure of | +| | | | all other tests in the suite. NOTE: After upgrading | +| | | | one of the VIRL servers host from Ubuntu14.04 to | +| | | | 16.04, DUT1 VM stops crashing, but tests keep | +| | | | failing sporadically 1-in-100. Possible root cause | +| | | | identified - unexpected IPv6 RA packets upsetting | +| | | | some test component. Currently suspecting | +| | | | environment or CSIT issue, but can not exclude VPP, | +| | | | further troubleshooting in progress. | ++---+-------------------------------------------------+----------+------------------------------------------------------+ +| 7 | IPSEC: Tests cover old crypto code path | CSIT-733 | There are used default conf settings so IPSEC tests | +| | | | use old security code not the new Crypto SW code. | ++---+-------------------------------------------------+----------+------------------------------------------------------+