docs/report/vpp_functional_tests/csit_release_notes.rst

   1 CSIT Release Notes
   2 ==================
   3
   4 Changes in CSIT |release|
   5 -------------------------
   6
   7 #. VPP functional test framework changes:
   8
   9    - Upgrade of tb4-virl1 and tb4-virl2 hosts;
  10
  11      - OS version to Ubuntu 16.04.02;
  12
  13      - VIRL version to Mitaka;
  14
  15    - Implemented load balance mechanism for VIRL hosts;
  16
  17    - Implemented waiting mechanism on VIRL host if there is not enough resources
  18      available to successfully start simulation;
  19
  20 #. Code updates and optimizations in CSIT functional framework:
  21
  22    - Complete CSIT framework code revision and optimizations as descried
  23      on CSIT wiki page
  24      _`Design_Optimizations <https://wiki.fd.io/view/CSIT/Design_Optimizations>`_;
  25
  26    - For more detail see the CSIT Framework Design section in this
  27      report;
  28
  29 Known Issues
  30 ------------
  31
  32 Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL:
  33
  34 +---+-------------------------------------------------+----------+------------------------------------------------------+
  35 | # | Issue                                           | Jira ID  | Description                                          |
  36 +---+-------------------------------------------------+----------+------------------------------------------------------+
  37 | 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when      |
  38 |   | sent with different XID.                        |          | received DHCPv4 OFFER message with different (wrong) |
  39 |   |                                                 |          | XID.                                                 |
  40 +---+-------------------------------------------------+----------+------------------------------------------------------+
  41 | 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in    |
  42 |   | destination address when IPv4 prefix is 0.      |          | case that IPv4 prefix is equal to 0 and IPv6 prefix  |
  43 |   |                                                 |          | is less than 40.                                     |
  44 +---+-------------------------------------------------+----------+------------------------------------------------------+
  45 | 3 | Softwire - MAP-E: Map domain is created when    | CSIT-399 | Map domain is created in case that the sum of suffix |
  46 |   | incorrect parameters provided.                  |          | length of IPv4 prefix and PSID length is greater     |
  47 |   |                                                 |          | than EA bits length. IPv6 destination address        |
  48 |   |                                                 |          | contains bits writen with PSID over the EA-bit       |
  49 |   |                                                 |          | length when IPv4 packet is sent.                     |
  50 +---+-------------------------------------------------+----------+------------------------------------------------------+
  51 | 4 | IPv6 RA: Incorrect IPv6 destination address in  | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in  |
  52 |   | response to ICMPv6 Router Solicitation.         |          | ICMPv6 Router Advertisement packet sent as a         |
  53 |   |                                                 |          | response to received  ICMPv6 Router Solicitation     |
  54 |   |                                                 |          | packet.                                              |
  55 +---+-------------------------------------------------+----------+------------------------------------------------------+
  56 | 5 | Vhost-user: QEMU reconnect does not work.       | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user    |
  57 |   |                                                 |          | reconnect. It requires moving CSIT VIRL environment  |
  58 |   |                                                 |          | to QEMU 2.7.0.                                       |
  59 +---+-------------------------------------------------+----------+------------------------------------------------------+
  60 | 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP    |
  61 |   |                                                 |          | and VXLAN test executions, what leads to failure of  |
  62 |   |                                                 |          | all other tests in the suite. NOTE: After upgrading  |
  63 |   |                                                 |          | one of the VIRL servers host from Ubuntu14.04 to     |
  64 |   |                                                 |          | 16.04, DUT1 VM stops crashing, but tests keep        |
  65 |   |                                                 |          | failing sporadically 1-in-100. Possible root cause   |
  66 |   |                                                 |          | identified - unexpected IPv6 RA packets upsetting    |
  67 |   |                                                 |          | some test component. Currently suspecting            |
  68 |   |                                                 |          | environment or CSIT issue, but can not exclude VPP,  |
  69 |   |                                                 |          | further troubleshooting in progress.                 |
  70 +---+-------------------------------------------------+----------+------------------------------------------------------+
  71 | 7 | IPSEC: Tests cover old crypto code path         |    --    | There are used default conf settings so IPSEC tests  |
  72 |   |                                                 |          | use old security code not the new Crypto SW code.    |
  73 +---+-------------------------------------------------+----------+------------------------------------------------------+