docs/report/detailed_test_results/honeycomb_functional_results/honeycomb_functional_results.rst

   1
   2 .. |br| raw:: html
   3
   4     <br />
   5
   6 .. note::
   7
   8     Data sources for reported test results: i) FD.io test executor jobs
   9     `hc2vpp-csit-integration-1701-ubuntu1404/1
  10     <https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-integration-1701-ubuntu1404/1>`_
  11     , ii) archived FD.io jobs test result `output files
  12     <../../_static/archive/>`_.
  13
  14 mgmt-cfg-acl-apihc-apivat-func
  15 ``````````````````````````````
  16
  17 **Honeycomb access control lists test suite.**
  18
  19 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  20 | Name                                                           | Documentation                                                                 | Status |
  21 +================================================================+===============================================================================+========+
  22 | TC01: Honeycomb can create ACL classify table                  | Check if Honeycomb API can create an ACL table.                               | PASS   |
  23 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  24 | TC02: Honeycomb can remove ACL table                           | Check if Honeycomb API can delete an ACL table.                               | PASS   |
  25 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  26 | TC03: Honeycomb manages more than one ACL table                | Check if Honeycomb API can create another ACL table.                          | PASS   |
  27 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  28 | TC04: Honeycomb can add ACL session to table                   | Check if Honeycomb API can add an ACL session to a table.                     | PASS   |
  29 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  30 | TC05: Honeycomb can remove ACL session                         | Check if Honeycomb API can remove an ACL session.                             | PASS   |
  31 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  32 | TC06: Honeycomb manages more than one ACL session on one table | Check if Honeycomb API can add another ACL session to a table.                | PASS   |
  33 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  34 | TC07: Honeycomb enables ACL on interface                       | Check if Honeycomb API can enable ACL on an interface.                        | PASS   |
  35 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  36 | TC08: Honeycomb disables ACL on interface                      | Check if Honeycomb API can disable ACL on an interface.                       | PASS   |
  37 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  38 | TC09: Honeycomb can remove one out of multiple ACL tables      | Check if Honeycomb API can delete an ACL table if more than one table exists. | PASS   |
  39 +----------------------------------------------------------------+-------------------------------------------------------------------------------+--------+
  40
  41 mgmt-cfg-int-apihcnc-func
  42 `````````````````````````
  43
  44 **Netconf test suite. Contains test cases that need to bypass REST API.**
  45
  46 +--------------------------------------------------+-----------------------------------------------------------------------------------------------+--------+
  47 | Name                                             | Documentation                                                                                 | Status |
  48 +==================================================+===============================================================================================+========+
  49 | TC01: Honeycomb can create and delete interfaces | Repeatedly create and delete an interface through Netconf and check the reply for any errors. | PASS   |
  50 +--------------------------------------------------+-----------------------------------------------------------------------------------------------+--------+
  51 | TC02: Transaction revert test case 1             | Configure two conflicting VxLAN tunnels, then verify that neither tunnel exists.              | PASS   |
  52 +--------------------------------------------------+-----------------------------------------------------------------------------------------------+--------+
  53 | TC03: Transaction revert test case 2             | Configure two conflicting TAP interfaces, then verify that neither interface exists.          | PASS   |
  54 +--------------------------------------------------+-----------------------------------------------------------------------------------------------+--------+
  55
  56 mgmt-cfg-int-subint-apihc-apivat-func
  57 `````````````````````````````````````
  58
  59 **Honeycomb sub-interface management test suite.**
  60
  61 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  62 | Name                                                                            | Documentation                                                                                                             | Status |
  63 +=================================================================================+===========================================================================================================================+========+
  64 | TC01: Honycomb creates sub-interface                                            | Check if Honeycomb creates a sub-interface.                                                                               | PASS   |
  65 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  66 | TC02: Honeycomb sets interface and sub-interface up                             | Honeycomb changes the state of interface and of its sub-interface to up.                                                  | PASS   |
  67 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  68 | TC03: Honeycomb sets sub-interface down while its super-interface is up         | Honeycomb sets the sub-interface down while its  super-interface is up. It must be possible.                              | PASS   |
  69 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  70 | TC04: Honeycomb sets interface and sub-interface down                           | Honeycomb changes the state of interface down and then  changes the state of its sub-interface down, in this order.       | PASS   |
  71 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  72 | TC05: Honeycomb fails to set sub-interface up while its super-interface is down | Honeycomb tries to set the sub-interface up while its  super-interface is down. It must not be possible.                  | PASS   |
  73 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  74 | TC06: Honeycomb fails to delete sub-interface                                   | Check if Honeycomb can delete an existing sub-interface.                                                                  | PASS   |
  75 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  76 | TC07: Honeycomb adds sub-interface to new bridge domain                         | Check if Honeycomb adds a sub-interface to bridge domain.                                                                 | PASS   |
  77 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  78 | TC08: Honeycomb enables tag-rewrite pop 1                                       | Check if Honeycomb enables tag-rewrite and sets its  parameters correctly. Case: pop 1.                                   | PASS   |
  79 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  80 | TC09: Honeycomb enables tag-rewrite push                                        | Check if Honeycomb enables tag-rewrite and sets its  parameters correctly. Case: push.                                    | PASS   |
  81 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  82 | TC10: Honeycomb enables tag-rewrite translate 1-2                               | Check if Honeycomb enables tag-rewrite and sets its  parameters correctly. Case: translate 1-2.                           | PASS   |
  83 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  84 | TC11: Honeycomb disables tag-rewrite                                            | Check if Honeycomb disables the tag-rewrite.                                                                              | PASS   |
  85 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  86 | TC12: Honeycomb enables tag-rewrite pop 1 again                                 | Check if Honeycomb can enable tag-rewrite again, once it  was disabled by Honeycomb.                                      | PASS   |
  87 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  88 | TC13: Honeycomb modifies the tag-rewrite                                        | Honeycomb sets the tag-rewrite: 1. pop 1, then 2. push, then 3. translate 1 - 2 Then Honeycomb disables the tag-rewrite.  | PASS   |
  89 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  90 | TC14: Honeycomb fails to set wrong vlan-type in tag-rewrite                     | Check that Honeycomb does not accept wrong values of  vlan-type in tag-rewrite.                                           | PASS   |
  91 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  92 | TC15: Honeycomb configures sub-interface ipv4 address                           | Check if Honeycomb can configure an ipv4 address on the sub-interface.                                                    | PASS   |
  93 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  94 | TC16: Honeycomb removes sub-interface ipv4 address                              | Check if Honeycomb can remove configured ipv4 addresses from the sub-interface.                                           | PASS   |
  95 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  96 | TC17: Honeycomb modifies existing sub-interface ipv4 address                    | Check if Honeycomb can modify an ipv4 address already configured on the sub-interface.                                    | PASS   |
  97 +---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+--------+
  98
  99 mgmt-cfg-intip4-intip6-apihc-apivat-func
 100 ````````````````````````````````````````
 101
 102 **Honeycomb interface management test suite.**
 103
 104 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 105 | Name                                                         | Documentation                                                                               | Status |
 106 +==============================================================+=============================================================================================+========+
 107 | TC01: Honeycomb configures and reads interface state         | Check if Honeycomb API can modify the admin state of VPP interfaces.                        | PASS   |
 108 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 109 | TC02: Honeycomb modifies interface IPv4 address with netmask | Check if Honeycomb API can configure interfaces for ipv4 with address and netmask provided. | PASS   |
 110 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 111 | TC03: Honeycomb removes IPv4 address from interface          | Check if Honeycomb API can remove configured ipv4 addresses from interface.                 | PASS   |
 112 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 113 | TC04: Honeycomb modifies interface IPv4 address with prefix  | Check if Honeycomb API can configure interfaces for ipv4 with address and prefix provided.  | PASS   |
 114 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 115 | TC05: Honeycomb modifies IPv4 neighbor table                 | Check if Honeycomb API can add and remove ARP entries.                                      | PASS   |
 116 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 117 | TC06: Honeycomb modifies interface configuration - IPv6      | Check if Honeycomb API can configure interfaces for ipv6.                                   | PASS   |
 118 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 119 | TC07: Honeycomb modifies interface configuration - MTU       | Check if Honeycomb API can configure interface MTU value.                                   | PASS   |
 120 +--------------------------------------------------------------+---------------------------------------------------------------------------------------------+--------+
 121
 122 mgmt-cfg-inttap-apihc-apivat-func
 123 `````````````````````````````````
 124
 125 **Honeycomb TAP management test suite.**
 126
 127 +---------------------------------------------------------------+---------------------------------------------------------------------------------------+--------+
 128 | Name                                                          | Documentation                                                                         | Status |
 129 +===============================================================+=======================================================================================+========+
 130 | TC01: Honeycomb configures TAP interface                      | Check if Honeycomb API can configure a TAP interface.                                 | PASS   |
 131 +---------------------------------------------------------------+---------------------------------------------------------------------------------------+--------+
 132 | TC02: Honeycomb modifies existing TAP interface configuration | Check if Honeycomb API can re-configure and existing TAP interface with new settings. | PASS   |
 133 +---------------------------------------------------------------+---------------------------------------------------------------------------------------+--------+
 134 | TC03: Honeycomb removes TAP interface                         | Check if Honeycomb API can remove TAP interface.                                      | PASS   |
 135 +---------------------------------------------------------------+---------------------------------------------------------------------------------------+--------+
 136
 137 mgmt-cfg-intvhost-apihc-apivat-func
 138 ```````````````````````````````````
 139
 140 **Honeycomb vhost-user interface management test suite.**
 141
 142 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 143 | Name                                                                            | Documentation                                                                                                | Status |
 144 +=================================================================================+==============================================================================================================+========+
 145 | TC01: Honeycomb creates vhost-user interface - server                           | Check if Honeycomb creates a vhost-user interface, role: server.                                             | FAIL   |
 146 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 147 | TC02: Honeycomb modifies vhost-user interface - server                          | Check if Honeycomb can modify properties of existing vhost-user interface, role: server.                     | FAIL   |
 148 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 149 | TC03: Honeycomb deletes vhost-user interface - server                           | Check if Honeycomb can delete an existing vhost-user interface, role: server.                                | FAIL   |
 150 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 151 | TC04: Honeycomb creates vhost-user interface - client                           | Check if Honeycomb creates a vhost-user interface, role: client.                                             | FAIL   |
 152 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 153 | TC05: Honeycomb modifies vhost-user interface - client                          | Check if Honeycomb can modify properties of existing vhost-user interface, role: client.                     | FAIL   |
 154 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 155 | TC06: Honeycomb deletes vhost-user interface - client                           | Check if Honeycomb can delete an existing vhost-user interface, role: client.                                | FAIL   |
 156 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 157 | TC07: Honeycomb does not set vhost-user configuration on another interface type | Check if Honeycomb refuses to set vhost-user configuration for interface which is not v3po:vhost-user type.  | FAIL   |
 158 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 159 | TC08: Honeycomb does not set invalid vhost-user configuration                   | Check if Honeycomb refuses to set invalid parameters to vhost-user interface.                                | FAIL   |
 160 +---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+--------+
 161
 162 mgmt-cfg-l2bd-apihc-apivat-func
 163 ```````````````````````````````
 164
 165 **Honeycomb bridge domain management test suite.**
 166
 167 +------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+--------+
 168 | Name                                                                   | Documentation                                                                                                     | Status |
 169 +========================================================================+===================================================================================================================+========+
 170 | TC01: Honeycomb sets up l2 bridge domain                               | Check if Honeycomb can create bridge domains on VPP node.                                                         | PASS   |
 171 +------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+--------+
 172 | TC02: Honeycomb manages multiple bridge domains on node                | Check if Honeycomb can manage multiple bridge domains on a single node.                                           | PASS   |
 173 +------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+--------+
 174 | TC03: Honeycomb removes bridge domains                                 | Check if Honeycomb can remove bridge domains from a VPP node.                                                     | PASS   |
 175 +------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+--------+
 176 | TC04: Honeycomb assigns interfaces to bridge domain                    | Check if Honeycomb can assign VPP interfaces to an existing bridge domain.                                        | PASS   |
 177 +------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+--------+
 178 | TC05: Honeycomb cannot remove bridge domain with an interface assigned | Check if Honeycomb can remove a bridge domain that has an interface assigned to it. Expect to fail with code 500. | PASS   |
 179 +------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+--------+
 180
 181 mgmt-cfg-l2fib-apihc-apivat-func
 182 ````````````````````````````````
 183
 184 **Honeycomb L2 FIB management test suite.**
 185
 186 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 187 | Name                                                    | Documentation                                                                                                                   | Status |
 188 +=========================================================+=================================================================================================================================+========+
 189 | TC01: Honeycomb adds L2 FIB entry (forward)             | Honeycomb creates a bridge domain and assignes an  interface to it. Then adds an L2 FIB entry (forward) to the bridge  domain.  | PASS   |
 190 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 191 | TC02: Honeycomb adds L2 FIB entry (static, forward)     | Honeycomb adds an L2 FIB entry (static, forward) to the  bridge domain.                                                         | PASS   |
 192 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 193 | TC03: Honeycomb adds L2 FIB entry (static, filter)      | Honeycomb adds an L2 FIB entry (static, filter) to the  bridge domain.                                                          | PASS   |
 194 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 195 | TC04: Honeycomb adds and removes L2 FIB entry (forward) | Honeycomb adds an L2 FIB entry (forward) to the bridge  domain and then Honeycomb removes it from the bridge domain.            | PASS   |
 196 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 197 | TC05: Honeycomb adds more than one L2 FIB entry         | Honeycomb adds three L2 FIB entries to the bridge domain.                                                                       | PASS   |
 198 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 199 | TC06: Honeycomb fails to set wrong L2 FIB entry         | Honeycomb tries to add an L2 FIB entry with wrong  parameters to the bridge domain. It must fail.                               | PASS   |
 200 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 201 | TC07: Honeycomb fails to modify existing L2 FIB entry   | Honeycomb tries to modify an existing L2 FIB entry. It  must fail.                                                              | PASS   |
 202 +---------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+--------+
 203
 204 mgmt-cfg-lisp-apihc-apivat-func
 205 ```````````````````````````````
 206
 207 **Honeycomb Lisp test suite.**
 208
 209 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 210 | Name                                                             | Documentation                                                                                      | Status |
 211 +==================================================================+====================================================================================================+========+
 212 | TC01: Honeycomb enables Lisp feature                             | Check if Honeycomb can enable the Lisp feature.                                                    | PASS   |
 213 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 214 | TC02: Honeycomb adds locator set and locator                     | Check if Honeycomb can configure a locator set.                                                    | PASS   |
 215 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 216 | TC03: Honeycomb configures Lisp - remote mapping - Bridge Domain | Check if Honeycomb can configure a remote Lisp mapping with a bridge domain.                       | PASS   |
 217 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 218 | TC04: Honeycomb can remove Lisp mapping                          | Check if Honeycomb can remove a configured Lisp mapping.                                           | PASS   |
 219 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 220 | TC05: Honeycomb configures Lisp - remote mapping - VRF           | Check if Honeycomb can configure a remote Lisp mapping with VRF.                                   | PASS   |
 221 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 222 | TC06: Honeycomb configures Lisp - local mapping - Bridge Domain  | Check if Honeycomb can configure a local Lisp mapping with a bridge domain.                        | PASS   |
 223 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 224 | TC07: Honeycomb configures Lisp - local mapping - VRF            | Check if Honeycomb can configure a local Lisp mapping with VRF.                                    | PASS   |
 225 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 226 | TC08: Honeycomb configures Lisp mapping with adjacency           | Check if Honeycomb can configure local and remote Lisp mappings with VRF, and configure adjacency. | PASS   |
 227 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 228 | TC09: Honeycomb configures Lisp map resolver                     | Check if Honeycomb can configure a Lisp map resolver.                                              | PASS   |
 229 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 230 | TC10: Honeycomb enabled Lisp PITR feature                        | Check if Honeycomb can configure the Lisp PITR feature.                                            | PASS   |
 231 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 232 | TC11: Honeycomb can remove configuration of Lisp features        | Check if Honeycomb can disable all Lisp features.                                                  | PASS   |
 233 +------------------------------------------------------------------+----------------------------------------------------------------------------------------------------+--------+
 234
 235 mgmt-cfg-nsh-apihc-apivat-func
 236 ``````````````````````````````
 237
 238 **Honeycomb NSH test suite.**
 239
 240 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 241 | Name                                                                | Documentation                                                             | Status |
 242 +=====================================================================+===========================================================================+========+
 243 | TC01: Honeycomb can configure NSH entry                             | Check if Honeycomb can configure an NSH entry.                            | PASS   |
 244 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 245 | TC02: Honeycomb can remove NSH entry                                | Check if Honeycomb can remove an existing NSH entry.                      | PASS   |
 246 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 247 | TC03: Honeycomb can configure new NSH entry                         | Check if Honeycomb can configure an NSH antry after one has been deleted. | PASS   |
 248 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 249 | TC04: Honeycomb can configure multiple NSH entries at the same time | Check if Honeycomb can configure an NSH entry when one already exists.    | PASS   |
 250 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 251 | TC05: Honeycomb can configure NSH map                               | Check if Honeycomb can configure an NSH map.                              | PASS   |
 252 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 253 | TC06: Honeycomb can remove NSH map                                  | Check if Honeycomb can remove an existing NSH map.                        | PASS   |
 254 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 255 | TC07: Honeycomb can modify existing NSH map                         | Check if Honeycomb can configure an NSH map after one has been deleted.   | PASS   |
 256 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 257 | TC08: Honeycomb can configure multiple NSH maps at the same time    | Check if Honeycomb can configure and NSH map when one already exists.     | PASS   |
 258 +---------------------------------------------------------------------+---------------------------------------------------------------------------+--------+
 259
 260 mgmt-cfg-pbb-apihc-apivat-func
 261 ``````````````````````````````
 262
 263 **Honeycomb provider backbone bridge test suite.**
 264
 265 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 266 | Name                                                                             | Documentation                                                                                                                                  | Status |
 267 +==================================================================================+================================================================================================================================================+========+
 268 | TC01: Honeycomb sets PBB sub-interface                                           | Honeycomb creates a new PBB sub-interface.                                                                                                     | PASS   |
 269 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 270 | TC02: Honeycomb modifies existing PBB sub-interface                              | Honeycomb modifies an existing PBB sub-interface.                                                                                              | PASS   |
 271 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 272 | TC03: Honeycomb deletes existing PBB sub-interface                               | Honeycomb deletes an existing PBB sub-interface.                                                                                               | PASS   |
 273 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 274 | TC04: Honeycomb fails to set wrong destination-address for new PBB sub-interface | Honeycomb fails to create a new PBB sub-interface with wrong value of parameter destination-address, type yang:mac-address.                    | PASS   |
 275 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 276 | TC05: Honeycomb fails to set wrong source-address for new PBB sub-interface      | Honeycomb fails to create a new PBB sub-interface with wrong value of parameter source-address, type yang:mac-address.                         | PASS   |
 277 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 278 | TC06: Honeycomb fails to set wrong b-vlan-tag-vlan-id for new PBB sub-interface  | Honeycomb fails to create a new PBB sub-interface with wrong value of parameter b-vlan-tag-vlan-id, type uint16, 12 bit range, range 1..4095.  | PASS   |
 279 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 280 | TC07: Honeycomb fails to set wrong i-tag-isid for new PBB sub-interface          | Honeycomb fails to create a new PBB sub-interface with wrong value of parameter i-tag-isid, type uint32, 24 bit range, range 1..16777215.      | PASS   |
 281 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 282 | TC08: Honeycomb fails to create new PBB sub-interface without vlan tag           | Honeycomb fails to create a new PBB sub-interface without parameter b-vlan-tag-vlan-id.                                                        | PASS   |
 283 +----------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+--------+
 284
 285 mgmt-cfg-snat44-apihc-apivat-func
 286 `````````````````````````````````
 287
 288 **Honeycomb NAT test suite.**
 289
 290 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 291 | Name                                                | Documentation                                                   | Status |
 292 +=====================================================+=================================================================+========+
 293 | TC01: Honeycomb configures NAT entry                | Honeycomb configures a static NAT entry.                        | PASS   |
 294 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 295 | TC02: Honeycomb removes NAT entry                   | Honeycomb removes a configured static NAT entry.                | PASS   |
 296 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 297 | TC03: Honeycomb configures multiple NAT entries     | Honeycomb configures two static NAT entries.                    | PASS   |
 298 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 299 | TC04: Honeycomb enables NAT on interface - inbound  | Honeycomb configures NAT on an interface in inbound direction.  | PASS   |
 300 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 301 | TC05: Honeycomb removes NAT interface configuration | Honeycomb removes NAT configuration from an interface.          | PASS   |
 302 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 303 | TC06: Honeycomb enables NAT on interface - outbound | Honeycomb configures NAT on an interface in outbound direction. | PASS   |
 304 +-----------------------------------------------------+-----------------------------------------------------------------+--------+
 305
 306 mgmt-cfg-vxlan-apihc-apivat-func
 307 ````````````````````````````````
 308
 309 **Honeycomb VxLAN management test suite.**
 310
 311 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 312 | Name                                                                       | Documentation                                                                                        | Status |
 313 +============================================================================+======================================================================================================+========+
 314 | TC01: Honeycomb configures VxLAN tunnel                                    | Check if Honeycomb API can configure VxLAN settings.                                                 | PASS   |
 315 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 316 | TC02: Honeycomb disables VxLAN tunnel                                      | Check if Honeycomb API can reset VxLAN configuration.                                                | PASS   |
 317 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 318 | TC03: Honeycomb can configure VXLAN tunnel after one has been disabled     | Check if Honeycomb API can configure VxLAN settings again after previous settings have been removed. | PASS   |
 319 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 320 | TC04: Honeycomb does not set VxLAN configuration on another interface type | Check if Honeycomb API prevents setting VxLAN on incorrect interface.                                | PASS   |
 321 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 322 | TC05: Honeycomb does not set invalid VxLAN configuration                   | Check if Honeycomb API prevents setting incorrect VxLAN settings.                                    | PASS   |
 323 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 324 | TC06: Honeycomb configures VxLAN tunnel with ipv6                          | Check if Honeycomb API can configure VxLAN with ipv6 settings.                                       | PASS   |
 325 +----------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+--------+
 326
 327 mgmt-cfg-vxlangpe-apihc-apivat-func
 328 ```````````````````````````````````
 329
 330 **Honeycomb VxLAN-GPE management test suite.**
 331
 332 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 333 | Name                                                                        | Documentation                                                                                   | Status |
 334 +=============================================================================+=================================================================================================+========+
 335 | TC01: Honeycomb creates VxLAN GPE tunnel                                    | Check if Honeycomb API can configure a VxLAN GPE tunnel.                                        | PASS   |
 336 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 337 | TC02: Honeycomb removes VxLAN GPE tunnel                                    | Check if Honeycomb API can remove VxLAN GPE tunnel.                                             | PASS   |
 338 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 339 | TC03: Honeycomb sets wrong interface type while creating VxLAN GPE tunnel   | Check if Honeycomb refuses to create a VxLAN GPE tunnel with a wrong interface type set.        | PASS   |
 340 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 341 | TC04: Honeycomb sets wrong protocol while creating VxLAN GPE tunnel         | Check if Honeycomb refuses to create a VxLAN GPE tunnel with a wrong next-protocol set.         | PASS   |
 342 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 343 | TC05: Honeycomb sets VxLAN GPE tunnel on existing interface with wrong type | Check if Honeycomb refuses to create a VxLAN GPE tunnel on existing interface with wrong type.  | PASS   |
 344 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 345 | TC06: Honeycomb creates VxLAN GPE tunnel with ipv6                          | Check if Honeycomb API can configure a VxLAN GPE tunnel with IPv6 addresses.                    | PASS   |
 346 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 347 | TC07: Honeycomb creates a second VxLAN GPE tunnel with ipv6                 | Check if Honeycomb API can configure another VxLAN GPE tunnel with IPv6 addresses.              | PASS   |
 348 +-----------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------+
 349
 350 mgmt-notif-apihcnc-func
 351 ```````````````````````
 352
 353 **Honeycomb notifications test suite.**
 354
 355 +--------------------------------------------------------------+--------------------------------------------------------------------------------------------------+--------+
 356 | Name                                                         | Documentation                                                                                    | Status |
 357 +==============================================================+==================================================================================================+========+
 358 | TC01: Honeycomb sends notification on interface state change | Check if Honeycomb sends a state-changed notification when the state of an interface is changed. | PASS   |
 359 +--------------------------------------------------------------+--------------------------------------------------------------------------------------------------+--------+
 360 | TC02: Honeycomb sends notification on interface deletion     | Check if Honeycomb sends an interface-deleted notification when an interface is deleted.         | PASS   |
 361 +--------------------------------------------------------------+--------------------------------------------------------------------------------------------------+--------+
 362
 363 mgmt-statepersist-apihc-func
 364 ````````````````````````````
 365
 366 **Honeycomb configuration persistence test suite.**
 367
 368 +----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+--------+
 369 | Name                                                                             | Documentation                                                                                       | Status |
 370 +==================================================================================+=====================================================================================================+========+
 371 | TC01: Honeycomb persists configuration through restart of both Honeycomb and VPP | Checks if Honeycomb maintains configuration after both Honeycomb and VPP are restarted.             | FAIL   |
 372 +----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+--------+
 373 | TC02: Honeycomb persists configuration through restart of Honeycomb              | Checks if Honeycomb maintains configuration after it is restarted.                                  | FAIL   |
 374 +----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+--------+
 375 | TC03: Honeycomb persists configuration through restart of VPP                    | Checks if Honeycomb updates VPP settings after VPP is restarted.                                    | FAIL   |
 376 +----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+--------+
 377 | TC04: Honeycomb reverts to defaults if persistence files are invalid             | Checks if Honeycomb reverts to default configuration when persistence files are damaged or invalid. | PASS   |
 378 +----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+--------+