From: Maciek Konstantynowicz Date: Thu, 8 Feb 2018 14:02:47 +0000 (+0000) Subject: rls18.01.1 report: updated make test unittest content. X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=commitdiff_plain;h=5cd30be240b965c17e84b3441ead277eaed6a8c7 rls18.01.1 report: updated make test unittest content. Change-Id: Ic57148795df2459010f908b196acfc8de7c7b50f Signed-off-by: Maciek Konstantynowicz --- diff --git a/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst b/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst index f20bb98055..3e1fd5ac57 100644 --- a/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst +++ b/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst @@ -1,114 +1,246 @@ -CRUD Loopback -````````````` +ACL Security Groups +``````````````````` :: ============================================================================== - CRUD Loopback + ACL plugin Test Case ============================================================================== - test_crud (test_interface_crud.TestLoopbackInterfaceCRUD) OK - test_down (test_interface_crud.TestLoopbackInterfaceCRUD) OK + ACL plugin version check; learn MACs OK + ACL create/delete test OK + permit ACL apply test OK + deny ACL apply test OK + VPP_624 permit ICMPv4 OK + VPP_624 permit ICMPv6 OK + VPP_624 deny ICMPv4 OK + VPP_624 deny ICMPv6 OK + permit TCPv4 OK + permit TCPv6 OK + permit UDPv4 OK + permit UDPv6 OK + deny TCPv4/v6 OK + deny UDPv4/v6 OK + verify add/dump acls OK + permit single TCPv4 OK + permit single UDPv4 OK + permit single TCPv6 OK + permit single UPPv6 OK + deny single TCPv4/v6 OK + deny single UDPv4/v6 OK + deny single UDPv4/v6, permit ip any, verify non-initial fragment blocked OK + VPP-687 zero length udp ipv4 packet OK + VPP-687 zero length udp ipv6 packet OK + permit TCPv4 + non-match range OK + permit TCPv6 + non-match range OK + permit UDPv4 + non-match range OK + permit UDPv6 + non-match range OK + deny TCPv4/v6 + non-match range OK + deny UDPv4/v6 + non-match range OK -Flowprobe feature -````````````````` -:: + ============================================================================== + IRB Test Case + ============================================================================== + ACL plugin prepare OK + ACL IPv6 routed -> bridged, L2 ACL deny OK + ACL IPv6 routed -> bridged, L3 ACL deny OK + ACL IPv4 routed -> bridged, L2 ACL deny OK + ACL IPv4 routed -> bridged, L3 ACL deny OK + ACL IPv6 bridged -> routed, L2 ACL deny OK + ACL IPv6 bridged -> routed, L3 ACL deny OK + ACL IPv4 bridged -> routed, L2 ACL deny OK + ACL IPv4 bridged -> routed, L3 ACL deny OK + ACL IPv6 routed -> bridged, L2 ACL permit+reflect OK + ACL IPv6 bridged -> routed, L2 ACL permit+reflect OK + ACL IPv4 routed -> bridged, L2 ACL permit+reflect OK + ACL IPv4 bridged -> routed, L2 ACL permit+reflect OK + ACL IPv6 routed -> bridged, L3 ACL permit+reflect OK + ACL IPv6 bridged -> routed, L3 ACL permit+reflect OK + ACL IPv4 routed -> bridged, L3 ACL permit+reflect OK + ACL IPv4 bridged -> routed, L3 ACL permit+reflect OK + ACL IPv6+EH routed -> bridged, L2 ACL deny OK + ACL IPv6+EH routed -> bridged, L3 ACL deny OK + ACL IPv6+EH bridged -> routed, L2 ACL deny OK + ACL IPv6+EH bridged -> routed, L3 ACL deny OK + ACL IPv6+EH routed -> bridged, L2 ACL permit+reflect OK + ACL IPv6+EH bridged -> routed, L2 ACL permit+reflect OK + ACL IPv6+EH routed -> bridged, L3 ACL permit+reflect OK + ACL IPv6+EH bridged -> routed, L3 ACL permit+reflect OK + ACL IPv4+MF routed -> bridged, L2 ACL deny OK + ACL IPv4+MF routed -> bridged, L3 ACL deny OK + ACL IPv4+MF bridged -> routed, L2 ACL deny OK + ACL IPv4+MF bridged -> routed, L3 ACL deny OK + ACL IPv4+MF routed -> bridged, L2 ACL permit+reflect OK + ACL IPv4+MF bridged -> routed, L2 ACL permit+reflect OK + ACL IPv4+MF routed -> bridged, L3 ACL permit+reflect OK + ACL IPv4+MF bridged -> routed, L3 ACL permit+reflect OK ============================================================================== - Re-enable Flowprobe feature + ACL plugin connection-oriented extended testcases ============================================================================== - disable flowprobe feature after first packets and re-enable SKIP + Prepare the settings SKIP + IPv4: Basic conn timeout test reflect on ingress SKIP + IPv4: Basic conn timeout test reflect on egress SKIP + IPv4: reflect egress, clear conn SKIP + IPv4: reflect ingress, clear conn SKIP + IPv4: Idle conn behind active conn, reflect on ingress SKIP + IPv4: Idle conn behind active conn, reflect on egress SKIP + IPv6: Basic conn timeout test reflect on ingress SKIP + IPv6: Basic conn timeout test reflect on egress SKIP + IPv6: reflect egress, clear conn SKIP + IPv6: reflect ingress, clear conn SKIP + IPv6: Idle conn behind active conn, reflect on ingress SKIP + IPv6: Idle conn behind active conn, reflect on egress SKIP + Prepare for TCP session tests SKIP + IPv4: transient TCP session (incomplete 3WHS), ref. on ingress SKIP + IPv4: transient TCP session (incomplete 3WHS), ref. on egress SKIP + IPv4: established TCP session (complete 3WHS), ref. on ingress SKIP + IPv4: established TCP session (complete 3WHS), ref. on egress SKIP + IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP + IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP + IPv6: transient TCP session (incomplete 3WHS), ref. on ingress SKIP + IPv6: transient TCP session (incomplete 3WHS), ref. on egress SKIP + IPv6: established TCP session (complete 3WHS), ref. on ingress SKIP + IPv6: established TCP session (complete 3WHS), ref. on egress SKIP + IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP + IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP + ============================================================================== - collect information on Ethernet, IP4 and IP6 datapath (no timers) + ACL on dot1q bridged subinterfaces Tests ============================================================================== - no timers, one CFLOW packet, 9 Flows inside OK - no timers, two CFLOW packets (mtu=256), 3 Flows in each OK - L2 data on IP4 datapath OK - L2 data on IP6 datapath OK - L2 data on L2 datapath OK - L3 data on IP4 datapath OK - L3 data on IP6 datapath OK - L3 data on L2 datapath OK - L4 data on IP4 datapath OK - L4 data on IP6 datapath OK - L4 data on L2 datapath OK - verify templates on IP6 datapath OK - verify templates on IP4 datapath OK - verify template on L2 datapath OK + IP4 ACL SubIf Dot1Q bridged traffic OK + IP6 ACL SubIf Dot1Q bridged traffic OK + ============================================================================== - Disable Flowprobe feature + ACL on dot1ad bridged subinterfaces Tests ============================================================================== - disable flowprobe feature after first packets SKIP + IP4 ACL SubIf Dot1AD bridged traffic OK + IP6 ACL SubIf Dot1AD bridged traffic OK + ============================================================================== - Re-enable IPFIX + ACL on dot1ad routed subinterfaces Tests ============================================================================== - disable IPFIX after first packets and re-enable after few packets SKIP + IP4 ACL SubIf Dot1AD routed traffic OK + IP4 ACL SubIf wrong tags Dot1AD routed traffic OK + IP6 ACL SubIf Dot1AD routed traffic OK + IP6 ACL SubIf wrong tags Dot1AD routed traffic OK + ============================================================================== - Disable IPFIX + ACL on dot1q routed subinterfaces Tests ============================================================================== - disable IPFIX after first packets SKIP + IP4 ACL SubIf Dot1Q routed traffic OK + IP4 ACL SubIf wrong tags Dot1Q routed traffic OK + IP6 ACL SubIf Dot1Q routed traffic OK + IP6 ACL SubIf wrong tags Dot1Q routed traffic OK -DHCP +APIs ```` :: ============================================================================== - DHCP Test Case + VAPI test ============================================================================== - DHCPv6 Proxy OK - DHCP Client OK - DHCPv4 Proxy OK + run C VAPI tests SKIP + run C++ VAPI tests SKIP -IPv4 VRF Multi-instance -``````````````````````` -:: + ============================================================================== + VPP Object Model Test + ============================================================================== + run C++ VOM tests SKIP ============================================================================== - IP4 VRF Multi-instance Test Case + PAPI Test Case ============================================================================== - IP4 VRF Multi-instance test 1 - create 5 BDs OK - IP4 VRF Multi-instance test 2 - delete 2 VRFs OK - IP4 VRF Multi-instance 3 - add 2 VRFs OK - IP4 VRF Multi-instance test 4 - delete 4 VRFs OK + show version OK + show version - invalid parameters OK + u8 array OK -Load Balancer -````````````` -:: + ============================================================================== + PAPI Message parsing Test Case + ============================================================================== + New compound type with array OK + Add new types OK + Add new types 2 OK + Add new message object OK + New message with array OK + Argument name OK + VLA with aribtrary length field placement OK + Message to byte encoding OK + Nested array type OK + Old style VLA array OK + Old VLA compound type OK + Old VLA array arbitrary placement OK + Old VLA u32 OK + Simple array OK ============================================================================== - Load Balancer Test Case + JVPP Core Test Case ============================================================================== - Load Balancer IP4 GRE4 OK - Load Balancer IP4 GRE6 OK - Load Balancer IP6 GRE4 OK - Load Balancer IP6 GRE6 OK + JVPP Acl Callback Api Test Case OK + JVPP Acl Future Api Test Case OK + JVPP Core Callback Api Test Case OK + JVPP Core Future Api Test Case OK + JVPP Ioamexport Callback Api Test Case OK + JVPP Ioamexport Future Api Test Case OK + JVPP Ioampot Callback Api Test Case OK + JVPP Ioampot Future Api Test Case OK + JVPP Ioamtrace Callback Api Test Case OK + JVPP Ioamtrace Future Api Test Case OK + JVPP Snat Callback Api Test Case OK + JVPP Snat Future Api Test Case OK -FIB Tests -````````` +ARP +``` :: ============================================================================== - FIB Test Case + ARP Test Case ============================================================================== - FIB Unit Tests OK + ARP OK + ARP Duplicates OK + ARP Static OK + ARP reply with VRRP virtual src hw addr OK + MPLS OK + Proxy ARP OK + Interface Mirror Proxy ARP OK -BFD IPv6 + ============================================================================== + L2BD arp termination Test Case + ============================================================================== + L2BD arp term - add 5 hosts, verify arp responses OK + L2BD arp term - delete 3 hosts, verify arp responses OK + L2BD arp term - recreate BD1, readd 3 hosts, verify arp responses OK + L2BD arp term - 2 IP4 addrs per host OK + L2BD arp term - create and update 10 IP4-mac pairs OK + L2BD arp/ND term - hosts with both ip4/ip6 OK + L2BD ND term - Add and Del hosts, verify ND replies OK + L2BD ND term - Add and update IP+mac, verify ND replies OK + L2BD arp term - send garps, verify arp event reports OK + L2BD arp term - send duplicate garps, verify suppression OK + L2BD arp term - disable ip4 arp events,send garps, verify no events OK + L2BD ND term - send NS packets verify reports OK + L2BD ND term - send duplicate ns, verify suppression OK + L2BD ND term - disable ip4 arp events,send ns, verify no events OK + +BFD API ```````` :: ============================================================================== - Bidirectional Forwarding Detection (BFD) (IPv6) - ============================================================================== - echo function used SKIP - echo packets looped back SKIP - hold BFD session up SKIP - interface with bfd session deleted SKIP - bring BFD session up SKIP - bring BFD session up - first frame looked up by address pair SKIP - ============================================================================== - BFD-FIB interactions (IPv6) + Bidirectional Forwarding Detection (BFD) - API ============================================================================== - BFD-FIB interactions SKIP + activate SHA1 authentication SKIP + create BFD session using non-existent SHA1 (negative case) SKIP + create a BFD session SKIP + create IPv6 BFD session SKIP + create a BFD session (SHA1) SKIP + add SHA1 keys SKIP + change SHA1 key SKIP + deactivate SHA1 authentication SKIP + create the same BFD session twice (negative case) SKIP + create the same BFD session twice (negative case) (SHA1) SKIP + modify BFD session parameters SKIP + share single SHA1 key between multiple BFD sessions SKIP -BFD authentication +BFD Authentication `````````````````` :: @@ -124,6 +256,20 @@ BFD authentication session is not kept alive by msgs with bad sequence numbers SKIP bring BFD session up SKIP +BFD Authentication Change +````````````````````````` +:: + + ============================================================================== + Bidirectional Forwarding Detection (BFD) (changing auth) + ============================================================================== + change auth key without disturbing session state (delayed) SKIP + change auth key without disturbing session state (immediate) SKIP + turn auth off without disturbing session state (delayed) SKIP + turn auth off without disturbing session state (immediate) SKIP + turn auth on without disturbing session state (delayed) SKIP + turn auth on without disturbing session state (immediate) SKIP + BFD CLI ```````` :: @@ -143,47 +289,12 @@ BFD CLI set/del udp echo source SKIP show commands SKIP -BFD API +BFD IPv4 ```````` :: ============================================================================== - Bidirectional Forwarding Detection (BFD) - API - ============================================================================== - activate SHA1 authentication SKIP - create BFD session using non-existent SHA1 (negative case) SKIP - create a BFD session SKIP - create IPv6 BFD session SKIP - create a BFD session (SHA1) SKIP - add SHA1 keys SKIP - change SHA1 key SKIP - deactivate SHA1 authentication SKIP - create the same BFD session twice (negative case) SKIP - create the same BFD session twice (negative case) (SHA1) SKIP - modify BFD session parameters SKIP - share single SHA1 key between multiple BFD sessions SKIP - -BFD authentication change -````````````````````````` -:: - - ============================================================================== - Bidirectional Forwarding Detection (BFD) (changing auth) - ============================================================================== - change auth key without disturbing session state (delayed) SKIP - change auth key without disturbing session state (immediate) SKIP - turn auth off without disturbing session state (delayed) SKIP - turn auth off without disturbing session state (immediate) SKIP - turn auth on without disturbing session state (delayed) SKIP - turn auth on without disturbing session state (immediate) SKIP - -BFD IPv4 -```````` - -:: - - ============================================================================== - Bidirectional Forwarding Detection (BFD) + Bidirectional Forwarding Detection (BFD) ============================================================================== put session admin-up and admin-down SKIP configuration change while peer in demand mode SKIP @@ -195,6 +306,7 @@ BFD IPv4 echo function stops if peer sets required min echo rx zero SKIP hold BFD session up SKIP immediately honor remote required min rx reduction SKIP + interface with bfd session deleted SKIP echo packets with invalid checksum don't keep a session up SKIP large remote required min rx interval SKIP modify detect multiplier SKIP @@ -210,207 +322,237 @@ BFD IPv4 stale echo packets don't keep a session up SKIP no packets when zero remote required min rx interval SKIP - - -IPv6 Tests -`````````` +BFD IPv6 +```````` :: ============================================================================== - IPv6 Test Case - ============================================================================== - IPv6 FIB test OK - IPv6 Neighbour Solicitation Exceptions OK - ND Duplicates OK - IPv6 Router Solicitation Exceptions OK - ============================================================================== - IPv6 disabled + Bidirectional Forwarding Detection (BFD) (IPv6) ============================================================================== - IP Disabled OK + echo function used SKIP + echo packets looped back SKIP + hold BFD session up SKIP + interface with bfd session deleted SKIP + bring BFD session up SKIP + bring BFD session up - first frame looked up by address pair SKIP + ============================================================================== - IPv6 ND ProxyTest Case + BFD-FIB interactions (IPv6) ============================================================================== - IPv6 Proxy ND OK + BFD-FIB interactions SKIP + +BIER - Bit Indexed Explicit Replication +``````````````````````````````````````` +:: + ============================================================================== - IPv6 Load-Balancing + BIER Test Case ============================================================================== - IPv6 Load-Balancing OK + BIER end-to-end OK + BIER head OK + BIER head over UDP OK + BIER midpoint OK + BIER Tail OK + BIER Tail over UDP OK + ============================================================================== - IPv6 routes via NULL + BIER FIB Test Case ============================================================================== - IP NULL route OK + BFIB Unit Tests OK -SPAN Tests +Classifier `````````` :: ============================================================================== - SPAN Test Case + Classifier Test Case ============================================================================== - SPAN device rx mirror test OK - SPAN l2 tx mirror test OK - SPAN l2 rx mirror test OK - SPAN l2 rx mirror into gre-subif+vtr OK - SPAN l2 rx mirror into subif+vtr OK - SPAN l2 rx mirror into vxlan test OK + IP ACL test OK + MAC ACL test OK + IP PBR test OK -GRE Tests -````````` +Container Integration +````````````````````` :: ============================================================================== - GRE Test Case + Container integration extended testcases ============================================================================== - GRE IPv4 tunnel Tests OK - GRE IPv6 tunnel Tests OK - GRE tunnel L2 Tests OK - GRE tunnel VRF Tests OK + IPv4 basic connectivity test SKIP + IPv6 basic connectivity test SKIP + Create loopbacks overlapping with remote addresses SKIP + IPv4 local-spoof connectivity test SKIP + IPv6 local-spoof connectivity test SKIP + Configure container commands SKIP + IPv4 test after configuring container SKIP + IPv6 test after configuring container SKIP + Unconfigure container commands SKIP + IPv4 local-spoof after unconfig test SKIP + IPv6 local-spoof after unconfig test SKIP -L2BD Multi-instance -``````````````````` +CRUD Loopback +````````````` :: ============================================================================== - L2BD Multi-instance Test Case + CRUD Loopback ============================================================================== - L2BD Multi-instance test 1 - create 5 BDs SKIP - L2BD Multi-instance test 2 - update data of 5 BDs SKIP - L2BD Multi-instance 3 - delete 2 BDs SKIP - L2BD Multi-instance test 4 - add 2 BDs SKIP - L2BD Multi-instance 5 - delete 5 BDs SKIP + test_crud (test_interface_crud.TestLoopbackInterfaceCRUD) OK + test_down (test_interface_crud.TestLoopbackInterfaceCRUD) OK -MAP Tests -````````` +DHCP +```` :: ============================================================================== - MAP Test Case + DHCP Test Case ============================================================================== - MAP-E OK + DHCPv6 Proxy OK + DHCP Client OK + DHCPv4 Proxy OK -LISP tests -`````````` +Distributed Virtual Router +`````````````````````````` :: ============================================================================== - Basic LISP test + Distributed Virtual Router ============================================================================== - Test case for basic encapsulation OK + Distributed Virtual Router OK + L2 Emulation OK -NAT44 Test Cases +DS-Lite Softwire ```````````````` :: ============================================================================== - NAT44 Test Cases + DS-Lite Test Cases ============================================================================== - NAT44 dynamic translation test OK - NAT44 handling of client packets with TTL=1 OK - NAT44 handling of error responses to client packets with TTL=2 OK - NAT44 handling of server packets with TTL=1 OK - NAT44 handling of error responses to server packets with TTL=2 OK - NAT44 interfaces without configured IP address OK - NAT44 hairpinning - 1:1 NAPT OK - NAT44 hairpinning - 1:1 NAT OK - 1:1 NAT translate packet with unknown protocol - hairpinning OK - NAT44 translate packet with unknown protocol - hairpinning OK - NAT44 multiple inside interfaces with overlapping address space OK - Acquire NAT44 addresses from interface OK - Static mapping with addresses from interface OK - IPFIX logging NAT addresses exhausted OK - IPFIX logging NAT44 session created/delted OK - MAX translations per user - recycle the least recently used OK - NAT44 multiple non-overlapping address space inside interfaces OK - NAT44 interface output feature (in2out postrouting) OK - NAT44 interface output feature hairpinning (in2out postrouting) OK - NAT44 interface output feature VRF aware (in2out postrouting) OK - Ping internal host from outside network OK - Ping NAT44 out interface from outside network OK - NAT44 add pool addresses to FIB OK - 1:1 NAT initialized from inside network OK - NAT44 interfaces without configured IP address - 1:1 NAT OK - NAT44 local service load balancing OK - 1:1 NAT initialized from outside network OK - 1:1 NAT translate packet with unknown protocol OK - 1:1 NAT VRF awareness OK - 1:1 NAPT initialized from inside network OK - NAT44 interfaces without configured IP address - 1:1 NAPT OK - 1:1 NAPT initialized from outside network OK - NAT44 translate packet with unknown protocol OK - NAT44 tenant VRF independent address pool mode OK - NAT44 tenant VRF aware address pool mode OK + Test DS-Lite OK + +FIB +``` +:: + ============================================================================== - Deterministic NAT Test Cases + FIB Test Case ============================================================================== - Deterministic NAT translation test (TCP, UDP, ICMP) OK - NAT plugin run deterministic mode OK - Deterministic NAT multiple users OK - Deterministic NAT maximum sessions per user limit SKIP - Deterministic NAT session timeouts SKIP - Set deterministic NAT timeouts OK - Deterministic NAT TCP session close from inside network OK - Deterministic NAT TCP session close from outside network OK + FIB Unit Tests OK -NAT64 Test Cases -```````````````` +Flowprobe +````````` :: ============================================================================== - NAT64 Test Cases + Re-enable Flowprobe feature ============================================================================== - NAT64 dynamic translation test OK - NAT64 hairpinning OK - NAT64 translate packet with unknown protocol - hairpinning OK - NAT64 ICMP Error message translation OK - Enable/disable NAT64 feature on the interface OK - Add/delete address to NAT64 pool OK - NAT64 Network-Specific Prefix OK - NAT64 session timeout SKIP - Set NAT64 timeouts OK - NAT64 static translation test OK - Add/delete static BIB entry OK - NAT64 translate packet with unknown protocol OK + disable flowprobe feature after first packets and re-enable SKIP -L2XC Multi-instance -``````````````````` -:: + ============================================================================== + collect information on Ethernet, IP4 and IP6 datapath (no timers) + ============================================================================== + no timers, one CFLOW packet, 9 Flows inside OK + no timers, two CFLOW packets (mtu=256), 3 Flows in each OK + L2 data on IP4 datapath OK + L2 data on IP6 datapath OK + L2 data on L2 datapath OK + L3 data on IP4 datapath OK + L3 data on IP6 datapath OK + L3 data on L2 datapath OK + L4 data on IP4 datapath OK + L4 data on IP6 datapath OK + L4 data on L2 datapath OK + verify templates on IP6 datapath OK + verify templates on IP4 datapath OK + verify template on L2 datapath OK ============================================================================== - L2XC Multi-instance Test Case + Disable Flowprobe feature ============================================================================== - L2XC Multi-instance test 1 - create 10 cross-connects OK - L2XC Multi-instance test 2 - delete 4 cross-connects OK - L2BD Multi-instance 3 - add new 4 cross-connects OK - L2XC Multi-instance test 4 - delete 10 cross-connects OK + disable flowprobe feature after first packets SKIP -IPv4 Tests -`````````` + ============================================================================== + Re-enable IPFIX + ============================================================================== + disable IPFIX after first packets and re-enable after few packets SKIP + + ============================================================================== + Disable IPFIX + ============================================================================== + disable IPFIX after first packets SKIP + +Geneve Tunnels +`````````````` :: ============================================================================== - IPv4 Test Case + GENEVE Test Case ============================================================================== - IPv4 FIB test OK + Decapsulation test OK + Encapsulation test OK + Multicast flood test OK + Multicast receive test OK + Unicast flood test OK + +GRE Tunnels +``````````` +:: + ============================================================================== - IPv4 routes via NULL + GRE Test Case ============================================================================== - IP NULL route OK + GRE IPv4 tunnel Tests OK + GRE IPv6 tunnel Tests OK + GRE tunnel L2 Tests OK + GRE tunnel VRF Tests OK + +GTPU Tunnels +```````````` +:: + ============================================================================== - IPv4 disabled + GTPU Test Case ============================================================================== - IP Disabled OK + Decapsulation test OK + Encapsulation test OK + Multicast flood test OK + Multicast receive test OK + Unicast flood test OK + +IP Multicast Routing +```````````````````` +:: + ============================================================================== - IPv4 Subnets + IP Multicast Test Case ============================================================================== - IP Sub Nets OK + IP Multicast Bi-directional OK + IPv6 Multicast Replication OK + IPv6 Multicast Replication in non-default table OK + IP Multicast Replication OK + IP Multicast Connected Source check OK + IP Multicast Signal OK + IP Multicast Replication in non-default table OK + +IPSec +````` +:: + ============================================================================== - IPv4 VLAN-0 + Basic test for IPSEC using AH transport and Tunnel mode ============================================================================== - IP VLAN-0 OK + ipsec ah v4 transport basic test OK + ipsec ah v4 transport burst test OK + ipsec ah 4o4 tunnel basic test OK + ipsec ah 4o4 tunnel burst test OK + ============================================================================== - IPv4 Load-Balancing + Basic test for ipsec esp sanity - tunnel and transport modes. ============================================================================== - IP Load-Balancing OK + ipsec esp v4 transport basic test OK + ipsec esp v4 transport burst test OK + ipsec esp 4o4 tunnel basic test OK + ipsec esp 4o4 tunnel burst test OK IPv4 FIB CRUD ````````````` @@ -424,148 +566,108 @@ IPv4 FIB CRUD Add 1k routes OK Delete 1.5k routes OK -IRB Tests -````````` +IPv4 Routing +```````````` :: ============================================================================== - IRB Test Case + IPv4 Test Case ============================================================================== - ACL plugin prepare OK - ACL IPv6 routed -> bridged, L2 ACL deny OK - ACL IPv6 routed -> bridged, L3 ACL deny OK - ACL IPv4 routed -> bridged, L2 ACL deny OK - ACL IPv4 routed -> bridged, L3 ACL deny OK - ACL IPv6 bridged -> routed, L2 ACL deny OK - ACL IPv6 bridged -> routed, L3 ACL deny OK - ACL IPv4 bridged -> routed, L2 ACL deny OK - ACL IPv4 bridged -> routed, L3 ACL deny OK - ACL IPv6 routed -> bridged, L2 ACL permit+reflect OK - ACL IPv6 bridged -> routed, L2 ACL permit+reflect OK - ACL IPv4 routed -> bridged, L2 ACL permit+reflect OK - ACL IPv4 bridged -> routed, L2 ACL permit+reflect OK - ACL IPv6 routed -> bridged, L3 ACL permit+reflect OK - ACL IPv6 bridged -> routed, L3 ACL permit+reflect OK - ACL IPv4 routed -> bridged, L3 ACL permit+reflect OK - ACL IPv4 bridged -> routed, L3 ACL permit+reflect OK - ACL IPv6+EH routed -> bridged, L2 ACL deny OK - ACL IPv6+EH routed -> bridged, L3 ACL deny OK - ACL IPv6+EH bridged -> routed, L2 ACL deny OK - ACL IPv6+EH bridged -> routed, L3 ACL deny OK - ACL IPv6+EH routed -> bridged, L2 ACL permit+reflect OK - ACL IPv6+EH bridged -> routed, L2 ACL permit+reflect OK - ACL IPv6+EH routed -> bridged, L3 ACL permit+reflect OK - ACL IPv6+EH bridged -> routed, L3 ACL permit+reflect OK - ACL IPv4+MF routed -> bridged, L2 ACL deny OK - ACL IPv4+MF routed -> bridged, L3 ACL deny OK - ACL IPv4+MF bridged -> routed, L2 ACL deny OK - ACL IPv4+MF bridged -> routed, L3 ACL deny OK - ACL IPv4+MF routed -> bridged, L2 ACL permit+reflect OK - ACL IPv4+MF bridged -> routed, L2 ACL permit+reflect OK - ACL IPv4+MF routed -> bridged, L3 ACL permit+reflect OK - ACL IPv4+MF bridged -> routed, L3 ACL permit+reflect OK + IPv4 FIB test OK -ACL Security Groups -``````````````````` -:: + ============================================================================== + IPv4 routes via NULL + ============================================================================== + IP NULL route OK ============================================================================== - ACL plugin Test Case + IPv4 disabled ============================================================================== - ACL plugin version check; learn MACs OK - ACL create/delete test OK - permit ACL apply test OK - deny ACL apply test OK - VPP_624 permit ICMPv4 OK - VPP_624 permit ICMPv6 OK - VPP_624 deny ICMPv4 OK - VPP_624 deny ICMPv6 OK - permit TCPv4 OK - permit TCPv6 OK - permit UDPv4 OK - permit UDPv6 OK - deny TCPv4/v6 OK - deny UDPv4/v6 OK - verify add/dump acls OK - permit single TCPv4 OK - permit single UDPv4 OK - permit single TCPv6 OK - permit single UPPv6 OK - deny single TCPv4/v6 OK - deny single UDPv4/v6 OK - deny single UDPv4/v6, permit ip any, verify non-initial fragment blocked OK - VPP-687 zero length udp ipv4 packet OK - VPP-687 zero length udp ipv6 packet OK - permit TCPv4 + non-match range OK - permit TCPv6 + non-match range OK - permit UDPv4 + non-match range OK - permit UDPv6 + non-match range OK - deny TCPv4/v6 + non-match range OK - deny UDPv4/v6 + non-match range OK + IP Disabled OK + ============================================================================== - ACL plugin connection-oriented extended testcases + IPv4 Subnets ============================================================================== - Prepare the settings SKIP - IPv4: Basic conn timeout test reflect on ingress SKIP - IPv4: Basic conn timeout test reflect on egress SKIP - IPv4: reflect egress, clear conn SKIP - IPv4: reflect ingress, clear conn SKIP - IPv4: Idle conn behind active conn, reflect on ingress SKIP - IPv4: Idle conn behind active conn, reflect on egress SKIP - IPv6: Basic conn timeout test reflect on ingress SKIP - IPv6: Basic conn timeout test reflect on egress SKIP - IPv6: reflect egress, clear conn SKIP - IPv6: reflect ingress, clear conn SKIP - IPv6: Idle conn behind active conn, reflect on ingress SKIP - IPv6: Idle conn behind active conn, reflect on egress SKIP - Prepare for TCP session tests SKIP - IPv4: transient TCP session (incomplete 3WHS), ref. on ingress SKIP - IPv4: transient TCP session (incomplete 3WHS), ref. on egress SKIP - IPv4: established TCP session (complete 3WHS), ref. on ingress SKIP - IPv4: established TCP session (complete 3WHS), ref. on egress SKIP - IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP - IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP - IPv6: transient TCP session (incomplete 3WHS), ref. on ingress SKIP - IPv6: transient TCP session (incomplete 3WHS), ref. on egress SKIP - IPv6: established TCP session (complete 3WHS), ref. on ingress SKIP - IPv6: established TCP session (complete 3WHS), ref. on egress SKIP - IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP - IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP + IP Sub Nets OK -MPLS Tests -`````````` + ============================================================================== + IPv4 VLAN-0 + ============================================================================== + IP VLAN-0 OK + + ============================================================================== + IPv4 Load-Balancing + ============================================================================== + IP Load-Balancing OK + + ============================================================================== + IPv4 Deaggregate Routes + ============================================================================== + IP Deag Routes OK + + ============================================================================== + IPv4 Input Exceptions + ============================================================================== + IP Input Exceptions OK + + ============================================================================== + IPv4 Punt Police/Redirect + ============================================================================== + IP punt police and redirect OK + +IPv4 VRF Multi-instance +``````````````````````` :: ============================================================================== - MPLS-L2 + IP4 VRF Multi-instance Test Case ============================================================================== - Virtual Private LAN Service OK - Virtual Private Wire Service OK + IP4 VRF Multi-instance test 1 - create 5 BDs OK + IP4 VRF Multi-instance test 2 - delete 2 VRFs OK + IP4 VRF Multi-instance 3 - add 2 VRFs OK + IP4 VRF Multi-instance test 4 - delete 4 VRFs OK + +IPv6 Routing +```````````` +:: + ============================================================================== - MPLS Test Case + IPv6 Test Case ============================================================================== - MPLS Local Label Binding test OK - MPLS Deagg OK - MPLS label imposition test OK - MPLS Interface Receive OK - MPLS Multicast Head-end OK - MPLS IPv4 Multicast Tail OK - MPLS IPv6 Multicast Tail OK - MPLS Multicast Mid Point OK - MPLS label swap tests OK - MPLS Tunnel Tests OK - MPLS V4 Explicit NULL test OK - MPLS V6 Explicit NULL test OK + IPv6 FIB test OK + IPv6 Neighbour Solicitation Exceptions OK + ND Duplicates OK + IPv6 Router Solicitation Exceptions OK + ============================================================================== - MPLS PIC edge convergence + IPv6 Punt Police/Redirect ============================================================================== - MPLS eBGP PIC edge convergence OK - MPLS iBGP PIC edge convergence OK - MPLSv6 eBGP PIC edge convergence OK + IP6 punt police and redirect OK + ============================================================================== - MPLS disabled + IPv6 disabled ============================================================================== - MPLS Disabled OK + IP Disabled OK + + ============================================================================== + IPv6 ND ProxyTest Case + ============================================================================== + IPv6 Proxy ND OK + + ============================================================================== + IPv6 Load-Balancing + ============================================================================== + IPv6 Load-Balancing OK + + ============================================================================== + IPv6 routes via NULL + ============================================================================== + IP NULL route OK + + ============================================================================== + IPv6 Input Exceptions + ============================================================================== + IP6 Input Exceptions OK IPv6 VRF Multi-instance ``````````````````````` @@ -579,8 +681,82 @@ IPv6 VRF Multi-instance IP6 VRF Multi-instance 3 - add 2 VRFs OK IP6 VRF Multi-instance test 4 - reset 4 VRFs OK -L2XC Tests +IRB Integrated Routing-Bridging +``````````````````````````````` +:: + + ============================================================================== + IRB Test Case + ============================================================================== + IPv4 IRB test 1 OK + IPv4 IRB test 2 OK + +Kube-proxy `````````` +:: + + ============================================================================== + Kube-proxy Test Case + ============================================================================== + Kube-proxy NAT44 OK + Kube-proxy NAT46 SKIP + Kube-proxy NAT64 SKIP + Kube-proxy NAT66 SKIP + +L2 FIB CRUD +``````````` +:: + + ============================================================================== + L2 FIB Test Case + ============================================================================== + L2 FIB - program 100 + 100 MACs OK + L2 FIB - program 100 + delete 12 MACs OK + L2 FIB - flush all OK + L2 FIB - flush BD OK + L2 FIB - flush interface OK + L2 FIB - mac learning events OK + L2 FIB - mac learning max macs in event OK + L2 FIB - program 100 MACs OK + L2 FIB - Program 10 MACs, learn 10 OK + +L2BD Multi-instance +``````````````````` +:: + + ============================================================================== + L2BD Multi-instance Test Case + ============================================================================== + L2BD Multi-instance test 1 - create 5 BDs OK + L2BD Multi-instance test 2 - update data of 5 BDs OK + L2BD Multi-instance test 3 - delete 2 BDs OK + L2BD Multi-instance test 4 - add 2 BDs OK + L2BD Multi-instance test 5 - delete 5 BDs SKIP + +L2BD Switching +`````````````` +:: + + ============================================================================== + L2BD Test Case + ============================================================================== + L2BD MAC learning dual-loop test OK + L2BD MAC learning single-loop test OK + +L2XC Multi-instance +``````````````````` +:: + + ============================================================================== + L2XC Multi-instance Test Case + ============================================================================== + L2XC Multi-instance test 1 - create 10 cross-connects OK + L2XC Multi-instance test 2 - delete 4 cross-connects OK + L2BD Multi-instance 3 - add new 4 cross-connects OK + L2XC Multi-instance test 4 - delete 10 cross-connects OK + +L2XC Switching +`````````````` :: ============================================================================== @@ -589,8 +765,104 @@ L2XC Tests L2XC dual-loop test OK L2XC single-loop test OK -MFIB Tests -`````````` +LISP Tunnels +```````````` +:: + + ============================================================================== + Basic LISP test + ============================================================================== + Test case for basic encapsulation OK + +Load Balancer +````````````` +:: + + ============================================================================== + Load Balancer Test Case + ============================================================================== + Load Balancer IP4 GRE4 OK + Load Balancer IP4 GRE6 OK + Load Balancer IP6 GRE4 OK + Load Balancer IP6 GRE6 OK + +MACIP Access Control +```````````````````` +:: + + ============================================================================== + MACIP Tests + ============================================================================== + MACIP 10 ACLs each with 100+ entries OK + MACIP 10 ACLs each with 100+ entries with IP4 traffic OK + MACIP 10 ACLs each with 100+ entries with IP6 traffic OK + MACIP ACL with 10 entries OK + MACIP ACL with 100 entries OK + MACIP ACL with 2 entries OK + MACIP ACL with 20 entries OK + MACIP ACL with 5 entries OK + MACIP ACL with 50 entries OK + MACIP 2 ACLs each with 100+ entries OK + MACIP replace ACL OK + MACIP ACL delete intf with acl OK + + ============================================================================== + MACIP with IP6 traffic + ============================================================================== + IP6 MACIP exactMAC|exactIP ACL bridged traffic OK + IP6 MACIP exactMAC|subnetIP ACL bridged traffic OK + IP6 MACIP exactMAC|wildIP ACL bridged traffic OK + IP6 MACIP oui_MAC|exactIP ACL bridged traffic OK + IP6 MACIP ouiMAC|subnetIP ACL bridged traffic OK + IP6 MACIP ouiMAC|wildIP ACL bridged traffic OK + IP6 MACIP wildcardMAC|exactIP ACL bridged traffic OK + IP6 MACIP wildcardMAC|subnetIP ACL bridged traffic OK + IP6 MACIP wildcardMAC|wildIP ACL bridged traffic OK + MACIP replace ACL with IP6 traffic OK + IP6 MACIP exactMAC|exactIP ACL routed traffic OK + IP6 MACIP exactMAC|subnetIP ACL routed traffic OK + IP6 MACIP exactMAC|wildIP ACL routed traffic OK + IP6 MACIP ouiMAC|exactIP ACL routed traffic OK + IP6 MACIP ouiMAC|subnetIP ACL routed traffic OK + IP6 MACIP ouiMAC|wildIP ACL routed traffic OK + IP6 MACIP wildcardMAC|exactIP ACL routed traffic OK + IP6 MACIP wildcardMAC|subnetIP ACL routed traffic OK + IP6 MACIP wildcardMAC|wildIP ACL OK + + ============================================================================== + MACIP with IP4 traffic + ============================================================================== + IP4 MACIP wildcardMAC|exactIP ACL bridged traffic OK + IP4 MACIP exactMAC|exactIP ACL bridged traffic OK + IP4 MACIP exactMAC|subnetIP ACL bridged traffic OK + IP4 MACIP exactMAC|wildIP ACL bridged traffic OK + IP4 MACIP ouiMAC|exactIP ACL bridged traffic OK + IP4 MACIP ouiMAC|subnetIP ACL bridged traffic OK + IP4 MACIP ouiMAC|wildIP ACL bridged traffic OK + IP4 MACIP wildcardMAC|subnetIP ACL bridged traffic OK + IP4 MACIP wildcardMAC|wildIP ACL bridged traffic OK + MACIP replace ACL with IP4 traffic OK + IP4 MACIP exactMAC|exactIP ACL routed traffic OK + IP4 MACIP exactMAC|subnetIP ACL routed traffic OK + IP4 MACIP exactMAC|wildIP ACL routed traffic OK + IP4 MACIP ouiMAC|exactIP ACL routed traffic OK + IP4 MACIP ouiMAC|subnetIP ACL routed traffic OK + IP4 MACIP ouiMAC|wildIP ACL routed traffic OK + IP4 MACIP wildcardMAC|exactIP ACL routed traffic OK + IP4 MACIP wildcardMAC|subnetIP ACL routed traffic OK + IP4 MACIP wildcardMAC|wildIP ACL OK + +MAP Softwires +````````````` +:: + + ============================================================================== + MAP Test Case + ============================================================================== + MAP-E OK + +MFIB Multicast FIB +`````````````````` :: ============================================================================== @@ -598,155 +870,198 @@ MFIB Tests ============================================================================== MFIB Unit Tests OK -IP Multicast Tests -`````````````````` +MPLS Switching +`````````````` :: ============================================================================== - IP Multicast Test Case + MPLS-L2 ============================================================================== - IPv6 Multicast Replication OK - IPv6 Multicast Replication in non-default table OK - IP Multicast Replication OK - IP Multicast Connected Source check OK - IP Multicast Signal OK - IP Multicast Replication in non-default table OK + Virtual Private LAN Service OK + Virtual Private Wire Service OK + + ============================================================================== + MPLS Test Case + ============================================================================== + MPLS Local Label Binding test OK + MPLS Deagg OK + MPLS label imposition test OK + MPLS Interface Receive OK + MPLS Multicast Head-end OK + MPLS IPv4 Multicast Tail OK + MPLS IPv6 Multicast Tail OK + MPLS Multicast Mid Point OK + MPLS label swap tests OK + MPLS Tunnel Tests OK + MPLS V4 Explicit NULL test OK + MPLS V6 Explicit NULL test OK + + ============================================================================== + MPLS PIC edge convergence + ============================================================================== + MPLS eBGP PIC edge convergence OK + MPLS iBGP PIC edge convergence OK + MPLSv6 eBGP PIC edge convergence OK + + ============================================================================== + MPLS disabled + ============================================================================== + MPLS Disabled OK + +NAT44 +````` +:: + + ============================================================================== + NAT44 Test Cases + ============================================================================== + Delete NAT44 session OK + NAT44 dynamic translation test OK + NAT44 handling of client packets with TTL=1 OK + NAT44 handling of error responses to client packets with TTL=2 OK + NAT44 handling of server packets with TTL=1 OK + NAT44 handling of error responses to server packets with TTL=2 OK + NAT44 interfaces without configured IP address OK + NAT44 forwarding test OK + NAT44 translate fragments arriving in order OK + NAT44 translate fragments arriving out of order OK + NAT44 hairpinning - 1:1 NAPT OK + NAT44 hairpinning - 1:1 NAT OK + 1:1 NAT translate packet with unknown protocol - hairpinning OK + NAT44 translate packet with unknown protocol - hairpinning OK + Identity NAT OK + NAT44 multiple inside interfaces with overlapping address space OK + Acquire NAT44 addresses from interface OK + Identity NAT with addresses from interface OK + Static mapping with addresses from interface OK + IPFIX logging NAT addresses exhausted OK + IPFIX logging NAT44 session created/delted OK + MAX translations per user - recycle the least recently used OK + NAT44 multiple non-overlapping address space inside interfaces OK + One armed NAT44 OK + NAT44 interface output feature (in2out postrouting) OK + NAT44 interface output feature hairpinning (in2out postrouting) OK + NAT44 interface output feature VRF aware (in2out postrouting) OK + Ping internal host from outside network OK + Ping NAT44 out interface from outside network OK + NAT44 add pool addresses to FIB OK + Port restricted NAT44 (MAP-E CE) OK + NAT44 fragments hairpinning OK + NAT44 set/get virtual fragmentation reassembly OK + 1:1 NAT initialized from inside network OK + NAT44 interfaces without configured IP address - 1:1 NAT OK + NAT44 local service load balancing OK + 1:1 NAT initialized from outside network OK + 1:1 NAT translate packet with unknown protocol OK + 1:1 NAT VRF awareness OK + 1:1 NAPT initialized from inside network OK + NAT44 interfaces without configured IP address - 1:1 NAPT OK + 1:1 NAPT initialized from outside network OK + Twice NAT44 OK + Acquire twice NAT44 addresses from interface OK + Twice NAT44 local service load balancing OK + NAT44 translate packet with unknown protocol OK + NAT44 tenant VRF independent address pool mode OK + NAT44 tenant VRF aware address pool mode OK -Classifier -`````````` -:: -####### ============================================================================== - Classifier Test Case + Deterministic NAT Test Cases ============================================================================== - IP ACL test OK - MAC ACL test OK - IP PBR test OK + Deterministic NAT translation test (TCP, UDP, ICMP) OK + NAT plugin run deterministic mode OK + Deterministic NAT multiple users OK + Deterministic NAT maximum sessions per user limit SKIP + Deterministic NAT session timeouts SKIP + Set deterministic NAT timeouts OK + Deterministic NAT TCP session close from inside network OK + Deterministic NAT TCP session close from outside network OK -VXLAN Tests -``````````` +NAT64 +````` :: ============================================================================== - VXLAN Test Case + NAT64 Test Cases ============================================================================== - Decapsulation test OK - Encapsulation test OK - Multicast flood test OK - Multicast receive test OK - Unicast flood test OK + NAT64 dynamic translation test OK + NAT64 translate fragments arriving in order OK + NAT64 translate fragments arriving out of order OK + NAT64 hairpinning OK + NAT64 translate packet with unknown protocol - hairpinning OK + NAT64 ICMP Error message translation OK + Enable/disable NAT64 feature on the interface OK + Acquire NAT64 pool addresses from interface OK + One armed NAT64 OK + Add/delete address to NAT64 pool OK + NAT64 Network-Specific Prefix OK + NAT64 fragments hairpinning OK + NAT64 session timeout SKIP + Set NAT64 timeouts OK + NAT64 static translation test OK + Add/delete static BIB entry OK + NAT64 translate packet with unknown protocol OK -VXLAN-GPE Tests -``````````` +P2P Ethernet Subinterface +````````````````````````` :: ============================================================================== - VXLAN-GPE Test Case + P2P Ethernet tests ============================================================================== - Decapsulation test SKIP - Encapsulation test SKIP - Multicast flood test SKIP - Multicast receive test SKIP - Unicast flood test SKIP - -L2 FIB CRUD -``````````` -:: + delete/create p2p subif OK + create 1k of p2p subifs OK ============================================================================== - L2 FIB Test Case + P2P Ethernet IPv4 tests ============================================================================== - L2 FIB test 1 - program 100 MAC addresses OK - L2 FIB test 2 - delete 12 MAC entries OK - L2 FIB test 3 - program new 100 MAC addresses OK - L2 FIB test 4 - delete 160 MAC entries OK - L2 FIB test 5 - Program 10 new MAC entries, learn 10 OK - L2 FIB test 6 - flush first interface OK - L2 FIB test 7 - flush bd_id OK - L2 FIB test 8 - flush all OK - L2 FIB test 9 - mac learning events OK - -ARP Tests -````````` -:: + receive ipv4 packet via p2p subinterface OK + route rx packet not matching p2p subinterface OK + send ip4 packet via p2p subinterface OK + drop tx ip4 packet not matching p2p subinterface OK ============================================================================== - ARP Test Case + P2P Ethernet IPv6 tests ============================================================================== - ARP OK - MPLS OK - Proxy ARP OK + receive ipv6 packet via p2p subinterface OK + drop rx packet not matching p2p subinterface OK + route rx ip6 packet not matching p2p subinterface OK + send packet via p2p subinterface OK + drop tx ip6 packet not matching p2p subinterface OK + standard routing without p2p subinterfaces OK -L2BD Tests -`````````` +PPPoE Encapsulation +``````````````````` :: ============================================================================== - L2BD Test Case + PPPoE Test Case ============================================================================== - L2BD MAC learning dual-loop test OK - L2BD MAC learning single-loop test OK + PPPoE Add Same Session Twice Test OK + PPPoE Decap Test OK + PPPoE Decap Multiple Sessions Test OK + PPPoE Delete Same Session Twice Test OK + PPPoE Encap Test OK + PPPoE Encap Multiple Sessions Test OK -MACIP Access Control Tests -`````````` +SPAN Switch Port Analyzer +````````````````````````` :: ============================================================================== - MACIP Test Case + SPAN Test Case ============================================================================== - IP4 MACIP wildcardMAC|exactIP ACL bridged traffic OK - MACIP 10 ACLs each with 100+ entries OK - MACIP 10 ACLs each with 100+ entries with IP4 traffic OK - MACIP 10 ACLs each with 100+ entries with IP6 traffic OK - MACIP ACL with 10 entries OK - MACIP ACL with 100 entries OK - MACIP ACL with 2 entries OK - MACIP ACL with 20 entries OK - MACIP ACL with 5 entries OK - MACIP ACL with 50 entries OK - MACIP 2 ACLs each with 100+ entries OK - IP4 MACIP exactMAC|exactIP ACL bridged traffic OK - IP4 MACIP exactMAC|subnetIP ACL bridged traffic OK - IP4 MACIP exactMAC|wildIP ACL bridged traffic OK - IP4 MACIP ouiMAC|exactIP ACL bridged traffic OK - IP4 MACIP ouiMAC|subnetIP ACL bridged traffic OK - IP4 MACIP ouiMAC|wildIP ACL bridged traffic OK - IP4 MACIP wildcardMAC|subnetIP ACL bridged traffic OK - IP4 MACIP wildcardMAC|wildIP ACL bridged traffic OK - IP6 MACIP exactMAC|exactIP ACL bridged traffic OK - IP6 MACIP exactMAC|subnetIP ACL bridged traffic OK - IP6 MACIP exactMAC|wildIP ACL bridged traffic OK - IP6 MACIP oui_MAC|exactIP ACL bridged traffic OK - IP6 MACIP ouiMAC|subnetIP ACL bridged traffic OK - IP6 MACIP ouiMAC|wildIP ACL bridged traffic OK - IP6 MACIP wildcardMAC|exactIP ACL bridged traffic OK - IP6 MACIP wildcardMAC|subnetIP ACL bridged traffic OK - IP6 MACIP wildcardMAC|wildIP ACL bridged traffic OK - MACIP replace ACL OK - MACIP replace ACL with IP4 traffic OK - MACIP replace ACL with IP6 traffic OK - IP4 MACIP exactMAC|exactIP ACL routed traffic OK - IP4 MACIP exactMAC|subnetIP ACL routed traffic OK - IP4 MACIP exactMAC|wildIP ACL routed traffic OK - IP4 MACIP ouiMAC|exactIP ACL routed traffic OK - IP4 MACIP ouiMAC|subnetIP ACL routed traffic OK - IP4 MACIP ouiMAC|wildIP ACL routed traffic OK - IP4 MACIP wildcardMAC|exactIP ACL routed traffic OK - IP4 MACIP wildcardMAC|subnetIP ACL routed traffic OK - IP4 MACIP wildcardMAC|wildIP ACL OK - IP6 MACIP exactMAC|exactIP ACL routed traffic OK - IP6 MACIP exactMAC|subnetIP ACL routed traffic OK - IP6 MACIP exactMAC|wildIP ACL routed traffic OK - IP6 MACIP ouiMAC|exactIP ACL routed traffic OK - IP6 MACIP ouiMAC|subnetIP ACL routed traffic OK - IP6 MACIP ouiMAC|wildIP ACL routed traffic OK - IP6 MACIP wildcardMAC|exactIP ACL routed traffic OK - IP6 MACIP wildcardMAC|subnetIP ACL routed traffic OK - IP6 MACIP wildcardMAC|wildIP ACL OK - MACIP ACL delete intf with acl OK + SPAN device rx mirror OK + SPAN l2 broadcast mirror OK + SPAN l2 rx tx mirror OK + SPAN l2 tx mirror OK + SPAN l2 rx mirror OK + SPAN l2 rx mirror into 1ad subif+vtr OK + SPAN l2 rx mirror into 1q subif+vtr OK + SPAN l2 rx mirror into gre-subif+vtr OK + SPAN l2 rx mirror into vxlan OK -SRv6 Tests -`````````` +SRv6 Routing +```````````` :: ============================================================================== @@ -765,23 +1080,29 @@ SRv6 Tests Test SRv6 Transit.Encaps behavior for IPv4. OK Test SRv6 Transit.Encaps behavior for L2. SKIP Test SRv6 Transit.Insert behavior (IPv6 only). OK + Test SRv6 Transit.Insert behavior (IPv6 only). OK -PPPoE Tests -``````````` +TCP/IP Stack +```````````` :: ============================================================================== - PPPoE Test Case + TCP Test Case ============================================================================== - PPPoE Add Same Session Twice Test OK - PPPoE Decap Test OK - PPPoE Decap Multiple Sessions Test OK - PPPoE Delete Same Session Twice Test OK - PPPoE Encap Test OK - PPPoE Encap Multiple Sessions Test OK + TCP builtin client/server transfer OK + TCP Unit Tests OK -VTR VLAN Tag Rewrite Tests -`````````````````````````` +UDP Stack +````````` +:: + + ============================================================================== + UDP Encap Test Case + ============================================================================== + UDP Encap test OK + +VTR VLAN Tag Rewrites +````````````````````` :: ============================================================================== @@ -807,71 +1128,12 @@ VTR VLAN Tag Rewrite Tests 1Q VTR translate 1 -> 1 test OK 1Q VTR translate 1 -> 2 test OK -ARP Tests -````````` -:: - - ============================================================================== - ARP Test Case - ============================================================================== - ARP OK - ARP Duplicates OK - ARP Static OK - ARP reply with VRRP virtual src hw addr OK - MPLS OK - Proxy ARP OK - Interface Mirror Proxy ARP OK - ============================================================================== - L2BD arp termination Test Case - ============================================================================== - L2BD arp term - add 5 hosts, verify arp responses OK - L2BD arp term - delete 3 hosts, verify arp responses OK - L2BD arp term - recreate BD1, readd 3 hosts, verify arp responses OK - L2BD arp term - 2 IP4 addrs per host OK - L2BD arp term - create and update 10 IP4-mac pairs OK - L2BD arp/ND term - hosts with both ip4/ip6 OK - L2BD ND term - Add and Del hosts, verify ND replies OK - L2BD ND term - Add and update IP+mac, verify ND replies OK - L2BD arp term - send garps, verify arp event reports OK - L2BD arp term - send duplicate garps, verify suppression OK - L2BD arp term - disable ip4 arp events,send garps, verify no events OK - L2BD ND term - send NS packets verify reports OK - L2BD ND term - send duplicate ns, verify suppression OK - L2BD ND term - disable ip4 arp events,send ns, verify no events OK - -P2P Ethernet Subinterface ests -`````````````````````````````` -:: - - ============================================================================== - P2P Ethernet tests - ============================================================================== - delete/create p2p subif OK - create 100k of p2p subifs SKIP - create 1k of p2p subifs OK - ============================================================================== - P2P Ethernet IPv4 tests - ============================================================================== - receive ipv4 packet via p2p subinterface OK - route rx packet not matching p2p subinterface OK - send ip4 packet via p2p subinterface OK - drop tx ip4 packet not matching p2p subinterface OK - ============================================================================== - P2P Ethernet IPv6 tests - ============================================================================== - receive ipv6 packet via p2p subinterface OK - drop rx packet not matching p2p subinterface OK - route rx ip6 packet not matching p2p subinterface OK - send packet via p2p subinterface OK - drop tx ip6 packet not matching p2p subinterface OK - standard routing without p2p subinterfaces OK - -GTPU Test Case -`````````````` +VXLAN Tunnels +````````````` :: ============================================================================== - GTPU Test Case + VXLAN Test Case ============================================================================== Decapsulation test OK Encapsulation test OK @@ -879,38 +1141,38 @@ GTPU Test Case Multicast receive test OK Unicast flood test OK -Other Tests -``````````` +VXLAN-GPE Tunnels +````````````````` :: ============================================================================== - VAPI test + VXLAN-GPE Test Case ============================================================================== - run C VAPI tests SKIP - run C++ VAPI tests SKIP + Decapsulation test SKIP + Encapsulation test SKIP + Multicast flood test SKIP + Multicast receive test SKIP + Unicast flood test SKIP + +Other Tests +``````````` +:: + ============================================================================== Ping Test Case ============================================================================== basic ping test OK burst ping test OK + + ============================================================================== + Session Test Case + ============================================================================== + Session Unit Tests OK + ============================================================================== Template verification, timer tests ============================================================================== timer less than template timeout OK timer greater than template timeout OK verify cflow packet fields OK - ============================================================================== - JVPP Core Test Case - ============================================================================== - JVPP Acl Callback Api Test Case OK - JVPP Acl Future Api Test Case OK - JVPP Core Callback Api Test Case OK - JVPP Core Future Api Test Case OK - JVPP Ioamexport Callback Api Test Case OK - JVPP Ioamexport Future Api Test Case OK - JVPP Ioampot Callback Api Test Case OK - JVPP Ioampot Future Api Test Case OK - JVPP Ioamtrace Callback Api Test Case OK - JVPP Ioamtrace Future Api Test Case OK - JVPP Snat Callback Api Test Case OK - JVPP Snat Future Api Test Case OK \ No newline at end of file + diff --git a/docs/report/vpp_unit_tests/overview.rst b/docs/report/vpp_unit_tests/overview.rst index 90c582c943..9472680aa5 100644 --- a/docs/report/vpp_unit_tests/overview.rst +++ b/docs/report/vpp_unit_tests/overview.rst @@ -35,40 +35,53 @@ Unit Tests Coverage Following VPP functional test areas are covered in VPP unit test code included in VPP rls1710 with results listed in this report: -- ARP - ARP, Proxy ARP. -- ACL plugin - stateful and stateless security-groups access-control-lists. -- BFD IPv4 - Bidirectional Forwarding Detection - baseline, APIs, authorization, authentication. -- BFD IPv6 - Bidirectional Forwarding Detection - baseline, APIs, authorization, authentication. +- ACL Security - stateful and stateless security-groups access-control-lists. +- APIs - VAPI, VOM, PAPI, JVPP. +- ARP - ARP, proxy ARP, static arp. +- BFD - API, Authentication, Authentication Change, CLI. +- BFD IPv4 - sessions operation. +- BFD IPv6 - sessions operation. +- BIER - Bit Indexed Explicit Replication. - Classifier - classification with IP ACL, MAC ACL, IP PBR. +- Container Integration - IPv4, IPv6 local-spoof connectivity tests. - CRUD Loopback - create, read, update, delete Loopback interfaces. -- Deterministic NAT - Carrier Grade NAT tests. -- DHCP - DHCPv4 and DHCPv6 Proxy. +- DHCP - DHCPv4/v6 Client and Proxy. +- Distributed Virtual Router. +- DS-Lite Softwire - softwire termination. - FIB - baseline and scale tests. -- Flow-per-packet plugin - collect and report L2 and IP4 flow statistics. -- Flowprobe tests. -- GRE - GRE IPv4/IPv6 tunnel, L2, VRF tests. -- GTPU - baseline GTPU tests. -- IP Multicast - IPv4/IPv6 multicast replication, connected source check. +- Flowprobe. +- Geneve Tunnels. +- GRE Tunnels - GRE IPv4/IPv6 tunnel, L2, VRF tests. +- GTPU Tunnels - baseline GTPU tests. +- IP Multicast Routing - IPv4/IPv6 multicast replication, connected source check. +- IPSec - baseline IPSec sanity tests. +- IPv4 FIB CRUD - add/update/delete IPv4 routes. +- IPv4 Routing. - IP4 VRF Multi-instance - create, read, update, delete and verify IPv4 VRFs. +- IPv6 Routing - baseline FIB operations, NS/RS exception handling. - IP6 VRF Multi-instance - create, read, update, delete and verify IPv6 VRFs. -- IPv4 - baseline FIB tests. -- IPv4 FIB CRUD - add/update/delete IPv4 routes. -- IPv6 - baseline FIB operations, NS/RS exception handling. -- IRB - Integrated Routing and Bridging tests. +- IRB Integrated Routing-Bridging. +- Kube-proxy - data plane NAT tests. - L2 FIB CRUD - add/update/delete L2 MAC entries. -- L2BD - L2 Bridge-Domain baseline tests incl. single- and dual-loop. -- L2XC - L2 cross-connect baseline tests incl. single- and dual-loop. +- L2BD Multi-instance. +- L2BD Switching - L2 Bridge-Domain baseline tests incl. single- and dual-loop. - L2XC Multi-instance - L2 cross-connect multi-instance tests. -- LISP - basic LISP tests. +- L2XC Switching - L2 cross-connect baseline tests incl. single- and dual-loop. +- LISP Tunnels - basic LISP tests. - Load Balancer - IP4 GRE4, IP4 GRE6, IP6 GRE4, IP6 GRE6. -- MACIP - ingress access control for IPv4, IPv6 with L2BDP and IP routing. -- MFIB Unit. -- MPLS - MPLS baseline tests. -- MPLS PIC edge convergence - prefix independent convergence tests for MPLS PE. -- NAT44 - NAT44 tests, IPFIX logging, VRF awareness. +- MACIP Access Control - ingress access control for IPv4, IPv6 with L2BDP and IP routing. +- MAP Softwires - softwire termination. +- MFIB Multicast FIB. +- MPLS Switching - MPLS baseline, prefix independent convergence for MPLS PE. +- NAT44 - NAT44 tests, IPFIX logging, VRF awareness, deterministic CGNAT. - NAT64 - NAT64 static and dynamic translation tests. -- SPAN - Switched Port Analyzer packet mirroring. -- SRv6 - Segment Routing IPv6 tests. -- VTR Test Case - VLAN tag manipulation tests. -- VXLAN - baseline VXLAN tunneling. -- VXLAN-GPE - baseline VXLAN-GPE tunneling tests including multicast. +- P2P Ethernet Subinterface. +- PPPoE Encapsulation. +- SPAN Switch Port Analyzer - packet mirroring. +- SRv6 Routing - Segment Routing IPv6 tests. +- TCP/IP Stack - unit tests, builtin client/server transfers. +- UDP Stack - unit tests. +- VTR VLAN Tag Rewrites - VLAN tag rewrite tests. +- VXLAN Tunnels - baseline VXLAN tests including multicast. +- VXLAN-GPE Tunnels - baseline VXLAN-GPE tunneling including multicast. +- Other Tests - ping, session, template verification, timer tests.