X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Ftag_documentation.rst;h=408477d3b5a717ddd32be67bb6713fa75286bd6e;hp=3e2d44df73eec2ae118125cca7160e2fc157b950;hb=2bdb1dc59ba736546a6663cbaf55b6edbcac6eab;hpb=d166ae0881c29dfd05ed61b9a12156f17981bb6d diff --git a/docs/tag_documentation.rst b/docs/tag_documentation.rst index 3e2d44df73..408477d3b5 100644 --- a/docs/tag_documentation.rst +++ b/docs/tag_documentation.rst @@ -1,8 +1,10 @@ CSIT TAGs Descriptions ====================== -Documentation for tags used to select and identify test cases. - +All CSIT test cases are labelled with Robot Framework tags used to allow for +easy test case type identification, test case grouping and selection for +execution. Following sections list currently used CSIT TAGs and their +documentation. Topology TAGs ------------- @@ -17,7 +19,6 @@ Topology TAGs 3 nodes connected in a circular topology with at least one link interconnecting devices. - Objective TAGs -------------- @@ -30,7 +31,6 @@ Objective TAGs Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch). - Environment TAGs ---------------- @@ -46,7 +46,6 @@ Environment TAGs DUTs with VPP and capable of running Virtual Machine. - NIC model tags -------------- @@ -70,7 +69,6 @@ NIC model tags VIC-1385 by Cisco. - Scaling TAGs ------------ @@ -110,6 +108,20 @@ Scaling TAGs Traffic flow with 4000 unique IPs (users) in one direction. +.. topic:: 100_FLOWS + + Traffic stream with 100 unique flows (10 IPs/users x 10 UDP ports) in one + direction. + +.. topic:: 10k_FLOWS + + Traffic stream with 10 000 unique flows (10 IPs/users x 1000 UDP ports) in + one direction. + +.. topic:: 100k_FLOWS + + Traffic stream with 100 000 unique flows (100 IPs/users x 1000 UDP ports) in + one direction. Tags marking functional vs. performance of tests ------------------------------------------------ @@ -122,7 +134,6 @@ Tags marking functional vs. performance of tests All performance test cases. - Performance testing tags ------------------------ @@ -143,7 +154,7 @@ Performance testing tags .. topic:: NDRPDRDISC - Find performance of DUT based on RFC2544 with linear / binary / combined + Find performance of DUT based on :rfc:`2544` with linear / binary / combined search. (Previous LONG tests.) Ethernet frame size tags for performance tests @@ -221,9 +232,8 @@ Test type tags At least one feature is configured in test cases. Use also feature tag(s). .. topic:: TLDK - - Functional test cases for TLDK. + Functional test cases for TLDK. Forwarding mode tags -------------------- @@ -248,7 +258,6 @@ Forwarding mode tags VPP IPv6 routed forwarding. - Underlay tags ------------- @@ -264,7 +273,6 @@ Underlay tags MPLS underlay. - Overlay tags ------------ @@ -280,13 +288,8 @@ Overlay tags IPv6 overlay (IPv6 payload). - -Encapsulation tags ------------------- - -.. topic:: ETH - - All test cases with base Ethernet (no encapsulation). +Tagging tags +------------ .. topic:: DOT1Q @@ -296,6 +299,13 @@ Encapsulation tags All test cases with dot1ad. +Encapsulation tags +------------------ + +.. topic:: ETH + + All test cases with base Ethernet (no encapsulation). + .. topic:: LISP All test cases with LISP. @@ -320,7 +330,6 @@ Encapsulation tags All test cases with IPSEC. - Interface tags -------------- @@ -332,6 +341,18 @@ Interface tags All test cases which uses VHOST. +.. topic:: VHOST_256 + + All test cases which uses VHOST with qemu queue size set to 256. + +.. topic:: VHOST_1024 + + All test cases which uses VHOST with qemu queue size set to 1024. + +.. topic:: CFS_OPT + + All test cases which uses VM with optimised scheduler policy. + .. topic:: TUNTAP All test cases which uses TUN and TAP. @@ -359,10 +380,45 @@ Feature tags COP whitelist. -.. topic:: SNAT +.. topic:: NAT44 + + NAT44 configured and tested. + +.. topic:: NAT64 + + NAT44 configured and tested. + +.. topic:: ACL + + ACL plugin configured and tested. + +.. topic:: IACL - SNAT configured and tested. + ACL plugin configured and tested on input path. +.. topic:: OACL + + ACL plugin configured and tested on output path. + +.. topic:: ACL_STATELESS + + ACL plugin configured and tested in stateless mode (permit action). + +.. topic:: ACL_STATEFUL + + ACL plugin configured and tested in stateful mode (permit+reflect action). + +.. topic:: ACL1 + + ACL plugin configured and tested with 1 not-hitting ACE. + +.. topic:: ACL10 + + ACL plugin configured and tested with 10 not-hitting ACEs. + +.. topic:: ACL50 + + ACL plugin configured and tested with 50 not-hitting ACEs. Encryption tags --------------- @@ -383,7 +439,6 @@ Encryption tags IPSec in tunnel mode. - Client-workload tags -------------------- @@ -399,7 +454,6 @@ Client-workload tags All test cases with specific APP use. - Multi-threading tags -------------------- @@ -452,7 +506,6 @@ Multi-threading tags 8 worker threads pinned to 8 dedicated physical cores. 4 receive queues per interface. Main thread pinned to core 0. - Honeycomb tags --------------