X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Ftag_documentation.rst;h=5c68858bfaafacb0e268a1f97c133435f44b229f;hp=7cb71f115e8cb5be08e45d699ee33586f1e9bbc9;hb=bf05994fbf8308bb2482c494a2b28949837fcc6f;hpb=88e6c1f979f530397a0743e4300d42faf9b538f5 diff --git a/docs/tag_documentation.rst b/docs/tag_documentation.rst index 7cb71f115e..5c68858bfa 100644 --- a/docs/tag_documentation.rst +++ b/docs/tag_documentation.rst @@ -1,13 +1,13 @@ -CSIT TAGs +CSIT Tags ========= All CSIT test cases are labelled with Robot Framework tags used to allow for easy test case type identification, test case grouping and selection for -execution. Following sections list currently used CSIT TAGs and their -documentation. +execution. Following sections list currently used CSIT tags and their +descriptions. -Topology TAGs -------------- +Testbed Topology Tags +--------------------- .. topic:: 2_NODE_DOUBLE_LINK_TOPO @@ -29,7 +29,7 @@ Topology TAGs 3 nodes connected in a circular topology with at least one link interconnecting devices. -Objective TAGs +Objective Tags -------------- .. topic:: SKIP_PATCH @@ -41,7 +41,7 @@ Objective TAGs Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch). -Environment TAGs +Environment Tags ---------------- .. topic:: HW_ENV @@ -56,7 +56,7 @@ Environment TAGs DUTs with VPP and capable of running Virtual Machine. -NIC model tags +NIC Model Tags -------------- .. topic:: NIC_Intel-X520-DA2 @@ -83,7 +83,7 @@ NIC model tags VIC-1385 by Cisco. -Scaling TAGs +Scaling Tags ------------ .. topic:: FIB_20K @@ -146,9 +146,13 @@ Scaling TAGs Test with 1000 VXLAN tunnels. -.. topic:: TNL_1000 +.. topic:: TNL_{t} + + IPSec in tunnel mode - {t} tunnels. - IPSec in tunnel mode - 1000 tunnels. +.. topic:: SRC_USER_1 + + Traffic flow with 1 unique IP (users) in one direction. .. topic:: SRC_USER_10 @@ -185,24 +189,8 @@ Scaling TAGs Traffic stream with 100 000 unique flows (100 IPs/users x 1000 UDP ports) in one direction. -.. topic:: 1C1N - - 1 service chain with 1 network function per chain. - -.. topic:: 2C1N - - 2 service chains with 1 network function per chain. - -.. topic:: 1C2N - - 1 service chain with 2 network functions per chain. - -.. topic:: 2C2N - - 2 service chains with 2 network functions per chain. - -Tags marking functional vs. performance of tests ------------------------------------------------- +Test Category Tags +------------------ .. topic:: FUNCTEST @@ -212,8 +200,8 @@ Tags marking functional vs. performance of tests All performance test cases. -Performance testing tags ------------------------- +Performance Type Tags +--------------------- .. topic:: NDRPDR @@ -228,20 +216,37 @@ Performance testing tags and reports total sent/received packets over trial duration. The result is an average of 10 trials of 1 second duration. -Ethernet frame size tags for performance tests ----------------------------------------------- +.. topic:: SOAK + + Performance tests using PLRsearch to find the critical load. + +.. topic:: RECONF + + Performance tests aimed to measure lost packets (time) when performing + reconfiguration while full throughput offered load is applied. + +Ethernet Frame Size Tags +------------------------ + +These are describing the traffic offered by Traffic Generator, +"primary" traffic in case of asymmetric load. +For traffic between DUTs, or for "secondary" traffic, see ${overhead} value. .. topic:: 64B - 64B frames used for test. + 64B frames used for test. Generic ethernet or IPv4. .. topic:: 78B - 78B frames used for test. + 78B frames used for test. Ipv6. .. topic:: 114B - 114B frames used for test. + 114B frames used for test. IPv4+vxlan. + +.. topic:: 118B + + 118B frames used for test. Dot1q+IPv4+vxlan. .. topic:: IMIX @@ -267,7 +272,7 @@ Ethernet frame size tags for performance tests 9000B frames used for test. -Test type tags +Test Type Tags -------------- .. topic:: BASE @@ -335,12 +340,52 @@ Test type tags Tests which use HTTP. -.. topic:: SERVICE_DENSITY +.. topic:: NF_DENSITY + + Performance tests that measure throughput of multiple VNF and CNF + service topologies at different service densities. + +NF Service Density Tags +----------------------- + +.. topic:: CHAIN + + NF service density tests with VNF or CNF service chain topology(ies). + +.. topic:: PIPE + + NF service density tests with CNF service pipeline topology(ies). + +.. topic:: NF_L3FWDIP4 + + NF service density tests with DPDK l3fwd IPv4 routing as NF workload. + +.. topic:: NF_VPPIP4 + + NF service density tests with VPP IPv4 routing as NF workload. - Performance tests which measures performance of service density by creating - topology of multiple sevice chains of network functions. +.. topic:: {r}R{c}C -Forwarding mode tags + Service density matrix locator {r}R{c}C, {r}Row denoting number of + service instances, {c}Column denoting number of NFs per service + instance. {r}=(1,2,4,6,8,10), {c}=(1,2,4,6,8,10). + +.. topic:: {n}VM{t}T + + Service density {n}VM{t}T, {n}Number of NF Qemu VMs, {t}Number of threads + per NF. + +.. topic:: {n}DCRt}T + + Service density {n}DCR{t}T, {n}Number of NF Docker containers, {t}Number of + threads per NF. + +.. topic:: {n}_ADDED_CHAINS + + {n}Number of chains (or pipelines) added (and/or removed) + during RECONF test. + +Forwarding Mode Tags -------------------- .. topic:: L2BDMACSTAT @@ -363,7 +408,7 @@ Forwarding mode tags VPP IPv6 routed forwarding. -Underlay tags +Underlay Tags ------------- .. topic:: IP4UNRLAY @@ -378,7 +423,7 @@ Underlay tags MPLS underlay. -Overlay tags +Overlay Tags ------------ .. topic:: L2OVRLAY @@ -393,7 +438,7 @@ Overlay tags IPv6 overlay (IPv6 payload). -Tagging tags +Tagging Tags ------------ .. topic:: DOT1Q @@ -404,7 +449,7 @@ Tagging tags All test cases with dot1ad. -Encapsulation tags +Encapsulation Tags ------------------ .. topic:: ETH @@ -439,7 +484,19 @@ Encapsulation tags All test cases with Segment routing over IPv6 dataplane. -Interface tags +.. topic:: SRv6_1SID + + All SRv6 test cases with single SID. + +.. topic:: SRv6_2SID_DECAP + + All SRv6 test cases with two SIDs and with decapsulation. + +.. topic:: SRv6_2SID_NODECAP + + All SRv6 test cases with two SIDs and without decapsulation. + +Interface Tags -------------- .. topic:: PHY @@ -524,7 +581,7 @@ Interface tags devices. In essence, today this driver can be used only with Intel XL710 / X710 / XXV710 adapters. -Feature tags +Feature Tags ------------ .. topic:: IACLDST @@ -591,7 +648,7 @@ Feature tags SRv6 endpoint to SR-unaware appliance via masquerading proxy. -Encryption tags +Encryption Tags --------------- .. topic:: IPSECSW @@ -610,7 +667,39 @@ Encryption tags IPSec in tunnel mode. -Client-workload tags +.. topic:: IPSECINT + + IPSec in interface mode. + +.. topic:: AES + + IPSec using AES algorithms. + +.. topic:: AES_128_CBC + + IPSec using AES 128 CBC algorithms. + +.. topic:: AES_128_GCM + + IPSec using AES 128 GCM algorithms. + +.. topic:: AES_256_GCM + + IPSec using AES 256 GCM algorithms. + +.. topic:: HMAC + + IPSec using HMAC integrity algorithms. + +.. topic:: HMAC_SHA_256 + + IPSec using HMAC SHA 256 integrity algorithms. + +.. topic:: HMAC_SHA_512 + + IPSec using HMAC SHA 512 integrity algorithms. + +Client-Workload Tags -------------------- .. topic:: VM @@ -621,6 +710,10 @@ Client-workload tags All test cases which use Linux container and LXC utils. +.. topic:: DRC + + All test cases which use at least one Docker container. + .. topic:: DOCKER All test cases which use Docker as container manager. @@ -629,7 +722,7 @@ Client-workload tags All test cases with specific APP use. -Container orchestration tags +Container Orchestration Tags ---------------------------- .. topic:: K8S @@ -662,7 +755,7 @@ Container orchestration tags 4 VPP running in 4 Docker containers acting as VNF work load. -Multi-threading tags +Multi-Threading Tags -------------------- .. topic:: STHREAD @@ -739,7 +832,7 @@ Multi-threading tags physical cores. 4 receive queues per interface. Main thread pinned to core 1. -Honeycomb tags +Honeycomb Tags -------------- .. topic:: HC_FUNC