CSIT-215 Improve documentation - performance

- Improve documentation in performance libraries

Change-Id: I66e5b0782497c5759c737556f207cf2fd3383923
Signed-off-by: pmikus <pmikus@cisco.com>

diff --git a/resources/libraries/robot/performance.robot b/resources/libraries/robot/performance.robot
index 63295b7..4bee378 100644 (file)
--- a/resources/libraries/robot/performance.robot
+++ b/resources/libraries/robot/performance.robot
@@ -28,7 +28,9 @@
 
 *** Keywords ***
 | Setup performance rate Variables
 
 *** Keywords ***
 | Setup performance rate Variables

-| | [Documentation] | Setup performance rates as Suite Variables
+| | [Documentation]
+| | ... | Setup performance linerates as Suite Variables. Variables are used
+| | ... | as search boundaries in RFC2544 throughput search.

 | | ...
 | | ... | _NOTE:_ This KW sets following suite variables:
 | | ... | - 10Ge_linerate_pps_64B - Maximum number of packet per second
 | | ...
 | | ... | _NOTE:_ This KW sets following suite variables:
 | | ... | - 10Ge_linerate_pps_64B - Maximum number of packet per second


@@ -92,16 +94,29 @@
 | | Set Suite Variable | ${40Ge_linerate_pps_9008B} | 553832
 
 | Setup performance global Variables
 | | Set Suite Variable | ${40Ge_linerate_pps_9008B} | 553832
 
 | Setup performance global Variables

-| | [Documentation] | Setup performance global Variables
+| | [Documentation]
+| | ... | Setup suite Variables. Variables are used across performance testing.

 | | ...
 | | ... | _NOTE:_ This KW sets following suite variables:
 | | ...
 | | ... | _NOTE:_ This KW sets following suite variables:

-| | ... | - ${glob_loss_acceptance} - Loss acceptance treshold
-| | ... | - ${glob_loss_acceptance_type} - Loss acceptance treshold type
+| | ... | - glob_loss_acceptance - Loss acceptance treshold
+| | ... | - glob_loss_acceptance_type - Loss acceptance treshold type

 | | ...
 | | Set Suite Variable | ${glob_loss_acceptance} | 0.5
 | | Set Suite Variable | ${glob_loss_acceptance_type} | percentage
 
 | 2-node circular Topology Variables Setup
 | | ...
 | | Set Suite Variable | ${glob_loss_acceptance} | 0.5
 | | Set Suite Variable | ${glob_loss_acceptance_type} | percentage
 
 | 2-node circular Topology Variables Setup

+| | [Documentation]
+| | ... | Compute path for testing on two given nodes in circular
+| | ... | topology and set corresponding suite variables.
+| | ...
+| | ... | _NOTE:_ This KW sets following suite variables:
+| | ... | - tg - TG node
+| | ... | - tg_if1 - 1st TG interface towards DUT.
+| | ... | - tg_if2 - 2nd TG interface towards DUT.
+| | ... | - dut1 - DUT1 node
+| | ... | - dut1_if1 - 1st DUT interface towards TG.
+| | ... | - dut1_if2 - 2nd DUT interface towards TG.
+| | ...

 | | Append Nodes | ${nodes['TG']} | ${nodes['DUT1']} | ${nodes['TG']}
 | | Compute Path
 | | ${tg_if1} | ${tg}= | Next Interface
 | | Append Nodes | ${nodes['TG']} | ${nodes['DUT1']} | ${nodes['TG']}
 | | Compute Path
 | | ${tg_if1} | ${tg}= | Next Interface


@@ -116,6 +131,21 @@
 | | Set Suite Variable | ${dut1_if2}
 
 | 3-node circular Topology Variables Setup
 | | Set Suite Variable | ${dut1_if2}
 
 | 3-node circular Topology Variables Setup

+| | [Documentation]
+| | ... | Compute path for testing on three given nodes in circular
+| | ... | topology and set corresponding suite variables.
+| | ...
+| | ... | _NOTE:_ This KW sets following suite variables:
+| | ... | - tg - TG node
+| | ... | - tg_if1 - TG interface towards DUT1.
+| | ... | - tg_if2 - TG interface towards DUT2.
+| | ... | - dut1 - DUT1 node
+| | ... | - dut1_if1 - DUT1 interface towards TG.
+| | ... | - dut1_if2 - DUT1 interface towards DUT2.
+| | ... | - dut2 - DUT2 node
+| | ... | - dut2_if1 - DUT2 interface towards TG.
+| | ... | - dut2_if2 - DUT2 interface towards DUT1.
+| | ...

 | | Append Nodes | ${nodes['TG']} | ${nodes['DUT1']} | ${nodes['DUT2']}
 | | ...          | ${nodes['TG']}
 | | Compute Path
 | | Append Nodes | ${nodes['TG']} | ${nodes['DUT1']} | ${nodes['DUT2']}
 | | ...          | ${nodes['TG']}
 | | Compute Path


@@ -136,9 +166,26 @@
 | | Set Suite Variable | ${dut2_if2}
 
 | 2-node circular Topology Variables Setup with DUT interface model
 | | Set Suite Variable | ${dut2_if2}
 
 | 2-node circular Topology Variables Setup with DUT interface model

-| | [Documentation] | Find a path between TG-DUT1-TG based on interface
-| | ...             | model provided as an argument. Set suite variables
-| | ...             | tg, tg_if1, tg_if2, dut1, dut1_if1, dut1_if2,
+| | [Documentation]
+| | ... | Compute path for testing on two given nodes in circular topology
+| | ... | based on interface model provided as an argument and set
+| | ... | corresponding suite variables.
+| | ...
+| | ... | *Arguments:*
+| | ... | - iface_model - Interface model. Type: string
+| | ...
+| | ... | _NOTE:_ This KW sets following suite variables:
+| | ... | - tg - TG node
+| | ... | - tg_if1 - 1st TG interface towards DUT.
+| | ... | - tg_if2 - 2nd TG interface towards DUT.
+| | ... | - dut1 - DUT1 node
+| | ... | - dut1_if1 - 1st DUT interface towards TG.
+| | ... | - dut1_if2 - 2nd DUT interface towards TG.
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| 2-node circular Topology Variables Setup with DUT interface model \
+| | ... | \| Intel-X520-DA2 \|

 | | [Arguments] | ${iface_model}
 | | ${iface_model_list}= | Create list | ${iface_model}
 | | Append Node | ${nodes['TG']}
 | | [Arguments] | ${iface_model}
 | | ${iface_model_list}= | Create list | ${iface_model}
 | | Append Node | ${nodes['TG']}


@@ -157,10 +204,29 @@
 | | Set Suite Variable | ${dut1_if2}
 
 | 3-node circular Topology Variables Setup with DUT interface model
 | | Set Suite Variable | ${dut1_if2}
 
 | 3-node circular Topology Variables Setup with DUT interface model

-| | [Documentation] | Find a path between TG-DUT1-DUT2-TG based on interface
-| | ...             | model provided as an argument. Set suite variables
-| | ...             | tg, tg_if1, tg_if2, dut1, dut1_if1, dut1_if2,
-| | ...             | dut2, dut2_if1, dut2_if2
+| | [Documentation]
+| | ... | Compute path for testing on three given nodes in circular topology
+| | ... | based on interface model provided as an argument and set
+| | ... | corresponding suite variables.
+| | ...
+| | ... | *Arguments:*
+| | ... | - iface_model - Interface model. Type: string
+| | ...
+| | ... | _NOTE:_ This KW sets following suite variables:
+| | ... | - tg - TG node
+| | ... | - tg_if1 - TG interface towards DUT1.
+| | ... | - tg_if2 - TG interface towards DUT2.
+| | ... | - dut1 - DUT1 node
+| | ... | - dut1_if1 - DUT1 interface towards TG.
+| | ... | - dut1_if2 - DUT1 interface towards DUT2.
+| | ... | - dut2 - DUT2 node
+| | ... | - dut2_if1 - DUT2 interface towards TG.
+| | ... | - dut2_if2 - DUT2 interface towards DUT1.
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| 3-node circular Topology Variables Setup with DUT interface model \
+| | ... | \| Intel-X520-DA2 \|

 | | [Arguments] | ${iface_model}
 | | ${iface_model_list}= | Create list | ${iface_model}
 | | Append Node | ${nodes['TG']}
 | | [Arguments] | ${iface_model}
 | | ${iface_model_list}= | Create list | ${iface_model}
 | | Append Node | ${nodes['TG']}


@@ -185,14 +251,18 @@
 | | Set Suite Variable | ${dut2_if2}
 
 | VPP interfaces in path are up in a 2-node circular topology
 | | Set Suite Variable | ${dut2_if2}
 
 | VPP interfaces in path are up in a 2-node circular topology

-| | [Documentation] | *Set UP state on VPP interfaces in path on nodes.*
+| | [Documentation]
+| | ... | *Set UP state on VPP interfaces in path on nodes in 2-node circular
+| | ... | topology.*

 | | ...
 | | Set Interface State | ${dut1} | ${dut1_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if2} | up
 | | Vpp Node Interfaces Ready Wait | ${dut1}
 
 | VPP interfaces in path are up in a 3-node circular topology
 | | ...
 | | Set Interface State | ${dut1} | ${dut1_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if2} | up
 | | Vpp Node Interfaces Ready Wait | ${dut1}
 
 | VPP interfaces in path are up in a 3-node circular topology

-| | [Documentation] | *Set UP state on VPP interfaces in path on nodes.*
+| | [Documentation]
+| | ... | *Set UP state on VPP interfaces in path on nodes in 3-node circular
+| | ... | topology.*

 | | ...
 | | Set Interface State | ${dut1} | ${dut1_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if2} | up
 | | ...
 | | Set Interface State | ${dut1} | ${dut1_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if2} | up


@@ -202,7 +272,14 @@
 | | Vpp Node Interfaces Ready Wait | ${dut2}
 
 | IPv4 forwarding initialized in a 3-node circular topology
 | | Vpp Node Interfaces Ready Wait | ${dut2}
 
 | IPv4 forwarding initialized in a 3-node circular topology

-| | [Documentation] | Custom setup of IPv4 addresses on all DUT nodes and TG
+| | [Documentation]
+| | ... | Set UP state on VPP interfaces in path on nodes in 3-node circular
+| | ... | topology. Get the interface MAC addresses and setup ARP on all VPP
+| | ... | interfaces. Setup IPv4 addresses with /24 prefix on DUT-TG links and
+| | ... | /30 prefix on DUT1-DUT2 link. Set routing on both DUT nodes with
+| | ... | prefix /24 and next hop of neighbour DUT interface IPv4 address.
+| | ...
+| Custom setup of IPv4 addresses on all DUT nodes and TG

 | | Set Interface State | ${dut1} | ${dut1_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if2} | up
 | | Set Interface State | ${dut2} | ${dut2_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if1} | up
 | | Set Interface State | ${dut1} | ${dut1_if2} | up
 | | Set Interface State | ${dut2} | ${dut2_if1} | up


@@ -224,7 +301,13 @@
 | | All Vpp Interfaces Ready Wait | ${nodes}
 
 | IPv6 forwarding initialized in a 3-node circular topology
 | | All Vpp Interfaces Ready Wait | ${nodes}
 
 | IPv6 forwarding initialized in a 3-node circular topology

-| | [Documentation] | Custom setup of IPv6 topology on all DUT nodes
+| | [Documentation]
+| | ... | Set UP state on VPP interfaces in path on nodes in 3-node circular
+| | ... | topology. Get the interface MAC addresses and setup neighbour on all
+| | ... | VPP interfaces. Setup IPv6 addresses with /128 prefixes on all
+| | ... | interfaces. Set routing on both DUT nodes with prefix /64 and
+| | ... | next hop of neighbour DUT interface IPv6 address.
+| | ...

 | | ${prefix}= | Set Variable | 64
 | | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1}
 | | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2}
 | | ${prefix}= | Set Variable | 64
 | | ${tg1_if1_mac}= | Get Interface MAC | ${tg} | ${tg_if1}
 | | ${tg1_if2_mac}= | Get Interface MAC | ${tg} | ${tg_if2}


@@ -247,18 +330,36 @@
 | | Vpp Route Add | ${dut2} | 2001:1::0 | ${prefix} | 2001:3::1 | ${dut2_if1}
 
 | L2 xconnect initialized in a 3-node circular topology
 | | Vpp Route Add | ${dut2} | 2001:1::0 | ${prefix} | 2001:3::1 | ${dut2_if1}
 
 | L2 xconnect initialized in a 3-node circular topology

-| | [Documentation] | Custom setup of L2 xconnect topology
+| | [Documentation]
+| | ... | Setup L2 xconnect topology by cross connecting two interfaces on
+| | ... | each DUT. Interfaces are brought up.
+| | ... |

 | | L2 setup xconnect on DUT | ${dut1} | ${dut1_if1} | ${dut1_if2}
 | | L2 setup xconnect on DUT | ${dut2} | ${dut2_if1} | ${dut2_if2}
 | | All Vpp Interfaces Ready Wait | ${nodes}
 
 | L2 bridge domain initialized in a 3-node circular topology
 | | L2 setup xconnect on DUT | ${dut1} | ${dut1_if1} | ${dut1_if2}
 | | L2 setup xconnect on DUT | ${dut2} | ${dut2_if1} | ${dut2_if2}
 | | All Vpp Interfaces Ready Wait | ${nodes}
 
 | L2 bridge domain initialized in a 3-node circular topology

-| | [Documentation] | Custom setup of L2 bridge topology
+| | [Documentation]
+| | ... | Setup L2 DB topology by adding two interfaces on each DUT into BD
+| | ... | that is created automatically with index 1. Learning is enabled.
+| | ... | Interfaces are brought up.
+| | ... |

 | | Vpp l2bd forwarding setup | ${dut1} | ${dut1_if1} | ${dut1_if2}
 | | Vpp l2bd forwarding setup | ${dut2} | ${dut2_if1} | ${dut2_if2}
 | | All Vpp Interfaces Ready Wait | ${nodes}
 
 | 2-node Performance Suite Setup
 | | Vpp l2bd forwarding setup | ${dut1} | ${dut1_if1} | ${dut1_if2}
 | | Vpp l2bd forwarding setup | ${dut2} | ${dut2_if1} | ${dut2_if2}
 | | All Vpp Interfaces Ready Wait | ${nodes}
 
 | 2-node Performance Suite Setup

+| | [Documentation]
+| | ... | Suite preparation phase that setup default startup configuration of
+| | ... | VPP on all DUTs. Updates interfaces on all nodes and setup global
+| | ... | variables used in test cases. Initializes traffic generator.
+| | ...
+| | ... | *Arguments:*
+| | ... | - topology_type - Topology type. Type: string
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| 2-node Performance Suite Setup \| L2 \|

 | | [Arguments] | ${topology_type}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}
 | | [Arguments] | ${topology_type}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}


@@ -272,6 +373,17 @@
 | | ...                          | ${topology_type}
 
 | 3-node Performance Suite Setup
 | | ...                          | ${topology_type}
 
 | 3-node Performance Suite Setup

+| | [Documentation]
+| | ... | Suite preparation phase that setup default startup configuration of
+| | ... | VPP on all DUTs. Updates interfaces on all nodes and setup global
+| | ... | variables used in test cases. Initializes traffic generator.
+| | ...
+| | ... | *Arguments:*
+| | ... | - topology_type - Topology type. Type: string
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| 3-node Performance Suite Setup \| L2 \|

 | | [Arguments] | ${topology_type}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}
 | | [Arguments] | ${topology_type}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}


@@ -285,6 +397,19 @@
 | | ...                          | ${topology_type}
 
 2-node Performance Suite Setup with DUT's NIC model
 | | ...                          | ${topology_type}
 
 2-node Performance Suite Setup with DUT's NIC model

+| | [Documentation]
+| | ... | Suite preparation phase that setup default startup configuration of
+| | ... | VPP on all DUTs. Updates interfaces on all nodes and setup global
+| | ... | variables used in test cases based on interface model provided as an
+| | ... | argument. Initializes traffic generator.
+| | ...
+| | ... | *Arguments:*
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - nic_model - Interface model. Type: string
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| 2-node Performance Suite Setup \| L2 \| Intel-X520-DA2 \|

 | | [Arguments] | ${topology_type} | ${nic_model}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}
 | | [Arguments] | ${topology_type} | ${nic_model}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}


@@ -299,6 +424,19 @@
 | | ...                          | ${topology_type}
 
 3-node Performance Suite Setup with DUT's NIC model
 | | ...                          | ${topology_type}
 
 3-node Performance Suite Setup with DUT's NIC model

+| | [Documentation]
+| | ... | Suite preparation phase that setup default startup configuration of
+| | ... | VPP on all DUTs. Updates interfaces on all nodes and setup global
+| | ... | variables used in test cases based on interface model provided as an
+| | ... | argument. Initializes traffic generator.
+| | ...
+| | ... | *Arguments:*
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - nic_model - Interface model. Type: string
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| 3-node Performance Suite Setup \| L2 \| Intel-X520-DA2 \|

 | | [Arguments] | ${topology_type} | ${nic_model}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}
 | | [Arguments] | ${topology_type} | ${nic_model}
 | | Setup default startup configuration of VPP on all DUTs
 | | Update All Interface Data On All Nodes | ${nodes}


@@ -313,19 +451,22 @@
 | | ...                          | ${topology_type}
 
 | 3-node Performance Suite Teardown
 | | ...                          | ${topology_type}
 
 | 3-node Performance Suite Teardown

+| | [Documentation]
+| | ... | Suite teardown phase with traffic generator teardown.
+| | ...

 | | Teardown traffic generator | ${tg}
 
 | Find NDR using linear search and pps
 | | Teardown traffic generator | ${tg}
 
 | Find NDR using linear search and pps

-| | [Documentation] | Find throughput by using RFC2544 linear search with
-| | ...             | non drop rate
+| | [Documentation]
+| | ... | Find throughput by using RFC2544 linear search with non drop rate.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${start_rate} - Initial start rate [pps]. Type: float
-| | ... | - ${step_rate} - Step of linear search [pps]. Type: float
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${min_rate} - Lower limit of search [pps]. Type: float
-| | ... | - ${max_rate} - Upper limit of search [pps]. Type: float
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - start_rate - Initial start rate [pps]. Type: float
+| | ... | - step_rate - Step of linear search [pps]. Type: float
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - min_rate - Lower limit of search [pps]. Type: float
+| | ... | - max_rate - Upper limit of search [pps]. Type: float

 | | ...
 | | ... | *Return:*
 | | ... | - No value returned
 | | ...
 | | ... | *Return:*
 | | ... | - No value returned


@@ -351,21 +492,19 @@
 | | ...                              | fail_on_loss=${False}
 
 | Find PDR using linear search and pps
 | | ...                              | fail_on_loss=${False}
 
 | Find PDR using linear search and pps

-| | [Documentation] | Find throughput by using RFC2544 linear search with
-| | ...             | partial drop rate, with PDR threshold 0.5%.
+| | [Documentation]
+| | ... | Find throughput by using RFC2544 linear search with partial drop rate
+| | ... | with PDR threshold and type specified by parameter.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${start_rate} - Initial start rate [pps]. Type: float
-| | ... | - ${step_rate} - Step of linear search [pps]. Type: float
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${min_rate} - Lower limit of search [pps]. Type: float
-| | ... | - ${max_rate} - Upper limit of search [pps]. Type: float
-| | ... | - ${loss_acceptance} - Accepted loss during search. Type: float
-| | ... | - ${loss_acceptance_type} - Percentage or frames. Type: string
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - start_rate - Initial start rate [pps]. Type: float
+| | ... | - step_rate - Step of linear search [pps]. Type: float
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - min_rate - Lower limit of search [pps]. Type: float
+| | ... | - max_rate - Upper limit of search [pps]. Type: float
+| | ... | - loss_acceptance - Accepted loss during search. Type: float
+| | ... | - loss_acceptance_type - Percentage or frames. Type: string

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -395,20 +534,17 @@
 | | ...                                   | fail_on_loss=${False}
 
 | Find NDR using binary search and pps
 | | ...                                   | fail_on_loss=${False}
 
 | Find NDR using binary search and pps

-| | [Documentation] | Find throughput by using RFC2544 binary search with
-| | ...             | non drop rate
+| | [Documentation]
+| | ... | Find throughput by using RFC2544 binary search with non drop rate.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${binary_min} - Lower boundary of search [pps]. Type: float
-| | ... | - ${binary_max} - Upper boundary of search [pps]. Type: float
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${min_rate} - Lower limit of search [pps]. Type: float
-| | ... | - ${max_rate} - Upper limit of search [pps]. Type: float
-| | ... | - ${threshold} - Threshold to stop search [pps]. Type: integer
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - binary_min - Lower boundary of search [pps]. Type: float
+| | ... | - binary_max - Upper boundary of search [pps]. Type: float
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - min_rate - Lower limit of search [pps]. Type: float
+| | ... | - max_rate - Upper limit of search [pps]. Type: float
+| | ... | - threshold - Threshold to stop search [pps]. Type: integer

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -431,22 +567,20 @@
 | | ...                              | fail_on_loss=${False}
 
 | Find PDR using binary search and pps
 | | ...                              | fail_on_loss=${False}
 
 | Find PDR using binary search and pps

-| | [Documentation] | Find throughput by using RFC2544 binary search with
-| | ...             | partial drop rate, with PDR threshold 0.5%.
+| | [Documentation]
+| | ... | Find throughput by using RFC2544 binary search with partial drop rate
+| | ... | with PDR threshold and type specified by parameter.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${binary_min} - Lower boundary of search [pps]. Type: float
-| | ... | - ${binary_max} - Upper boundary of search [pps]. Type: float
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${min_rate} - Lower limit of search [pps]. Type: float
-| | ... | - ${max_rate} - Upper limit of search [pps]. Type: float
-| | ... | - ${threshold} - Threshold to stop search [pps]. Type: integer
-| | ... | - ${loss_acceptance} - Accepted loss during search. Type: float
-| | ... | - ${loss_acceptance_type} - Percentage or frames. Type: string
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - binary_min - Lower boundary of search [pps]. Type: float
+| | ... | - binary_max - Upper boundary of search [pps]. Type: float
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - min_rate - Lower limit of search [pps]. Type: float
+| | ... | - max_rate - Upper limit of search [pps]. Type: float
+| | ... | - threshold - Threshold to stop search [pps]. Type: integer
+| | ... | - loss_acceptance - Accepted loss during search. Type: float
+| | ... | - loss_acceptance_type - Percentage or frames. Type: string

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -477,20 +611,18 @@
 | | ...                                   | fail_on_loss=${False}
 
 | Find NDR using combined search and pps
 | | ...                                   | fail_on_loss=${False}
 
 | Find NDR using combined search and pps

-| | [Documentation] | Find throughput by using RFC2544 combined search
-| | ...             | (linear + binary) with non drop rate
+| | [Documentation]
+| | ... | Find throughput by using RFC2544 combined search (linear+binary) with
+| | ... | non drop rate.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${start_rate} - Initial start rate [pps]. Type: float
-| | ... | - ${step_rate} - Step of linear search [pps]. Type: float
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${min_rate} - Lower limit of search [pps]. Type: float
-| | ... | - ${max_rate} - Upper limit of search [pps]. Type: float
-| | ... | - ${threshold} - Threshold to stop search [pps]. Type: integer
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - start_rate - Initial start rate [pps]. Type: float
+| | ... | - step_rate - Step of linear search [pps]. Type: float
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - min_rate - Lower limit of search [pps]. Type: float
+| | ... | - max_rate - Upper limit of search [pps]. Type: float
+| | ... | - threshold - Threshold to stop search [pps]. Type: integer

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -514,23 +646,20 @@
 | | ...                              | fail_on_loss=${False}
 
 | Find PDR using combined search and pps
 | | ...                              | fail_on_loss=${False}
 
 | Find PDR using combined search and pps

-| | [Documentation] | Find throughput by using RFC2544 combined search
-| | ...             | (linear + binary) with partial drop rate, with PDR
-| | ...             | threshold 0.5%.
+| | [Documentation]
+| | ... | Find throughput by using RFC2544 combined search (linear+binary) with
+| | ... | partial drop rate with PDR threshold and type specified by parameter.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${start_rate} - Initial start rate [pps]. Type: float
-| | ... | - ${step_rate} - Step of linear search [pps]. Type: float
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${min_rate} - Lower limit of search [pps]. Type: float
-| | ... | - ${max_rate} - Upper limit of search [pps]. Type: float
-| | ... | - ${threshold} - Threshold to stop search [pps]. Type: integer
-| | ... | - ${loss_acceptance} - Accepted loss during search. Type: float
-| | ... | - ${loss_acceptance_type} - Percentage or frames. Type: string
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - start_rate - Initial start rate [pps]. Type: float
+| | ... | - step_rate - Step of linear search [pps]. Type: float
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - min_rate - Lower limit of search [pps]. Type: float
+| | ... | - max_rate - Upper limit of search [pps]. Type: float
+| | ... | - threshold - Threshold to stop search [pps]. Type: integer
+| | ... | - loss_acceptance - Accepted loss during search. Type: float
+| | ... | - loss_acceptance_type - Percentage or frames. Type: string

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -562,17 +691,19 @@
 | | ...                                   | fail_on_loss=${False}
 
 | Display result of NDR search
 | | ...                                   | fail_on_loss=${False}
 
 | Display result of NDR search

-| | [Documentation] | Display result of NDR search in packet per seconds (total
-| | ...             | and per stream) and Gbps.
+| | [Documentation]
+| | ... | Display result of NDR search in packet per seconds (total and per
+| | ... | stream) and Gbps total bandwidth with untagged packet.
+| | ... | Througput is calculated as:
+| | ... | Measured rate per stream * Total number of streams
+| | ... | Bandwidth is calculated as:
+| | ... | (Througput * (L2 Frame Size + IPG) * 8) / Max bitrate of NIC

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${rate_per_stream} - Measured rate per stream [pps]. Type: string
-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${nr_streams} - Total number of streams. Type: integer
-| | ... | - ${latency} - Latency stats. Type: dictionary
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - rate_per_stream - Measured rate per stream [pps]. Type: string
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - nr_streams - Total number of streams. Type: integer
+| | ... | - latency - Latency stats. Type: dictionary

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -592,19 +723,21 @@
 | | ...                | append=yes
 
 | Display result of PDR search
 | | ...                | append=yes
 
 | Display result of PDR search

-| | [Documentation] | Display result of PDR search in packet per seconds (total
-| | ...             | and per stream) and Gbps.
+| | [Documentation]
+| | ... | Display result of PDR search in packet per seconds (total and per
+| | ... | stream) and Gbps total bandwidth with untagged packet.
+| | ... | Througput is calculated as:
+| | ... | Measured rate per stream * Total number of streams
+| | ... | Bandwidth is calculated as:
+| | ... | (Througput * (L2 Frame Size + IPG) * 8) / Max bitrate of NIC

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${rate_per_stream} - Measured rate per stream [pps]. Type: string
-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${nr_streams} - Total number of streams. Type: integer
-| | ... | - ${loss_acceptance} - Accepted loss during search. Type: float
-| | ... | - ${loss_acceptance_type} - Percentage or frames. Type: string
-| | ... | - ${latency} - Latency stats. Type: dictionary
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - rate_per_stream - Measured rate per stream [pps]. Type: string
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - nr_streams - Total number of streams. Type: integer
+| | ... | - loss_acceptance - Accepted loss during search. Type: float
+| | ... | - loss_acceptance_type - Percentage or frames. Type: string
+| | ... | - latency - Latency stats. Type: dictionary

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -626,17 +759,15 @@
 | | ...              | append=yes
 
 | Traffic should pass with no loss
 | | ...              | append=yes
 
 | Traffic should pass with no loss

-| | [Documentation] | Send traffic at specified rate. No packet loss is
-| | ...             | accepted at loss evaluation.
+| | [Documentation]
+| | ... | Send traffic at specified rate. No packet loss is accepted at loss
+| | ... | evaluation.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${duration} - Duration of traffic run [s]. Type: integer
-| | ... | - ${rate} - Rate for sending packets. Type: string
-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - duration - Duration of traffic run [s]. Type: integer
+| | ... | - rate - Rate for sending packets. Type: string
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - topology_type - Topology type. Type: string

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -653,19 +784,17 @@
 | | Run Keyword If | ${fail_on_loss} | No traffic loss occurred
 
 | Traffic should pass with partial loss
 | | Run Keyword If | ${fail_on_loss} | No traffic loss occurred
 
 | Traffic should pass with partial loss

-| | [Documentation] | Send traffic at specified rate. Partial packet loss is
-| | ...             | accepted within loss acceptance value.
+| | [Documentation]
+| | ... | Send traffic at specified rate. Partial packet loss is accepted
+| | ... | within loss acceptance value specified as argument.

 | | ...
 | | ... | *Arguments:*
 | | ...
 | | ... | *Arguments:*

-| | ... | - ${duration} - Duration of traffic run [s]. Type: integer
-| | ... | - ${rate} - Rate for sending packets. Type: string
-| | ... | - ${framesize} - L2 Frame Size [B]. Type: integer
-| | ... | - ${topology_type} - Topology type. Type: string
-| | ... | - ${loss_acceptance} - Accepted loss during search. Type: float
-| | ... | - ${loss_acceptance_type} - Percentage or frames. Type: string
-| | ...
-| | ... | *Return:*
-| | ... | - No value returned
+| | ... | - duration - Duration of traffic run [s]. Type: integer
+| | ... | - rate - Rate for sending packets. Type: string
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - topology_type - Topology type. Type: string
+| | ... | - loss_acceptance - Accepted loss during search. Type: float
+| | ... | - loss_acceptance_type - Percentage or frames. Type: string

 | | ...
 | | ... | *Example:*
 | | ...
 | | ...
 | | ... | *Example:*
 | | ...


@@ -684,6 +813,21 @@
 | | ...            | ${loss_acceptance} | ${loss_acceptance_type}
 
 | Clear and show runtime counters with running traffic
 | | ...            | ${loss_acceptance} | ${loss_acceptance_type}
 
 | Clear and show runtime counters with running traffic

+| | [Documentation]
+| | ... | Start traffic at specified rate then clear runtime counters on all
+| | ... | DUTs. Wait for specified amount of time and capture runtime counters
+| | ... | on all DUTs. Finally stop traffic
+| | ...
+| | ... | *Arguments:*
+| | ... | - duration - Duration of traffic run [s]. Type: integer
+| | ... | - rate - Rate for sending packets. Type: string
+| | ... | - framesize - L2 Frame Size [B]. Type: integer
+| | ... | - topology_type - Topology type. Type: string
+| | ...
+| | ... | *Example:*
+| | ...
+| | ... | \| Traffic should pass with partial loss \| 10 \| 4.0mpps \| 64 \
+| | ... | \| 3-node-IPv4 \| 0.5 \| percentage

 | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type}
 | | Send traffic on tg | -1 | ${rate} | ${framesize}
 | | ...                | ${topology_type} | warmup_time=0 | async_call=${True}
 | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type}
 | | Send traffic on tg | -1 | ${rate} | ${framesize}
 | | ...                | ${topology_type} | warmup_time=0 | async_call=${True}

diff --git a/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot b/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot
index 07b8468..09d9398 100644 (file)
--- a/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot
@@ -22,12 +22,12 @@
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs

-| Documentation | *RFC2544: Pkt throughput L2XC with dot1ad test cases*
+| Documentation | *RFC2544: Pkt throughput L2XC with 802.1ad test cases*

 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4.
-| ... | Dot1ad tagging is applied on link between DUT1 and DUT2 with inner 4B
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 xconnect.
+| ... | 802.1ad tagging is applied on link between DUT1 and DUT2 with inner 4B

 | ... | vlan tag (id=100) and outer 4B vlan tag (id=200).
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | vlan tag (id=100) and outer 4B vlan tag (id=200).
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.


@@ -53,7 +53,7 @@
 | ${tag_rewrite}= | pop-2
 
 *** Test Cases ***
 | ${tag_rewrite}= | pop-2
 
 *** Test Cases ***

-| TC01: 64B NDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC01: 64B NDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames


@@ -84,7 +84,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC02: 64B PDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC02: 64B PDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -117,7 +117,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC03: 1514B NDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC03: 1514B NDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1514 Byte frames


@@ -148,7 +148,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC04: 1514B PDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC04: 1514B PDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames


@@ -181,7 +181,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC05: 9000B NDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC05: 9000B NDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames


@@ -211,7 +211,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC06: 9000B PDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC06: 9000B PDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames


@@ -243,7 +243,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC07: 64B NDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq
+| TC07: 64B NDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames


@@ -274,7 +274,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC08: 64B PDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq
+| TC08: 64B PDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -307,7 +307,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC09: 1514B NDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq
+| TC09: 1514B NDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1514 Byte frames


@@ -338,7 +338,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC10: 1514B PDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq
+| TC10: 1514B PDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames


@@ -371,7 +371,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC11: 9000B NDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq
+| TC11: 9000B NDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames


@@ -401,7 +401,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC12: 9000B PDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq
+| TC12: 9000B PDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames


@@ -433,7 +433,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC13: 64B NDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq
+| TC13: 64B NDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames


@@ -464,7 +464,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC14: 64B PDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq
+| TC14: 64B PDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -497,7 +497,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC15: 1514B NDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq
+| TC15: 1514B NDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1514 Byte frames


@@ -528,7 +528,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC16: 1514B PDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq
+| TC16: 1514B PDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1514 Byte frames


@@ -561,7 +561,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC17: 9000B NDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq
+| TC17: 9000B NDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 9000 Byte frames


@@ -591,7 +591,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC18: 9000B PDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq
+| TC18: 9000B PDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 9000 Byte frames

diff --git a/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot b/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot
index 814621f..86716f4 100644 (file)
--- a/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot
@@ -22,11 +22,12 @@
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs

-| Documentation | *RFC2544: Pkt throughput L2XC test cases*
+| Documentation | *RFC2544: Pkt throughput L2XC with 802.1q test cases*

 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4.
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect. 802.1q
+| ... | tagging is applied on link between DUT1 and DUT2.

 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop


@@ -48,7 +49,7 @@
 | ${tag_rewrite}= | pop-1
 
 *** Test Cases ***
 | ${tag_rewrite}= | pop-1
 
 *** Test Cases ***

-| TC01: 64B NDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq
+| TC01: 64B NDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames


@@ -78,7 +79,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC02: 64B PDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq
+| TC02: 64B PDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -110,7 +111,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC03: 1518B NDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq
+| TC03: 1518B NDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames


@@ -140,7 +141,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC04: 1518B PDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq
+| TC04: 1518B PDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames


@@ -172,7 +173,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC05: 9000B NDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq
+| TC05: 9000B NDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames


@@ -201,7 +202,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC06: 9000B PDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq
+| TC06: 9000B PDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames


@@ -232,7 +233,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC07: 64B NDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq
+| TC07: 64B NDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames


@@ -262,7 +263,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC08: 64B PDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq
+| TC08: 64B PDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -294,7 +295,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC09: 1518B NDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq
+| TC09: 1518B NDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames


@@ -324,7 +325,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC10: 1518B PDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq
+| TC10: 1518B PDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames


@@ -356,7 +357,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC11: 9000B NDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq
+| TC11: 9000B NDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames


@@ -385,7 +386,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC12: 9000B PDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq
+| TC12: 9000B PDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames


@@ -416,7 +417,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC13: 64B NDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq
+| TC13: 64B NDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames


@@ -446,7 +447,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC14: 64B PDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq
+| TC14: 64B PDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -478,7 +479,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC15: 1518B NDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq
+| TC15: 1518B NDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1518 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1518 Byte frames


@@ -508,7 +509,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC16: 1518B PDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq
+| TC16: 1518B PDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1518 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1518 Byte frames


@@ -540,7 +541,7 @@
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 
 | | ...                                       | ${glob_loss_acceptance}
 | | ...                                       | ${glob_loss_acceptance_type}
 

-| TC17: 9000B NDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq
+| TC17: 9000B NDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 9000 Byte frames


@@ -569,7 +570,7 @@
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 
 | | ...                                       | ${min_rate} | ${max_rate}
 | | ...                                       | ${threshold}
 

-| TC18: 9000B PDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq
+| TC18: 9000B PDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 9000 Byte frames

diff --git a/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot b/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot
index 2a96443..01f692d 100644 (file)
--- a/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot
@@ -27,7 +27,7 @@
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4.
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect.

 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop

diff --git a/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot b/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot
index 21e1451..0a0755b 100644 (file)
--- a/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot
@@ -34,11 +34,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***

diff --git a/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot
index 45ded08..1861d51 100644 (file)
--- a/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot
@@ -37,11 +37,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***

diff --git a/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot
index 698197f..9e60561 100644 (file)
--- a/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot
@@ -38,11 +38,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***

diff --git a/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot
index 6f6ec3a..ea4a087 100644 (file)
--- a/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot
@@ -28,7 +28,7 @@
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4-ICMPv4 for IPv4 routing.
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for IPv4 routing.

 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv4
 | ... | routing, two static IPv4 /24 routes and IPv4 iAcl security whitelist
 | ... | ingress /24 filter entries applied on links TG - DUT1 and DUT2 - TG.
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv4
 | ... | routing, two static IPv4 /24 routes and IPv4 iAcl security whitelist
 | ... | ingress /24 filter entries applied on links TG - DUT1 and DUT2 - TG.


@@ -37,11 +37,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***

diff --git a/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot
index 9e3c659..5ef42c5 100644 (file)
--- a/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot
@@ -35,11 +35,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv6 header and generated
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv6 header and generated

-| ... | payload.
+| ... | payload. MAC addresses are matching MAC addresses of the TG node
+| ... | interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***

diff --git a/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot
index febc25e..cf163a9 100644 (file)
--- a/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot
@@ -34,11 +34,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv6 header and generated
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv6 header and generated

-| ... | payload.
+| ... | payload. MAC addresses are matching MAC addresses of the TG node
+| ... | interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***

diff --git a/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot
index 028eb1b..5779dc5 100644 (file)
--- a/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot
@@ -22,12 +22,12 @@
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs

-| Documentation | *Reference NDR throughput L2XC with dot1ad verify test cases*
+| Documentation | *Reference NDR throughput L2XC with 802.1ad verify test cases*

 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4.
-| ... | Dot1ad tagging is applied on link between DUT1 and DUT2 with inner 4B
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 xconnect.
+| ... | 802.1ad tagging is applied on link between DUT1 and DUT2 with inner 4B

 | ... | vlan tag (id=100) and outer 4B vlan tag (id=200).
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | vlan tag (id=100) and outer 4B vlan tag (id=200).
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.


@@ -35,11 +35,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Variables ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Variables ***


@@ -50,7 +51,7 @@
 | ${tag_rewrite}= | pop-2
 
 *** Test Cases ***
 | ${tag_rewrite}= | pop-2
 
 *** Test Cases ***

-| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte


@@ -76,7 +77,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC02: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC02: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1514 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1514 Byte


@@ -102,7 +103,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC03: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with dot1ad - 1thread 1core 1rxq
+| TC03: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with 802.1ad - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte


@@ -127,7 +128,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT L2XC with dot1ad - 2thread 2core 1rxq
+| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT L2XC with 802.1ad - 2thread 2core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -153,7 +154,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC05: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with dot1ad - 2thread 2core 1rxq
+| TC05: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with 802.1ad - 2thread 2core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames


@@ -179,7 +180,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC06: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with dot1ad - 2thread 2core 1rxq
+| TC06: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with 802.1ad - 2thread 2core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames


@@ -204,7 +205,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC07: Verify 64B ref-NDR at 2x 8Mpps - DUT L2XC with dot1ad - 4thread 4core 2rxq
+| TC07: Verify 64B ref-NDR at 2x 8Mpps - DUT L2XC with 802.1ad - 4thread 4core 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \
 | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \
 | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames


@@ -230,7 +231,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC08: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with dot1ad - 4thread 4core 2rxq
+| TC08: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with 802.1ad - 4thread 4core 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \
 | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \
 | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames


@@ -256,7 +257,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC09: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with dot1ad - 4thread 4core 2rxq
+| TC09: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with 802.1ad - 4thread 4core 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \
 | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \
 | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames

diff --git a/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot
index 1057a70..b2eb1ad 100644 (file)
--- a/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot
@@ -22,11 +22,11 @@
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs
 | Test Setup | Setup all DUTs before test
 | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs
 | ...           | AND          | Show vpp trace dump on all DUTs

-| Documentation | *Reference NDR throughput L2XC verify test cases*
+| Documentation | *Reference NDR throughput L2XC with 802.1q verify test cases*

 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4. Dot1q
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect. 802.1q

 | ... | tagging is applied on link between DUT1 and DUT2.
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.
 | ... | tagging is applied on link between DUT1 and DUT2.
 | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
 | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.


@@ -34,11 +34,12 @@
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Variables ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Variables ***


@@ -46,7 +47,7 @@
 | ${tag_rewrite}= | pop-1
 
 *** Test Cases ***
 | ${tag_rewrite}= | pop-1
 
 *** Test Cases ***

-| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT dot1q - 1thread 1core 1rxq
+| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte


@@ -71,7 +72,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC02: Verify 1518B ref-NDR at 2x 720kpps - DUT dot1q - 1thread 1core 1rxq
+| TC02: Verify 1518B ref-NDR at 2x 720kpps - DUT 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1518 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1518 Byte


@@ -96,7 +97,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC03: Verify 9000B ref-NDR at 2x 120kpps - DUT dot1q - 1thread 1core 1rxq
+| TC03: Verify 9000B ref-NDR at 2x 120kpps - DUT 802.1q - 1thread 1core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte


@@ -120,7 +121,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT dot1q - 2thread 2core 1rxq
+| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT 802.1q - 2thread 2core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte


@@ -145,7 +146,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC05: Verify 1518B ref-NDR at 2x 720kpps - DUT dot1q - 2thread 2core 1rxq
+| TC05: Verify 1518B ref-NDR at 2x 720kpps - DUT 802.1q - 2thread 2core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1518 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1518 Byte


@@ -170,7 +171,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC06: Verify 9000B ref-NDR at 2x 120kpps - DUT dot1q - 2thread 2core 1rxq
+| TC06: Verify 9000B ref-NDR at 2x 120kpps - DUT 802.1q - 2thread 2core 1rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \
 | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte


@@ -194,7 +195,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC07: Verify 64B ref-NDR at 2x 11Mpps - DUT dot1q - 4thread 4core 2rxq
+| TC07: Verify 64B ref-NDR at 2x 11Mpps - DUT 802.1q - 4thread 4core 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 64 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 64 Byte


@@ -219,7 +220,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC08: Verify 1518B ref-NDR at 2x 720kpps - DUT dot1q - 4thread 4core 2rxq
+| TC08: Verify 1518B ref-NDR at 2x 720kpps - DUT 802.1q - 4thread 4core 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 1518 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 1518 Byte


@@ -244,7 +245,7 @@
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 
 | | Then Traffic should pass with no loss | ${duration} | ${rate}
 | | ...                                   | ${framesize} | 3-node-xconnect
 

-| TC09: Verify 9000B ref-NDR at 2x 120kpps - DUT dot1q - 4thread 4core 2rxq
+| TC09: Verify 9000B ref-NDR at 2x 120kpps - DUT 802.1q - 4thread 4core 2rxq

 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 9000 Byte
 | | [Documentation]
 | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \
 | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 9000 Byte

diff --git a/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot
index 8011e0b..56df7a4 100644 (file)
--- a/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot
@@ -27,19 +27,19 @@
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.
 | ...
 | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
 | ... | with single links between nodes.

-| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for IPv4 routing.
-| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv4
-| ... | routing and two static IPv4 /24 route entries. DUT1 and DUT2 tested with
-| ... | 2p10GE NIC X520 Niantic by Intel.
+| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect.
+| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross-
+| ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel.

 | ... | *[Ver] TG verification:* In short performance tests, TG verifies
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long
 | ... | *[Ver] TG verification:* In short performance tests, TG verifies
 | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet
 | ... | loss tolerance. Ref-NDR value is periodically updated acording to
 | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long

-| ... | performance tests for the same DUT confiiguration. Test packets are
+| ... | performance tests for the same DUT configuration. Test packets are

 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61
 | ... | generated by TG on links to DUTs. TG traffic profile contains two L3
 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with
 | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61

-| ... | and generated payload.
+| ... | and generated payload. MAC addresses are matching MAC addresses of the
+| ... | TG node interfaces.

 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***
 | ... | *[Ref] Applicable standard specifications:* RFC2544.
 
 *** Test Cases ***