X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=resources%2Flibraries%2Frobot%2Fperformance%2Fperformance_utils.robot;h=60d51f6dfe035b11ed8fb3942f083bd544f76e21;hb=bab0b570345ceb6ffeaec9e47a50e62d7303387e;hp=2fd07824e9f4f89ec0494a2289f606664377c877;hpb=c1f66bb322224d4d19b7f9830b5e2e817caed5c1;p=csit.git diff --git a/resources/libraries/robot/performance/performance_utils.robot b/resources/libraries/robot/performance/performance_utils.robot index 2fd07824e9..60d51f6dfe 100644 --- a/resources/libraries/robot/performance/performance_utils.robot +++ b/resources/libraries/robot/performance/performance_utils.robot @@ -23,28 +23,20 @@ | Library | resources.libraries.python.TrafficGenerator.OptimizedSearch | Library | resources.libraries.python.TrafficGenerator.TGDropRateSearchImpl | Library | resources.libraries.python.Trace -| Resource | resources/libraries/robot/shared/default.robot -| Resource | resources/libraries/robot/shared/interfaces.robot -| Resource | resources/libraries/robot/shared/counters.robot -| Resource | resources/libraries/robot/shared/container.robot -| Resource | resources/libraries/robot/shared/memif.robot -| Resource | resources/libraries/robot/l2/l2_bridge_domain.robot -| Resource | resources/libraries/robot/l2/l2_xconnect.robot -| Resource | resources/libraries/robot/ip/ip4.robot -| Resource | resources/libraries/robot/ip/ip6.robot -| Resource | resources/libraries/robot/l2/tagging.robot -| Documentation | Performance suite keywords - utilities to find and verify NDR -| ... | and PDR. +| Variables | resources/libraries/python/Constants.py +| ... +| Documentation +| ... | Performance suite keywords - utilities to find and verify NDR and PDR. *** Keywords *** | Find NDR and PDR intervals using optimized search | | [Documentation] | | ... | Find boundaries for RFC2544 compatible NDR and PDR values | | ... | using an optimized search algorithm. -| | ... | Display results as formatted test message. +| | ... | Display findings as a formatted test message. | | ... | Fail if a resulting lower bound has too high loss fraction. | | ... | Input rates are understood as uni-directional, -| | ... | reported result contains bi-directional rates. +| | ... | reported result contains aggregate rates. | | ... | Currently, the min_rate value is hardcoded to match test teardowns. | | ... | | ... | TODO: Should the trial duration of the additional @@ -67,31 +59,106 @@ | | ... | - intermediate phases - Number of intermediate phases [1]. Type: int | | ... | - timeout - Fail if search duration is longer [s]. Type: float | | ... | - doublings - How many doublings to do when expanding [1]. Type: int +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | | ... | *Example:* | | ... -| | ... | \| Find NDR and PDR intervals using optimized search \| \${0.005} -| | ... | \| \${0.005} \| \${30.0} \| \${1.0} \| \${2} \| ${600.0} \| ${2} \| +| | ... | \| Find NDR and PDR intervals using optimized search \| \${0.005} \ +| | ... | \| \${0.005} \| \${30.0} \| \${1.0} \| \${2} \| \${600.0} \| \${2} \ +| | ... | \| \${2} \| | | ... | | [Arguments] | ${packet_loss_ratio}=${0.005} | | ... | ${final_relative_width}=${0.005} | ${final_trial_duration}=${30.0} | | ... | ${initial_trial_duration}=${1.0} | | ... | ${number_of_intermediate_phases}=${2} | ${timeout}=${720.0} -| | ... | ${doublings}=${2} +| | ... | ${doublings}=${2} | ${traffic_directions}=${2} | | ... | | ${result} = | Perform optimized ndrpdr search | ${frame_size} -| | ... | ${traffic_profile} | ${20000} | ${max_rate*2} +| | ... | ${traffic_profile} | ${10000} | ${max_rate} | | ... | ${packet_loss_ratio} | ${final_relative_width} | | ... | ${final_trial_duration} | ${initial_trial_duration} | | ... | ${number_of_intermediate_phases} | timeout=${timeout} -| | ... | doublings=${doublings} -| | Display result of NDRPDR search | ${result} | ${frame_size} +| | ... | doublings=${doublings} | traffic_directions=${traffic_directions} +| | Display result of NDRPDR search | ${result} | | Check NDRPDR interval validity | ${result.pdr_interval} | | ... | ${packet_loss_ratio} | | Check NDRPDR interval validity | ${result.ndr_interval} | | Perform additional measurements based on NDRPDR result | | ... | ${result} | ${frame_size} | ${traffic_profile} +| Display Reconfig Test Message +| | [Documentation] +| | ... | Display the number of packets lost (bidirectionally) +| | ... | due to reconfiguration under traffic. +| | ... +| | ... | *Arguments:* +| | ... | - result - Result of bidirectional measurtement. +| | ... | Type: ReceiveRateMeasurement +| | ... +| | ... | *Example:* +| | ... +| | ... | \| Display Reconfig Test Message \| \${result} \| +| | ... +| | [Arguments] | ${result} +| | ... +| | Set Test Message | Packets lost due to reconfig: ${result.loss_count} +| | ${time_lost} = | Evaluate | ${result.loss_count} / ${result.target_tr} +| | Set Test Message | ${\n}Implied time lost: ${time_lost} | append=yes + +| Find Throughput Using MLRsearch +| | [Documentation] +| | ... | Find and return lower bound PDR (zero PLR by default) +| | ... | aggregate throughput using MLRsearch algorithm. +| | ... | Input rates are understood as uni-directional. +| | ... | Currently, the min_rate value is hardcoded to match test teardowns. +| | ... +| | ... | TODO: Should the trial duration of the additional +| | ... | measurements be configurable? +| | ... +| | ... | Some inputs are read from variables to streamline suites. +| | ... +| | ... | *Test (or broader scope) variables read:* +| | ... | - traffic_profile - Name of module defining traffc for measurements. +| | ... | Type: string +| | ... | - frame_size - L2 Frame Size [B] or IMIX string. Type: int or str +| | ... | - max_rate - Calculated unidirectional maximal transmit rate [pps]. +| | ... | Type: float +| | ... +| | ... | *Arguments:* +| | ... | - packet_loss_ratio - Accepted loss during search. Type: float +| | ... | - final_relative_width - Maximal width multiple of upper. Type: float +| | ... | - final_trial_duration - Duration of final trials [s]. Type: float +| | ... | - initial_trial_duration - Duration of initial trials [s]. Type: float +| | ... | - intermediate phases - Number of intermediate phases [1]. Type: int +| | ... | - timeout - Fail if search duration is longer [s]. Type: float +| | ... | - doublings - How many doublings to do when expanding [1]. Type: int +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int +| | ... +| | ... | *Returns:* +| | ... | - Lower bound for bi-directional throughput at given PLR. Type: float +| | ... +| | ... | *Example:* +| | ... +| | ... | \| \${throughpt}= \| Find Throughput Using MLRsearch \| \${0} \ +| | ... | \| \${0.001} \| \${10.0}\| \${1.0} \| \${1} \| \${720.0} \| \${2} \ +| | ... | \| \${2} \| +| | ... +| | [Arguments] | ${packet_loss_ratio}=${0.0} +| | ... | ${final_relative_width}=${0.001} | ${final_trial_duration}=${10.0} +| | ... | ${initial_trial_duration}=${1.0} +| | ... | ${number_of_intermediate_phases}=${1} | ${timeout}=${720.0} +| | ... | ${doublings}=${2} | ${traffic_directions}=${2} +| | ... +| | ${result} = | Perform optimized ndrpdr search | ${frame_size} +| | ... | ${traffic_profile} | ${10000} | ${max_rate} +| | ... | ${packet_loss_ratio} | ${final_relative_width} +| | ... | ${final_trial_duration} | ${initial_trial_duration} +| | ... | ${number_of_intermediate_phases} | timeout=${timeout} +| | ... | doublings=${doublings} | traffic_directions=${traffic_directions} +| | Return From Keyword | ${result.pdr_interval.measured_low.transmit_rate} + | Find critical load using PLRsearch | | [Documentation] | | ... | Find boundaries for troughput (of given target loss ratio) @@ -99,7 +166,7 @@ | | ... | Display results as formatted test message. | | ... | Fail if computed lower bound is below minimal rate. | | ... | Input rates are understood as uni-directional, -| | ... | reported result contains bi-directional rates. +| | ... | reported result contains aggregate rates. | | ... | Currently, the min_rate value is hardcoded to match test teardowns. | | ... | Some inputs are read from variables to streamline suites. | | ... @@ -113,31 +180,36 @@ | | ... | *Arguments:* | | ... | - packet_loss_ratio - Accepted loss during search. Type: float | | ... | - timeout - Stop when search duration is longer [s]. Type: float +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | | ... | *Example:* | | ... -| | ... | \| Find critical load usingPLR search \| \${1e-7} \| \${1800} \| +| | ... | \| Find critical load using PLR search \| \${1e-7} \| \${120} \ +| | ... | \| \${2} \| | | ... | | [Arguments] | ${packet_loss_ratio}=${1e-7} | ${timeout}=${1800.0} +| | ... | ${traffic_directions}=${2} | | ... -| | ${min_rate} = | Set Variable | ${20000} +| | ${min_rate} = | Set Variable | ${10000} | | ${average} | ${stdev} = | Perform soak search | ${frame_size} -| | ... | ${traffic_profile} | ${min_rate} | ${max_rate*2} +| | ... | ${traffic_profile} | ${min_rate} | ${max_rate} | | ... | ${packet_loss_ratio} | timeout=${timeout} +| | ... | traffic_directions=${traffic_directions} | | ${lower} | ${upper} = | Display result of soak search -| | ... | ${average} | ${stdev} | ${frame_size} +| | ... | ${average} | ${stdev} | | Should Not Be True | ${lower} < ${min_rate} -| | ... | Lower bound ${lower} is below bidirectional minimum ${min_rate}. +| | ... | Lower bound ${lower} is below unidirectional minimum ${min_rate}. | Display single bound | | [Documentation] | | ... | Display one bound of NDR+PDR search, | | ... | in packet per seconds (total and per stream) -| | ... | and Gbps total bandwidth with untagged packet. +| | ... | and Gbps total bandwidth (for initial packet size). | | ... | Througput is calculated as: -| | ... | Measured rate per stream * Total number of streams +| | ... | Sum of measured rates over streams | | ... | Bandwidth is calculated as: -| | ... | (Throughput * (L2 Frame Size + IPG) * 8) / Max bitrate of NIC +| | ... | (Throughput * (L2 Frame Size + IPG) * 8) | | ... | The given result should contain latency data as well. | | ... | | ... | *Arguments:* @@ -155,7 +227,7 @@ | | ... | | ${bandwidth_total} = | Evaluate | ${rate_total} * (${frame_size}+20)*8 / 1e9 | | Set Test Message | ${\n}${text}: ${rate_total} pps, | append=yes -| | Set Test Message | ${bandwidth_total} Gbps (untagged) | append=yes +| | Set Test Message | ${bandwidth_total} Gbps (initial) | append=yes | | Return From Keyword If | not """${latency}""" | | Set Test Message | ${\n}LATENCY usec [min/avg/max] per stream: ${latency} | | ... | append=yes @@ -163,23 +235,24 @@ | Display result of NDRPDR search | | [Documentation] | | ... | Display result of NDR+PDR search, both quantities, both bounds, -| | ... | in packet per seconds (total and per stream) -| | ... | and Gbps total bandwidth with untagged packet. +| | ... | aggregate in packet per seconds +| | ... | and Gbps total bandwidth (for initial packet size). | | ... | Througput is calculated as: -| | ... | Measured rate per stream * Total number of streams +| | ... | Sum of measured rate over streams | | ... | Bandwidth is calculated as: -| | ... | (Throughput * (L2 Frame Size + IPG) * 8) / Max bitrate of NIC +| | ... | (Throughput * (L2 Frame Size + IPG) * 8) | | ... | The given result should contain latency data as well. | | ... +| | ... | *Test (or broader scope) variables read:* +| | ... | - frame_size - L2 Frame Size [B] or IMIX string. Type: int or str | | ... | *Arguments:* | | ... | - result - Measured result data per stream [pps]. Type: NdrPdrResult -| | ... | - frame_size - L2 Frame Size [B]. Type: integer | | ... | | ... | *Example:* | | ... -| | ... | \| Display result of NDRPDR search \| \${result} \| \${64} \| +| | ... | \| Display result of NDRPDR search \| \${result} \| | | ... -| | [Arguments] | ${result} | ${frame_size} +| | [Arguments] | ${result} | | ... | | ${frame_size} = | Get Average Frame Size | ${frame_size} | | Display single bound | NDR_LOWER @@ -196,36 +269,37 @@ | Display result of soak search | | [Documentation] | | ... | Display result of soak search, avg+-stdev, as upper/lower bounds, -| | ... | in packet per seconds (total and per stream) -| | ... | and Gbps total bandwidth with untagged packet. +| | ... | in aggregate packets per seconds +| | ... | and Gbps total bandwidth (for initial packet size). | | ... | Througput is calculated as: -| | ... | Measured rate per stream * Total number of streams +| | ... | Sum of measured rates over streams | | ... | Bandwidth is calculated as: -| | ... | (Throughput * (L2 Frame Size + IPG) * 8) / Max bitrate of NIC +| | ... | (Throughput * (L2 Frame Size + IPG) * 8) | | ... | TODO: Do we want to report some latency data, | | ... | even if not measured at the reported bounds?. | | ... +| | ... | *Test (or broader scope) variables read:* +| | ... | - frame_size - L2 Frame Size [B] or IMIX string. Type: int or str | | ... | *Arguments:* | | ... | - avg - Estimated average critical load [pps]. Type: float | | ... | - stdev - Standard deviation of critical load [pps]. Type: float -| | ... | - frame_size - L2 Frame Size [B]. Type: integer | | ... | | ... | *Returns:* | | ... | - Lower and upper bound of critical load [pps]. Type: 2-tuple of float | | ... | | ... | *Example:* | | ... -| | ... | \| Display result of soak search \| \${100000} \| \${100} \| \${64} \| +| | ... | \| Display result of soak search \| \${100000} \| \${100} \| | | ... -| | [Arguments] | ${avg} | ${stdev} | ${frame_size} +| | [Arguments] | ${avg} | ${stdev} | | ... | | ${frame_size} = | Get Average Frame Size | ${frame_size} | | ${avg} = | Convert To Number | ${avg} | | ${stdev} = | Convert To Number | ${stdev} | | ${lower} = | Evaluate | ${avg} - ${stdev} | | ${upper} = | Evaluate | ${avg} + ${stdev} -| | Display single bound | PLRsearch lower bound: | ${lower} | ${frame_size} -| | Display single bound | PLRsearch upper bound: | ${upper} | ${frame_size} +| | Display single bound | PLRsearch lower bound | ${lower} | ${frame_size} +| | Display single bound | PLRsearch upper bound | ${upper} | ${frame_size} | | Return From Keyword | ${lower} | ${upper} | Check NDRPDR interval validity @@ -268,18 +342,22 @@ | | ... | - result - Measured result data per stream [pps]. Type: NdrPdrResult | | ... | - frame_size - L2 Frame Size [B] or IMIX string. Type: int or str | | ... | - traffic_profile - Topology profile. Type: string +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | | ... | *Example:* | | ... | \| Perform additional measurements based on NDRPDR result \ -| | ... | \| \${result} \| ${64} \| 3-node-IPv4 \| +| | ... | \| \${result} \| \${64} \| 3-node-IPv4 \| \${2} \| | | ... | | [Arguments] | ${result} | ${framesize} | ${traffic_profile} +| | ... | ${traffic_directions}=${2} | | ... -| | ${duration}= | Set Variable | 2.0 -| | ${rate_per_stream}= | Evaluate -| | ... | ${result.ndr_interval.measured_low.target_tr} / 2.0 +| | ${duration}= | Set Variable | ${2.0} +| | ${rate_sum}= | Set Variable | ${result.ndr_interval.measured_low.target_tr} +| | ${rate_per_stream}= | Evaluate | ${rate_sum} / float(${traffic_directions}) | | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps | | ... | ${framesize} | ${traffic_profile} | fail_on_loss=${False} +| | ... | traffic_directions=${traffic_directions} | Traffic should pass with no loss | | [Documentation] @@ -294,17 +372,19 @@ | | ... | Type: string | | ... | - fail_on_loss - If True, the keyword fails if loss occurred. | | ... | Type: boolean +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | | ... | *Example:* | | ... -| | ... | \| Traffic should pass with no loss \| 10 \| 4.0mpps \| 64 \ -| | ... | \| 3-node-IPv4 \| +| | ... | \| Traffic should pass with no loss \| \${10} \| 4.0mpps \| \${64} \ +| | ... | \| 3-node-IPv4 \| \${2} \| | | ... | | [Arguments] | ${duration} | ${rate} | ${frame_size} | ${traffic_profile} -| | ... | ${fail_on_loss}=${True} +| | ... | ${fail_on_loss}=${True} | ${traffic_directions}=${2} | | ... | | Send traffic at specified rate | ${duration} | ${rate} | ${frame_size} -| | ... | ${traffic_profile} +| | ... | ${traffic_profile} | traffic_directions=${traffic_directions} | | Run Keyword If | ${fail_on_loss} | No traffic loss occurred | Traffic should pass with maximum rate @@ -324,22 +404,23 @@ | | ... | - subsamples - How many trials in this measurement. Type: int | | ... | - trial_duration - Duration of single trial [s]. Type: float | | ... | - fail_no_traffic - Whether to fail on zero receive count. Type: boolean -| | ... | - unidirection - False if traffic is bidirectional. Type: boolean +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | - tx_port - TX port of TG, default 0. Type: integer | | ... | - rx_port - RX port of TG, default 1. Type: integer | | ... | | ... | *Example:* | | ... -| | ... | \| Traffic should pass with maximum rate \| ${1} \| ${10.0} \| -| | ... | \| ${False} \| ${False} \| ${0} \| ${1} \| +| | ... | \| Traffic should pass with maximum rate \| \${1} \| \${10.0} \ +| | ... | \| \${False} \| \${2} \| \${0} \| \${1} \| | | ... -| | [Arguments] | ${trial_duration}=${perf_trial_duration} -| | ... | ${fail_no_traffic}=${True} | ${subsamples}=${perf_trial_multiplicity} -| | ... | ${unidirection}=${False} | ${tx_port}=${0} | ${rx_port}=${1} +| | [Arguments] | ${trial_duration}=${PERF_TRIAL_DURATION} +| | ... | ${fail_no_traffic}=${True} | ${subsamples}=${PERF_TRIAL_MULTIPLICITY} +| | ... | ${traffic_directions}=${2} | ${tx_port}=${0} | ${rx_port}=${1} | | ... | | ${results} = | Send traffic at specified rate | ${trial_duration} | | ... | ${max_rate}pps | ${frame_size} | ${traffic_profile} | ${subsamples} -| | ... | ${unidirection} | ${tx_port} | ${rx_port} +| | ... | ${traffic_directions} | ${tx_port} | ${rx_port} | | Set Test Message | ${\n}Maximum Receive Rate trial results | | Set Test Message | in packets per second: ${results} | | ... | append=yes @@ -360,25 +441,28 @@ | | ... | - traffic_profile - Name of module defining traffc for measurements. | | ... | Type: string | | ... | - subsamples - How many trials in this measurement. Type: int -| | ... | - unidirection - False if traffic is bidirectional. Type: boolean +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | - tx_port - TX port of TG, default 0. Type: integer | | ... | - rx_port - RX port of TG, default 1. Type: integer +| | ... | - pkt_trace - True to enable packet trace. Type: boolean | | ... | | ... | *Example:* | | ... -| | ... | \| Send traffic at specified rate \| ${1.0} \| 4.0mpps \| 64 \ -| | ... | \| 3-node-IPv4 \| ${10} \| ${False} \| ${0} | ${1} \| +| | ... | \| Send traffic at specified rate \| \${1.0} \| 4.0mpps \| \${64} \ +| | ... | \| 3-node-IPv4 \| \${10} \| \${2} \| \${0} | \${1} \| \${False} | | ... | | [Arguments] | ${trial_duration} | ${rate} | ${frame_size} -| | ... | ${traffic_profile} | ${subsamples}=${1} | ${unidirection}=${False} -| | ... | ${tx_port}=${0} | ${rx_port}=${1} +| | ... | ${traffic_profile} | ${subsamples}=${1} | ${traffic_directions}=${2} +| | ... | ${tx_port}=${0} | ${rx_port}=${1} | ${pkt_trace}=${False} | | ... | | Clear and show runtime counters with running traffic | ${trial_duration} | | ... | ${rate} | ${frame_size} | ${traffic_profile} -| | ... | ${unidirection} | ${tx_port} | ${rx_port} -| | Run Keyword If | ${dut_stats}==${True} | Clear all counters on all DUTs +| | ... | ${traffic_directions} | ${tx_port} | ${rx_port} +| | Run Keyword If | ${dut_stats}==${True} +| | ... | Clear statistics on all DUTs | ${nodes} | | Run Keyword If | ${dut_stats}==${True} and ${pkt_trace}==${True} -| | ... | VPP Enable Traces On All DUTs | ${nodes} +| | ... | VPP Enable Traces On All DUTs | ${nodes} | fail_on_error=${False} | | Run Keyword If | ${dut_stats}==${True} | | ... | VPP enable elog traces on all DUTs | ${nodes} | | ${results} = | Create List @@ -386,8 +470,9 @@ | | | # The following line is skipping some default arguments, | | | # that is why subsequent arguments have to be named. | | | Send traffic on tg | ${trial_duration} | ${rate} | ${frame_size} -| | | ... | ${traffic_profile} | warmup_time=${0} | unidirection=${unidirection} -| | | ... | tx_port=${tx_port} | rx_port=${rx_port} +| | | ... | ${traffic_profile} | warmup_time=${0} +| | | ... | traffic_directions=${traffic_directions} | tx_port=${tx_port} +| | | ... | rx_port=${rx_port} | | | ${rx} = | Get Received | | | ${rr} = | Evaluate | ${rx} / ${trial_duration} | | | Append To List | ${results} | ${rr} @@ -407,29 +492,85 @@ | | ... | | ... | *Arguments:* | | ... | - duration - Duration of traffic run [s]. Type: integer -| | ... | - rate - Rate for sending packets. Type: string +| | ... | - rate - Unidirectional rate for sending packets. Type: string | | ... | - frame_size - L2 Frame Size [B] or IMIX_v4_1. Type: integer/string | | ... | - traffic_profile - Name of module defining traffc for measurements. | | ... | Type: string -| | ... | - unidirection - False if traffic is bidirectional. Type: boolean +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int | | ... | - tx_port - TX port of TG, default 0. Type: integer | | ... | - rx_port - RX port of TG, default 1. Type: integer | | ... | | ... | *Example:* | | ... -| | ... | \| Clear and show runtime counters with running traffic \| 10 \ -| | ... | \| 4.0mpps \| 64 \| 3-node-IPv4 \| ${False} \| ${0} | ${1} \| +| | ... | \| Clear and show runtime counters with running traffic \| \${10} \ +| | ... | \| 4.0mpps \| \${64} \| 3-node-IPv4 \| \${2} \| \${0} \| \${1} \| | | ... | | [Arguments] | ${duration} | ${rate} | ${frame_size} | ${traffic_profile} -| | ... | ${unidirection}=${False} | ${tx_port}=${0} | ${rx_port}=${1} +| | ... | ${traffic_directions}=${2} | ${tx_port}=${0} | ${rx_port}=${1} | | ... | | # Duration of -1 means we will stop traffic manually. | | Send traffic on tg | ${-1} | ${rate} | ${frame_size} | ${traffic_profile} | | ... | warmup_time=${0} | async_call=${True} | latency=${False} -| | ... | unidirection=${unidirection} | tx_port=${tx_port} | rx_port=${rx_port} +| | ... | traffic_directions=${traffic_directions} | tx_port=${tx_port} +| | ... | rx_port=${rx_port} | | Run Keyword If | ${dut_stats}==${True} -| | ... | Clear runtime counters on all DUTs | ${nodes} +| | ... | VPP clear runtime counters on all DUTs | ${nodes} | | Sleep | ${duration} | | Run Keyword If | ${dut_stats}==${True} -| | ... | Show runtime counters on all DUTs | ${nodes} +| | ... | VPP show runtime counters on all DUTs | ${nodes} | | Stop traffic on tg + +| Start Traffic on Background +| | [Documentation] +| | ... | Start traffic at specified rate then return control to Robot. +| | ... +| | ... | This keyword is useful if the test needs to do something +| | ... | while traffic is running. +| | ... | Just a wrapper around L1 keyword. +| | ... | +| | ... | TODO: How to make sure the traffic is stopped on any failure? +| | ... +| | ... | *Test (or broader scope) variables read:* +| | ... | - traffic_profile - Name of module defining traffc for measurements. +| | ... | Type: string +| | ... | - frame_size - L2 Frame Size [B] or IMIX string. Type: int or str +| | ... | *Arguments:* +| | ... | - rate - Unidirectional rate for sending packets. Type: string +| | ... | - traffic_directions - Bi- (2) or uni- (1) directional traffic. +| | ... | Type: int +| | ... | - tx_port - TX port of TG, default 0. Type: integer +| | ... | - rx_port - RX port of TG, default 1. Type: integer +| | ... +| | ... | *Example:* +| | ... +| | ... | \| Start Traffic on Background \| 4.0mpps \| \${2} \| \${0} \ +| | ... | \| \${1} \| +| | ... +| | [Arguments] | ${rate} | ${traffic_directions}=${2} | ${tx_port}=${0} +| | ... | ${rx_port}=${1} +| | ... +| | # Duration of -1 means we will stop traffic manually. +| | Send traffic on tg | ${-1} | ${rate} | ${frame_size} | ${traffic_profile} +| | ... | warmup_time=${0} | async_call=${True} | latency=${False} +| | ... | traffic_directions=${traffic_directions} | tx_port=${tx_port} +| | ... | rx_port=${rx_port} + +| Stop Running Traffic +| | [Documentation] +| | ... | Stop the running traffic, return measurement result. +| | ... | For bidirectional traffic, the reported values are bi-directional. +| | ... +| | ... | Just a wrapper around L1 keyword. +| | ... | +| | ... | TODO: Tolerate if traffic was not started. +| | ... +| | ... | *Returns:* +| | ... | - Measurement result. Type: ReceiveRateMeasurement +| | ... +| | ... | *Example:* +| | ... +| | ... | \${result}= \| Stop Running Traffic \| +| | ... +| | ${result}= | Stop traffic on tg +| | Return From Keyword | ${result}