X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=resources%2Flibraries%2Frobot%2Fperformance%2Fperformance_utils.robot;h=7f971378e3db0bfaca452f31bc545a5234e1f7d9;hp=9661b522d87617fa966d36d7a1d768a8757123e1;hb=1108807740e6c7d0b154ad8bb391bf0f35c550b9;hpb=780b65d82863effd53ccb0e0150c29d22522c61d diff --git a/resources/libraries/robot/performance/performance_utils.robot b/resources/libraries/robot/performance/performance_utils.robot index 9661b522d8..7f971378e3 100644 --- a/resources/libraries/robot/performance/performance_utils.robot +++ b/resources/libraries/robot/performance/performance_utils.robot @@ -23,18 +23,9 @@ | Library | resources.libraries.python.TrafficGenerator.OptimizedSearch | Library | resources.libraries.python.TrafficGenerator.TGDropRateSearchImpl | Library | resources.libraries.python.Trace -| Resource | resources/libraries/robot/shared/default.robot -| Resource | resources/libraries/robot/shared/interfaces.robot -| Resource | resources/libraries/robot/shared/counters.robot -| Resource | resources/libraries/robot/shared/container.robot -| Resource | resources/libraries/robot/shared/memif.robot -| Resource | resources/libraries/robot/l2/l2_bridge_domain.robot -| Resource | resources/libraries/robot/l2/l2_xconnect.robot -| Resource | resources/libraries/robot/ip/ip4.robot -| Resource | resources/libraries/robot/ip/ip6.robot -| Resource | resources/libraries/robot/l2/tagging.robot -| Documentation | Performance suite keywords - utilities to find and verify NDR -| ... | and PDR. +| ... +| Documentation +| ... | Performance suite keywords - utilities to find and verify NDR and PDR. *** Keywords *** | Find NDR and PDR intervals using optimized search @@ -89,6 +80,8 @@ | | Check NDRPDR interval validity | ${result.pdr_interval} | | ... | ${packet_loss_ratio} | | Check NDRPDR interval validity | ${result.ndr_interval} +| | Perform additional measurements based on NDRPDR result +| | ... | ${result} | ${frame_size} | ${traffic_profile} | Find critical load using PLRsearch | | [Documentation] @@ -114,9 +107,9 @@ | | ... | | ... | *Example:* | | ... -| | ... | \| Find critical load usingPLR search \| \${1e-7} \| \${1800} \| +| | ... | \| Find critical load using PLR search \| \${1e-7} \| \${120} \| | | ... -| | [Arguments] | ${packet_loss_ratio}=${1e-7} | ${timeout}=${1800.0} +| | [Arguments] | ${packet_loss_ratio}=${1e-7} | ${timeout}=${7200.0} | | ... | | ${min_rate} = | Set Variable | ${20000} | | ${average} | ${stdev} = | Perform soak search | ${frame_size} @@ -254,6 +247,31 @@ | | ... | ${message}${\n}${message_zero} | ${message}${\n}${message_other} | | Fail | ${message} +| Perform additional measurements based on NDRPDR result +| | [Documentation] +| | ... | Perform any additional measurements which are not directly needed +| | ... | for determining NDR nor PDR, but which are needed for gathering +| | ... | additional data for debug purposes. +| | ... | Currently, just "Traffic should pass with no loss" is called. +| | ... | TODO: Move latency measurements from optimized search here. +| | ... +| | ... | *Arguments:* +| | ... | - result - Measured result data per stream [pps]. Type: NdrPdrResult +| | ... | - frame_size - L2 Frame Size [B] or IMIX string. Type: int or str +| | ... | - traffic_profile - Topology profile. Type: string +| | ... +| | ... | *Example:* +| | ... | \| Perform additional measurements based on NDRPDR result \ +| | ... | \| \${result} \| ${64} \| 3-node-IPv4 \| +| | ... +| | [Arguments] | ${result} | ${framesize} | ${traffic_profile} +| | ... +| | ${duration}= | Set Variable | 2.0 +| | ${rate_per_stream}= | Evaluate +| | ... | ${result.ndr_interval.measured_low.target_tr} / 2.0 +| | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps +| | ... | ${framesize} | ${traffic_profile} | fail_on_loss=${False} + | Traffic should pass with no loss | | [Documentation] | | ... | Send traffic at specified rate. No packet loss is accepted at loss @@ -336,22 +354,23 @@ | | ... | - unidirection - False if traffic is bidirectional. Type: boolean | | ... | - tx_port - TX port of TG, default 0. Type: integer | | ... | - rx_port - RX port of TG, default 1. Type: integer +| | ... | - pkt_trace - True to enable packet trace. Type: boolean | | ... | | ... | *Example:* | | ... | | ... | \| Send traffic at specified rate \| ${1.0} \| 4.0mpps \| 64 \ -| | ... | \| 3-node-IPv4 \| ${10} \| ${False} \| ${0} | ${1} \| +| | ... | \| 3-node-IPv4 \| ${10} \| ${False} \| ${0} | ${1} \| ${False} | | ... | | [Arguments] | ${trial_duration} | ${rate} | ${frame_size} | | ... | ${traffic_profile} | ${subsamples}=${1} | ${unidirection}=${False} -| | ... | ${tx_port}=${0} | ${rx_port}=${1} +| | ... | ${tx_port}=${0} | ${rx_port}=${1} | ${pkt_trace}=${False} | | ... | | Clear and show runtime counters with running traffic | ${trial_duration} | | ... | ${rate} | ${frame_size} | ${traffic_profile} | | ... | ${unidirection} | ${tx_port} | ${rx_port} | | Run Keyword If | ${dut_stats}==${True} | Clear all counters on all DUTs | | Run Keyword If | ${dut_stats}==${True} and ${pkt_trace}==${True} -| | ... | VPP Enable Traces On All DUTs | ${nodes} +| | ... | VPP Enable Traces On All DUTs | ${nodes} | fail_on_error=${False} | | Run Keyword If | ${dut_stats}==${True} | | ... | VPP enable elog traces on all DUTs | ${nodes} | | ${results} = | Create List