1 # Copyright (c) 2016 Cisco and/or its affiliates.
2 # Licensed under the Apache License, Version 2.0 (the "License");
3 # you may not use this file except in compliance with the License.
4 # You may obtain a copy of the License at:
6 # http://www.apache.org/licenses/LICENSE-2.0
8 # Unless required by applicable law or agreed to in writing, software
9 # distributed under the License is distributed on an "AS IS" BASIS,
10 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
11 # See the License for the specific language governing permissions and
12 # limitations under the License.
14 | Resource | resources/libraries/robot/performance.robot
15 | Library | resources.libraries.python.topology.Topology
16 | Library | resources.libraries.python.NodePath
17 | Library | resources.libraries.python.InterfaceUtil
18 | Library | resources.libraries.python.IPv4Setup.Dut | ${nodes['DUT1']} | WITH NAME | dut1_v4
19 | Library | resources.libraries.python.IPv4Setup.Dut | ${nodes['DUT2']} | WITH NAME | dut2_v4
20 | Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_LONG
21 | Suite Setup | 3-node Performance Suite Setup | L3
22 | Suite Teardown | 3-node Performance Suite Teardown
23 | Test Setup | Setup all DUTs before test
24 | Test Teardown | Run Keyword | Show statistics on all DUTs
25 | Documentation | *Throughput search suite (based on RFC2544).*
27 | ... | Test suite uses 3-node topology TG - DUT1 - DUT2 - TG, with one link
28 | ... | between nodes. Traffic profile contain 2 L3 streams (1 stream per
29 | ... | direction). Packets contain Ethernet header, IPv4 header,
30 | ... | IP protocol=61 and random payload. Ethernet header MAC addresses are
31 | ... | matching MAC addresses of the TG node.
34 | Find NDR by using RFC2544 linear search and 64B frames through IPv4 forwarding in 3-node topology
36 | | ... | Find throughput with non drop rate for 64B frames by using
37 | | ... | linear search starting at 4.1Mpps, stepping down with step of 0.1Mpps
38 | | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD
39 | | ${framesize}= | Set Variable | 64
40 | | ${start_rate}= | Set Variable | 4400000
41 | | ${step_rate}= | Set Variable | 100000
42 | | ${min_rate}= | Set Variable | 100000
43 | | ${max_rate}= | Set Variable | 14880952
44 | | Given Setup '1' worker threads and rss '1' without HTT on all DUTs
45 | | AND IPv4 forwarding initialized in a 3-node circular topology
46 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
47 | | ... | ${step_rate} | 3-node-IPv4
48 | | ... | ${min_rate} | ${max_rate}
50 | Find NDR by using RFC2544 linear search and 1518B frames through IPv4 forwarding in 3-node topology
52 | | ... | Find throughput with non drop rate for 1518B frames by using
53 | | ... | linear search starting at 812,743pps, stepping down with step of
55 | | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD
56 | | ${framesize}= | Set Variable | 1518
57 | | ${start_rate}= | Set Variable | 812743
58 | | ${step_rate}= | Set Variable | 10000
59 | | ${min_rate}= | Set Variable | 10000
60 | | ${max_rate}= | Set Variable | 812743
61 | | Given Setup '1' worker threads and rss '1' without HTT on all DUTs
62 | | AND IPv4 forwarding initialized in a 3-node circular topology
63 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
64 | | ... | ${step_rate} | 3-node-IPv4
65 | | ... | ${min_rate} | ${max_rate}
67 | Find NDR by using RFC2544 linear search and 9000B frames through IPv4 forwarding in 3-node topology
69 | | ... | Find throughput with non drop rate for 9000B frames by using
70 | | ... | linear search starting at 138,580pps, stepping down with step of
72 | | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD
73 | | ${framesize}= | Set Variable | 9000
74 | | ${start_rate}= | Set Variable | 138580
75 | | ${step_rate}= | Set Variable | 5000
76 | | ${min_rate}= | Set Variable | 5000
77 | | ${max_rate}= | Set Variable | 138580
78 | | Given Setup '1' worker threads and rss '1' without HTT on all DUTs
79 | | AND IPv4 forwarding initialized in a 3-node circular topology
80 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
81 | | ... | ${step_rate} | 3-node-IPv4
82 | | ... | ${min_rate} | ${max_rate}
84 | Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 64B frames through IPv4 forwarding in 3-node topology
86 | | ... | Find throughput on 2 cores with non drop rate for 64B frames by using
87 | | ... | linear search starting at 8.8Mpps, stepping down with step of 0.1Mpps
88 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
89 | | ${framesize}= | Set Variable | 64
90 | | ${start_rate}= | Set Variable | 8800000
91 | | ${step_rate}= | Set Variable | 100000
92 | | ${min_rate}= | Set Variable | 100000
93 | | ${max_rate}= | Set Variable | 14880952
94 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
95 | | AND IPv4 forwarding initialized in a 3-node circular topology
96 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
97 | | ... | ${step_rate} | 3-node-IPv4
98 | | ... | ${min_rate} | ${max_rate}
100 | Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 1518B frames through IPv4 forwarding in 3-node topology
102 | | ... | Find throughput on 2 cores with non drop rate for 1518B frames by
103 | | ... | using linear search starting at 812,743pps, stepping down with step
104 | | ... | of 10.000pps
105 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
106 | | ${framesize}= | Set Variable | 1518
107 | | ${start_rate}= | Set Variable | 812743
108 | | ${step_rate}= | Set Variable | 10000
109 | | ${min_rate}= | Set Variable | 10000
110 | | ${max_rate}= | Set Variable | 812743
111 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
112 | | AND IPv4 forwarding initialized in a 3-node circular topology
113 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
114 | | ... | ${step_rate} | 3-node-IPv4
115 | | ... | ${min_rate} | ${max_rate}
117 | Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 9000B frames through IPv4 forwarding in 3-node topology
119 | | ... | Find throughput on 2 cores with non drop rate for 9000B frames by
120 | | ... | using linear search starting at 138,580pps, stepping down with step
121 | | ... | of 5,000pps
122 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
123 | | ${framesize}= | Set Variable | 9000
124 | | ${start_rate}= | Set Variable | 138580
125 | | ${step_rate}= | Set Variable | 5000
126 | | ${min_rate}= | Set Variable | 5000
127 | | ${max_rate}= | Set Variable | 138580
128 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
129 | | AND IPv4 forwarding initialized in a 3-node circular topology
130 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
131 | | ... | ${step_rate} | 3-node-IPv4
132 | | ... | ${min_rate} | ${max_rate}
134 | Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 64B frames through IPv4 forwarding in 3-node topology
136 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 64B
137 | | ... | frames by using linear search starting at 9.8Mpps, stepping down with
138 | | ... | step of 0.1Mpps
139 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
140 | | ${framesize}= | Set Variable | 64
141 | | ${start_rate}= | Set Variable | 9800000
142 | | ${step_rate}= | Set Variable | 100000
143 | | ${min_rate}= | Set Variable | 100000
144 | | ${max_rate}= | Set Variable | 14880952
145 | | Given Setup '4' worker threads and rss '2' without HTT on all DUTs
146 | | AND IPv4 forwarding initialized in a 3-node circular topology
147 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
148 | | ... | ${step_rate} | 3-node-IPv4
149 | | ... | ${min_rate} | ${max_rate}
151 | Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 1518B frames through IPv4 forwarding in 3-node topology
153 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 1518B
154 | | ... | frames by using linear search starting at 812,743pps, stepping down
155 | | ... | with step of 10.000pps
156 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
157 | | ${framesize}= | Set Variable | 1518
158 | | ${start_rate}= | Set Variable | 812743
159 | | ${step_rate}= | Set Variable | 10000
160 | | ${min_rate}= | Set Variable | 10000
161 | | ${max_rate}= | Set Variable | 812743
162 | | Given Setup '4' worker threads and rss '2' without HTT on all DUTs
163 | | AND IPv4 forwarding initialized in a 3-node circular topology
164 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
165 | | ... | ${step_rate} | 3-node-IPv4
166 | | ... | ${min_rate} | ${max_rate}
168 | Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 9000B frames through IPv4 forwarding in 3-node topology
170 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 9000B
171 | | ... | frames by using linear search starting at 138,580pps, stepping down
172 | | ... | with step of 5,000pps
173 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
174 | | ${framesize}= | Set Variable | 9000
175 | | ${start_rate}= | Set Variable | 138580
176 | | ${step_rate}= | Set Variable | 5000
177 | | ${min_rate}= | Set Variable | 5000
178 | | ${max_rate}= | Set Variable | 138580
179 | | Given Setup '4' worker threads and rss '2' without HTT on all DUTs
180 | | AND IPv4 forwarding initialized in a 3-node circular topology
181 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
182 | | ... | ${step_rate} | 3-node-IPv4
183 | | ... | ${min_rate} | ${max_rate}
185 | Find NDR with 2 cores by using RFC2544 binary search and 64B frames through IPv4 forwarding in 3-node topology
187 | | ... | Find throughput on 2 cores with non drop rate for 64B
188 | | ... | frames by using binary search with threshold 5,000pps
189 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
190 | | ${framesize}= | Set Variable | 64
191 | | ${binary_min}= | Set Variable | 8000000
192 | | ${binary_max}= | Set Variable | 9000000
193 | | ${min_rate}= | Set Variable | 100000
194 | | ${max_rate}= | Set Variable | 14880952
195 | | ${threshold}= | Set Variable | 5000
196 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
197 | | AND IPv4 forwarding initialized in a 3-node circular topology
198 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
199 | | ... | ${binary_max} | 3-node-IPv4
200 | | ... | ${min_rate} | ${max_rate}
201 | | ... | ${threshold}
203 | Find NDR with 4 cores and rss 2 by using RFC2544 binary search and 64B frames through IPv4 forwarding in 3-node topology
205 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 64B
206 | | ... | frames by using binary search with threshold 5,000pps
207 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
208 | | ${framesize}= | Set Variable | 64
209 | | ${binary_min}= | Set Variable | 8000000
210 | | ${binary_max}= | Set Variable | 10000000
211 | | ${min_rate}= | Set Variable | 100000
212 | | ${max_rate}= | Set Variable | 14880952
213 | | ${threshold}= | Set Variable | 5000
214 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
215 | | AND IPv4 forwarding initialized in a 3-node circular topology
216 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
217 | | ... | ${binary_max} | 3-node-IPv4
218 | | ... | ${min_rate} | ${max_rate}
219 | | ... | ${threshold}