1 # Copyright (c) 2016 Cisco and/or its affiliates.
2 # Licensed under the Apache License, Version 2.0 (the "License");
3 # you may not use this file except in compliance with the License.
4 # You may obtain a copy of the License at:
6 # http://www.apache.org/licenses/LICENSE-2.0
8 # Unless required by applicable law or agreed to in writing, software
9 # distributed under the License is distributed on an "AS IS" BASIS,
10 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
11 # See the License for the specific language governing permissions and
12 # limitations under the License.
14 | Resource | resources/libraries/robot/performance.robot
15 | Library | resources.libraries.python.topology.Topology
16 | Library | resources.libraries.python.NodePath
17 | Library | resources.libraries.python.InterfaceUtil
18 | Library | resources.libraries.python.IPv4Setup.Dut | ${nodes['DUT1']} | WITH NAME | dut1_v4
19 | Library | resources.libraries.python.IPv4Setup.Dut | ${nodes['DUT2']} | WITH NAME | dut2_v4
20 | Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_LONG
21 | Suite Setup | 3-node Performance Suite Setup | L3
22 | Suite Teardown | 3-node Performance Suite Teardown
23 | Test Setup | Setup all DUTs before test
24 | Test Teardown | Run Keywords | Show statistics on all DUTs
25 | ... | AND | Reset startup configuration of VPP on all DUTs
26 | Documentation | *Throughput search suite (based on RFC2544).*
28 | ... | Test suite uses 3-node topology TG - DUT1 - DUT2 - TG, with one link
29 | ... | between nodes. Traffic profile contain 2 L3 streams (1 stream per
30 | ... | direction). Packets contain Ethernet header, IPv4 header,
31 | ... | IP protocol=61 and random payload. Ethernet header MAC addresses are
32 | ... | matching MAC addresses of the TG node.
35 | Find NDR by using RFC2544 linear search and 64B frames through IPv4 forwarding in 3-node topology
37 | | ... | Find throughput with non drop rate for 64B frames by using
38 | | ... | linear search starting at 4.1Mpps, stepping down with step of 0.1Mpps
39 | | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD
40 | | ${framesize}= | Set Variable | 64
41 | | ${start_rate}= | Set Variable | 4400000
42 | | ${step_rate}= | Set Variable | 100000
43 | | ${min_rate}= | Set Variable | 100000
44 | | ${max_rate}= | Set Variable | 14880952
45 | | Given Setup '1' worker threads and rss '1' without HTT on all DUTs
46 | | AND IPv4 forwarding initialized in a 3-node circular topology
47 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
48 | | ... | ${step_rate} | 3-node-IPv4
49 | | ... | ${min_rate} | ${max_rate}
51 | Find NDR by using RFC2544 linear search and 1518B frames through IPv4 forwarding in 3-node topology
53 | | ... | Find throughput with non drop rate for 1518B frames by using
54 | | ... | linear search starting at 812,743pps, stepping down with step of
56 | | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD
57 | | ${framesize}= | Set Variable | 1518
58 | | ${start_rate}= | Set Variable | 812743
59 | | ${step_rate}= | Set Variable | 10000
60 | | ${min_rate}= | Set Variable | 10000
61 | | ${max_rate}= | Set Variable | 812743
62 | | Given Setup '1' worker threads and rss '1' without HTT on all DUTs
63 | | AND IPv4 forwarding initialized in a 3-node circular topology
64 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
65 | | ... | ${step_rate} | 3-node-IPv4
66 | | ... | ${min_rate} | ${max_rate}
68 | Find NDR by using RFC2544 linear search and 9000B frames through IPv4 forwarding in 3-node topology
70 | | ... | Find throughput with non drop rate for 9000B frames by using
71 | | ... | linear search starting at 138,580pps, stepping down with step of
73 | | [Tags] | 1_THREAD_NOHTT_RSS_1 | SINGLE_THREAD
74 | | ${framesize}= | Set Variable | 9000
75 | | ${start_rate}= | Set Variable | 138580
76 | | ${step_rate}= | Set Variable | 5000
77 | | ${min_rate}= | Set Variable | 5000
78 | | ${max_rate}= | Set Variable | 138580
79 | | Given Setup '1' worker threads and rss '1' without HTT on all DUTs
80 | | AND IPv4 forwarding initialized in a 3-node circular topology
81 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
82 | | ... | ${step_rate} | 3-node-IPv4
83 | | ... | ${min_rate} | ${max_rate}
85 | Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 64B frames through IPv4 forwarding in 3-node topology
87 | | ... | Find throughput on 2 cores with non drop rate for 64B frames by using
88 | | ... | linear search starting at 8.8Mpps, stepping down with step of 0.1Mpps
89 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
90 | | ${framesize}= | Set Variable | 64
91 | | ${start_rate}= | Set Variable | 8800000
92 | | ${step_rate}= | Set Variable | 100000
93 | | ${min_rate}= | Set Variable | 100000
94 | | ${max_rate}= | Set Variable | 14880952
95 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
96 | | AND IPv4 forwarding initialized in a 3-node circular topology
97 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
98 | | ... | ${step_rate} | 3-node-IPv4
99 | | ... | ${min_rate} | ${max_rate}
101 | Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 1518B frames through IPv4 forwarding in 3-node topology
103 | | ... | Find throughput on 2 cores with non drop rate for 1518B frames by
104 | | ... | using linear search starting at 812,743pps, stepping down with step
105 | | ... | of 10.000pps
106 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
107 | | ${framesize}= | Set Variable | 1518
108 | | ${start_rate}= | Set Variable | 812743
109 | | ${step_rate}= | Set Variable | 10000
110 | | ${min_rate}= | Set Variable | 10000
111 | | ${max_rate}= | Set Variable | 812743
112 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
113 | | AND IPv4 forwarding initialized in a 3-node circular topology
114 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
115 | | ... | ${step_rate} | 3-node-IPv4
116 | | ... | ${min_rate} | ${max_rate}
118 | Find NDR with 2 cores and rss 1 by using RFC2544 linear search and 9000B frames through IPv4 forwarding in 3-node topology
120 | | ... | Find throughput on 2 cores with non drop rate for 9000B frames by
121 | | ... | using linear search starting at 138,580pps, stepping down with step
122 | | ... | of 5,000pps
123 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
124 | | ${framesize}= | Set Variable | 9000
125 | | ${start_rate}= | Set Variable | 138580
126 | | ${step_rate}= | Set Variable | 5000
127 | | ${min_rate}= | Set Variable | 5000
128 | | ${max_rate}= | Set Variable | 138580
129 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
130 | | AND IPv4 forwarding initialized in a 3-node circular topology
131 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
132 | | ... | ${step_rate} | 3-node-IPv4
133 | | ... | ${min_rate} | ${max_rate}
135 | Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 64B frames through IPv4 forwarding in 3-node topology
137 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 64B
138 | | ... | frames by using linear search starting at 9.8Mpps, stepping down with
139 | | ... | step of 0.1Mpps
140 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
141 | | ${framesize}= | Set Variable | 64
142 | | ${start_rate}= | Set Variable | 9800000
143 | | ${step_rate}= | Set Variable | 100000
144 | | ${min_rate}= | Set Variable | 100000
145 | | ${max_rate}= | Set Variable | 14880952
146 | | Given Setup '4' worker threads and rss '2' without HTT on all DUTs
147 | | AND IPv4 forwarding initialized in a 3-node circular topology
148 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
149 | | ... | ${step_rate} | 3-node-IPv4
150 | | ... | ${min_rate} | ${max_rate}
152 | Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 1518B frames through IPv4 forwarding in 3-node topology
154 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 1518B
155 | | ... | frames by using linear search starting at 812,743pps, stepping down
156 | | ... | with step of 10.000pps
157 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
158 | | ${framesize}= | Set Variable | 1518
159 | | ${start_rate}= | Set Variable | 812743
160 | | ${step_rate}= | Set Variable | 10000
161 | | ${min_rate}= | Set Variable | 10000
162 | | ${max_rate}= | Set Variable | 812743
163 | | Given Setup '4' worker threads and rss '2' without HTT on all DUTs
164 | | AND IPv4 forwarding initialized in a 3-node circular topology
165 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
166 | | ... | ${step_rate} | 3-node-IPv4
167 | | ... | ${min_rate} | ${max_rate}
169 | Find NDR with 4 cores and rss 2 by using RFC2544 linear search and 9000B frames through IPv4 forwarding in 3-node topology
171 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 9000B
172 | | ... | frames by using linear search starting at 138,580pps, stepping down
173 | | ... | with step of 5,000pps
174 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
175 | | ${framesize}= | Set Variable | 9000
176 | | ${start_rate}= | Set Variable | 138580
177 | | ${step_rate}= | Set Variable | 5000
178 | | ${min_rate}= | Set Variable | 5000
179 | | ${max_rate}= | Set Variable | 138580
180 | | Given Setup '4' worker threads and rss '2' without HTT on all DUTs
181 | | AND IPv4 forwarding initialized in a 3-node circular topology
182 | | Then Find NDR using linear search and pps | ${framesize} | ${start_rate}
183 | | ... | ${step_rate} | 3-node-IPv4
184 | | ... | ${min_rate} | ${max_rate}
186 | Find NDR with 2 cores by using RFC2544 binary search and 64B frames through IPv4 forwarding in 3-node topology
188 | | ... | Find throughput on 2 cores with non drop rate for 64B
189 | | ... | frames by using binary search with threshold 5,000pps
190 | | [Tags] | 2_THREAD_NOHTT_RSS_1 | MULTI_THREAD
191 | | ${framesize}= | Set Variable | 64
192 | | ${binary_min}= | Set Variable | 8000000
193 | | ${binary_max}= | Set Variable | 9000000
194 | | ${min_rate}= | Set Variable | 100000
195 | | ${max_rate}= | Set Variable | 14880952
196 | | ${threshold}= | Set Variable | 5000
197 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
198 | | AND IPv4 forwarding initialized in a 3-node circular topology
199 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
200 | | ... | ${binary_max} | 3-node-IPv4
201 | | ... | ${min_rate} | ${max_rate}
202 | | ... | ${threshold}
204 | Find NDR with 4 cores and rss 2 by using RFC2544 binary search and 64B frames through IPv4 forwarding in 3-node topology
206 | | ... | Find throughput on 4 cores and rss 2 with non drop rate for 64B
207 | | ... | frames by using binary search with threshold 5,000pps
208 | | [Tags] | 4_THREAD_NOHTT_RSS_2 | MULTI_THREAD
209 | | ${framesize}= | Set Variable | 64
210 | | ${binary_min}= | Set Variable | 8000000
211 | | ${binary_max}= | Set Variable | 10000000
212 | | ${min_rate}= | Set Variable | 100000
213 | | ${max_rate}= | Set Variable | 14880952
214 | | ${threshold}= | Set Variable | 5000
215 | | Given Setup '2' worker threads and rss '1' without HTT on all DUTs
216 | | AND IPv4 forwarding initialized in a 3-node circular topology
217 | | Then Find NDR using binary search and pps | ${framesize} | ${binary_min}
218 | | ... | ${binary_max} | 3-node-IPv4
219 | | ... | ${min_rate} | ${max_rate}
220 | | ... | ${threshold}