73138ec6cfe3c7691c8e6d05257abc4d170088b8
[csit.git] / docs / lab / testbed_specifications.md
1 # FD.io CSIT Testbed Specifications
2
3 1. [FD.io CSIT Testbed Specifications](#fdio-csit-testbed-specifications)
4 1. [Testbeds Overview](#testbeds-overview)
5    1. [Summary List](#summary-list)
6    1. [1-Node-Skylake Xeon Intel (1n-skx)](#1-node-skylake-xeon-intel-1n-skx)
7    1. [1-Node-ThunderX2 Arm Marvell (1n-tx2)](#1-node-thunderx2-arm-marvell-1n-tx2)
8    1. [2-Node-Skylake Xeon Intel (2n-skx)](#2-node-skylake-xeon-intel-2n-skx)
9    1. [2-Node-Denverton Atom Intel (2n-dnv)](#2-node-denverton-atom-intel-2n-dnv)
10    1. [2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)](#2-node-ixiaps1l47-ixia-psone-l47-2n-ps1)
11    1. [3-Node-Haswell Xeon Intel (3n-skx)](#3-node-haswell-xeon-intel-3n-skx)
12    1. [3-Node-Skylake Xeon Intel (3n-skx)](#3-node-skylake-xeon-intel-3n-skx)
13    1. [3-Node-TaiShan Arm Huawei (3n-tsh)](#3-node-taishan-arm-huawei-3n-tsh)
14    1. [3-Node-MACCHIATObin Arm Marvell](#3-node-macchiatobin-arm-marvell)
15    1. [3-Node-Rangeley Atom Testbeds](#3-node-rangeley-atom-testbeds)
16 1. [Server Management](#server-management)
17    1. [Requirements](#requirements)
18    1. [Addressing](#addressing)
19    1. [LOM (IPMI) VLAN IP Addresses](#lom-ipmi-vlan-ip-addresses)
20    1. [Management VLAN IP Addresses](#management-vlan-ip-addresses)
21 1. [Server Type Specification](#server-type-specification)
22    1. [Server and Port Naming](#server-and-port-naming)
23 1. [Testbeds Configuration](#testbeds-configuration)
24    1. [Per Testbed Server Allocation and Naming](#per-testbed-server-allocation-and-naming)
25       1 [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
26       1 [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
27       1 [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
28       1 [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
29       1 [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
30       1 [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
31       1 [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
32       1 [3-Node-Rangeley (3n-rng) VERIFY](#3-node-rangeley-3n-rng-verify)
33       1 [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
34       1 [3-Node-Mcbin (3n-mcb) TODO](#3-node-mcbin-3n-mcb-todo)
35    1. [Per Testbed Wiring](#per-testbed-wiring)
36       1 [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
37       1 [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
38       1 [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
39       1 [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
40       1 [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
41       1 [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
42       1 [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
43       1 [3-Node-Rangeley (3n-rng) TODO](#3-node-rangeley-3n-rng-todo)
44       1 [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
45       1 [3-Node-Mcbin (3n-mcb) WIP](#3-node-mcbin-3n-mcb-wip)
46 1. [Inventory](#inventory)
47    1. [Appliances](#appliances)
48    1. [Arm Servers](#arm-servers)
49    1. [Xeon and Atom Servers](#xeon-and-atom-servers)
50    1. [Network Interface Cards](#network-interface-cards)
51    1. [Pluggables and Cables](#pluggables-and-cables)
52    1. [Other Parts](#other-parts)
53
54 ## FD.io CSIT Testbed Specifications
55
56 This note includes specification of the physical testbed infrastructure
57 hosted by LFN FD.io CSIT project.
58
59 ## Testbeds Overview
60
61 ### Summary List
62
63 ```
64  #. CSIT_tb          Purpose  SUT   TG    #TB  #SUT #TG  #hsw #skx #ps1 #rng #dnv #tx2 #tsh #mcb
65  1. 1-Node-Skylake     func   skx   na    2    2    0    0    2    0    0    0    0    0    0
66  2. 1-Node-Thunderx2   func   tx2   na    1    1    0    0    0    0    0    0    1    0    0
67  3. 2-Node-Skylake     perf   skx   skx   4    4    4    0    8    0    0    0    0    0    0
68  4. 2-Node-Denverton   perf   dnv   skx   1    1    1    0    .5   0    0    1    0    0    0
69  5. 2-Node-IxiaPS1L47  tcp    skx   ps1   1    1    1    0    1    1    0    0    0    0    0
70  6. 3-Node-Haswell     perf   hsw   hsw   3    6    3    9    0    0    0    0    0    0    0
71  7. 3-Node-Skylake     perf   skx   skx   2    4    2    0    6    0    0    0    0    0    0
72  8. 3-Node-Rangeley    perf   rng   skx   1    3    1    0    0    0    2    0    0    0    0
73  9. 3-Node-Taishan     perf   tsh   skx   1    2    1    0    .5   0    0    0    0    2    0
74 10. 3-Node-Mcbin       perf   mcb   skx   1    2    1    0    .5   0    0    0    0    0    2
75 11. 1-Node-VIRL        func   hsw   ---   3    3    0    3    0    0    0    0    0    0    0
76                                  Totals: 17   26   14   12   19    1    2    1    1    2    2
77 ```
78
79 ### 1-Node-Skylake Xeon Intel (1n-skx)
80
81 Each 1-Node-Skylake testbed includes one SUT (Type-B6 server) with NIC
82 ports connected back-to-back.
83 Used for FD.io VPP_Device functional driver tests.
84
85 ### 1-Node-ThunderX2 Arm Marvell (1n-tx2)
86
87 Each 1-Node-ThunderX2 testbed includes one SUT (Type-B9 server) with NIC
88 ports connected back-to-back.
89 Used for FD.io VPP_Device functional driver tests.
90
91 ### 2-Node-Skylake Xeon Intel (2n-skx)
92
93 Each 2-Node-Skylake testbed includes one SUT (Type-B1 server) and one TG
94 (Type-B2 server) connected back-to-back.
95 Used for FD.io performance tests.
96
97 ### 2-Node-Denverton Atom Intel (2n-dnv)
98
99 Each 2-Node-Skylake testbed includes one SUT (Type-B10 server) and one TG
100 (Type-B2 server) connected back-to-back.
101 Used for FD.io performance tests.
102
103 ### 2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)
104
105 Each 2-Node-IxiaPS1L47 testbed includes one SUT (Type-B1 server) and one
106 TG (Ixia PSOne appliance) with 10GE interfaces connected back-to-back.
107 Used for FD.io TCP/IP and HTTP performance tests.
108
109 ### 3-Node-Haswell Xeon Intel (3n-skx)
110
111 ### 3-Node-Skylake Xeon Intel (3n-skx)
112
113 Each 3-Node-Skylake testbed includes two SUTs (Type-B1 servers) and one
114 TG (Type-B2 server) connected in full-mesh triangle.
115 Used for FD.io performance tests.
116
117 ### 3-Node-TaiShan Arm Huawei (3n-tsh)
118
119 Each 3-Node-TaiShan testbed includes two SUTs (Type-B3 server) and one TG
120 (Type-B2 server) connected in full-mesh triangle.
121 Used for FD.io performance tests.
122
123 ### 3-Node-MACCHIATObin Arm Marvell
124
125 Each 3-Node-MACCHIATObin testbed includes two SUTs (Type-B4 server) and
126 one TG (Type-B2 server) connected in full-mesh triangle.
127 Used for FD.io performance tests.
128
129 ### 3-Node-Rangeley Atom Testbeds
130
131 Each 3-Node-Rangeley testbed includes two SUTs (Type-B5 Netgate device)
132 and one TG (Type-2 server) connected in full-mesh triangle.
133 Used for FD.io performance tests.
134
135 ## Server Management
136
137 ### Requirements
138
139 For management purposes, each server must have following two ports
140 connected to the management network:
141
142 ```
143 - 1GE IPMI port
144   - IPMI - Intelligent Platform Management Interface.
145   - Required for access to embedded server management with WebUI, CLI, SNMPv3,
146     IPMIv2.0, for firmware (BIOS) and OS updates.
147 - 1GE/10GE/40GE management port
148   - hostOS management port for general system management.
149 ```
150
151 ### Addressing
152
153 Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management
154 port, which are connected to two different VLANs.
155
156 ```
157 1. LOM (IPMI) VLAN:
158     - Subnet: 10.30.50.0/24
159     - Gateway: 10.30.50.1
160     - Broadcast: 10.30.50.255
161     - DNS1: 199.204.44.24
162     - DNS2: 199.204.47.54
163 2. Management Vlan:
164     - Subnet: 10.30.51.0/24
165     - Gateway: 10.30.51.1
166     - Broadcast: 10.30.51.255
167     - DNS1: 199.204.44.24
168     - DNS2: 199.204.47.54
169 ```
170
171 To access these hosts, VPN connection is required.
172
173 ### LOM (IPMI) VLAN IP Addresses
174
175 Name         | Comment
176 ------------ | -------
177 10.30.50.0   | network
178 10.30.51.1   | Router
179 10.30.50.2   | LF Reserved
180 10.30.50.3   | LF Reserved
181 10.30.50.4   | LF Reserved
182 10.30.50.5   | LF Reserved
183 10.30.50.6   | LF Reserved
184 10.30.50.7   | LF Reserved
185 10.30.50.8   | LF Reserved
186 10.30.50.9   | LF Reserved
187 10.30.50.10  | LF Reserved
188 10.30.50.11  | LF Reserved
189 10.30.50.12  | LF Reserved
190 10.30.50.13  | LF Reserved
191 10.30.50.14  | LF Reserved
192 10.30.50.15  | LF Reserved
193 10.30.50.16  | t1-tg1
194 10.30.50.17  | t1-sut1
195 10.30.50.18  | t1-sut2
196 10.30.50.20  | t2-tg1
197 10.30.50.21  | t2-sut1
198 10.30.50.22  | t2-sut2
199 10.30.50.24  | t3-tg1
200 10.30.50.25  | t3-sut1
201 10.30.50.26  | t3-sut-2
202 10.30.50.28  | t4-sut1
203 10.30.50.29  | t4-sut2
204 10.30.50.30  | t4-sut3
205 10.30.50.36  | s17-t33-sut1
206 10.30.50.37  | s18-t33-sut2
207 10.30.50.41  | s3-t21-sut1
208 10.30.50.42  | s4-t21-tg1
209 10.30.50.43  | s11-t31-sut1
210 10.30.50.44  | s12-t31-sut2
211 10.30.50.45  | s13-t31-tg1
212 10.30.50.46  | s19-t33t34-tg1
213 10.30.50.47  | s1-t11-sut1
214 10.30.50.48  | s2-t12-sut1
215 10.30.50.49  | s5-t22-sut1
216 10.30.50.50  | s6-t22-tg1
217 10.30.50.51  | s7-t23-sut1
218 10.30.50.52  | s8-t23-tg1
219 10.30.50.53  | s9-t24-sut1
220 10.30.50.54  | s10-t24-tg1
221 10.30.50.55  | s14-t32-sut1
222 10.30.50.56  | s15-t32-sut2
223 10.30.50.57  | s16-t32-tg1
224 10.30.50.58  | s25-t25-sut1
225 10.30.50.59  | s26-t25-tg1
226 10.30.50.69  | s27-t13-sut
227 10.30.50.255 | Broadcast
228
229 ### Management VLAN IP Addresses
230
231 Name                      | Comment
232 ------------------------- | -------
233 10.30.51.0                | network
234 10.30.51.1                | Router
235 10.30.51.2                | LF Reserved
236 10.30.51.3                | LF Reserved
237 10.30.51.4                | LF Reserved
238 10.30.51.5                | LF Reserved
239 10.30.51.6                | LF Reserved
240 10.30.51.7                | LF Reserved
241 10.30.51.8                | LF Reserved
242 10.30.51.9                | s22-t35-sut1 (netgate-1)
243 10.30.51.10               | s23-t35-sut2 (netgate-2)
244 10.30.51.11               | s24-t35-sut3 (netgate-3)
245 10.30.51.12               | softiron-1
246 10.30.51.13               | softiron-2
247 10.30.51.14               | softiron-3
248 10.30.51.15               | LF Reserved
249 10.30.51.16               | t1-tg1
250 10.30.51.17               | t1-sut1
251 10.30.51.18               | t1-sut2
252 10.30.51.20               | t2-tg1
253 10.30.51.21               | t2-sut1
254 10.30.51.22               | t2-sut2
255 10.30.51.24               | t3-tg1
256 10.30.51.25               | t3-sut1
257 10.30.51.26               | t3-sut-2
258 10.30.51.28               | t4-sut1
259 10.30.51.29               | t4-sut2
260 10.30.51.29               | s22-t35-sut1 screen -r /dev/ttyUSB0, TO BE VERIFIED
261 10.30.51.30               | t4-sut3
262 10.30.51.30               | s23-t35-sut2 screen -r /dev/ttyUSB1, TO BE VERIFIED
263 10.30.51.30               | s24-t35-sut3 screen -r /dev/ttyUSB2, TO BE VERIFIED
264 10.30.51.36               | s17-t33-sut1
265 10.30.51.37               | s18-t33-sut2
266 10.30.51.41               | s20-t34-sut1
267 10.30.51.42               | s21-t34-sut2
268 10.30.51.44               | s3-t21-sut1
269 10.30.51.45               | s4-t21-tg1
270 10.30.51.46               | s11-t31-sut1
271 10.30.51.47               | s12-t31-sut2
272 10.30.51.48               | s13-t31-tg1
273 10.30.51.49               | s19-t33t34-tg1
274 10.30.51.50               | s1-t11-sut1
275 10.30.51.51               | s2-t12-sut1
276 10.30.51.52               | s5-t22-sut1
277 10.30.51.53               | s6-t22-tg1
278 10.30.51.54               | s7-t23-sut1
279 10.30.51.55               | s8-t23-tg1
280 10.30.51.56               | s9-t24-sut1
281 10.30.51.57               | s10-t24-tg1
282 10.30.51.58               | s14-t32-sut1
283 10.30.51.59               | s15-t32-sut2
284 10.30.51.60               | s16-t32-tg1
285 10.30.51.61               | s25-t25-sut1
286 10.30.51.62               | s26-t25-tg1
287 10.30.51.69               | s27-t13-sut1
288 10.30.51.70-10.30.51.105  | VIRL1 TO BE VERIFIED
289 10.30.51.106-10.30.51.180 | VIRL2
290 10.30.51.181-10.30.51.254 | VIRL3
291 10.30.51.255              | Broadcast
292
293 ## Server Type Specification
294
295 FD.io CSIT lab contains following server types:
296 ```
297 1. Type-A1: Purpose - Haswell Xeon SUT (Systems Under Test) for FD.io performance testing.
298     - Quantity: 6 servers.
299     - Physical connectivity:
300         - CIMC and host management ports.
301         - NIC ports connected in 3-node topologies.
302     - Main HW configuration:
303         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
304         - Processors: 2* E5-2699v3 2.3 GHz.
305         - RAM Memory: 16* 32GB DDR4-2133MHz.
306         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
307     - NICs configuration:
308         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes)
309             - PCIe Slot1: Cisco VIC 1385 2p40GE.
310             - PCIe Slot2: Intel NIC x520 2p10GE.
311             - PCIe Slot3: empty.
312         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes)
313             - PCIe Slot4: Intel NIC xl710 2p40GE.
314             - PCIe Slot5: Intel NIC x710 2p10GE.
315             - PCIe Slot6: Intel QAT 8950 50G (Walnut Hill)
316         - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
317 2. Type-A2: Purpose - Haswell Xeon TG (Traffic Generators) for FD.io performance testing.
318     - Quantity: 3 servers.
319     - Physical connectivity:
320         - CIMC and host management ports.
321         - NIC ports connected in 3-node topologies.
322     - Main HW configuration:
323         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
324         - Processors: 2* E5-2699v3 2.3 GHz.
325         - RAM Memory: 16* 32GB DDR4-2133MHz.
326         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
327     - NICs configuration:
328         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
329             - PCIe Slot1: Intel NIC xl710 2p40GE.
330             - PCIe Slot2: Intel NIC x710 2p10GE.
331             - PCIe Slot3: Intel NIC x710 2p10GE.
332         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
333             - PCIe Slot4: Intel NIC xl710 2p40GE.
334             - PCIe Slot5: Intel NIC x710 2p10GE.
335             - PCIe Slot6: Intel NIC x710 2p10GE.
336         - MLOM slot: empty.
337 3. Type-A3: Purpose - Haswell Xeon VIRL hosts for FD.io functional testing.
338     - Quantity: 3 servers.
339     - Physical connectivity:
340         - CIMC and host management ports.
341         - no NIC ports, standalone setup.
342     - Main HW configuration:
343         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
344         - Processors: 2* E5-2699v3 2.3 GHz.
345         - RAM Memory: 16* 32GB DDR4-2133MHz.
346         - Disks: 2* 480 GB 2.5inch 6G SATA SSD.
347     - NICs configuration:
348         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
349             - no cards.
350         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
351             - no cards.
352         - MLOM slot: empty.
353 4. Type-B1: Purpose - Skylake Xeon SUT for FD.io performance testing.
354     - Quantity: ---
355     - Physical connectivity:
356         - IPMI and host management ports.
357         - NIC ports connected into 2-node and 3-node topologies.
358     - Main HW configuration:
359         - Chassis: SuperMicro SYS-7049GP-TRT.
360         - Motherboard: SuperMicro X11DPG-QT.
361         - Processors: 2* Intel Platinum 8180 2.3 GHz.
362         - RAM Memory: 16* 16GB DDR4-2666MHz.
363         - Disks: 2* 1.6TB 6G SATA SSD.
364     - NICs configuration:
365         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
366             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
367             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
368             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
369         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
370             - PCIe Slot6 86:00.xx: empty.
371             - PCIe Slot8 af:00.xx: empty.
372             - PCIe Slot10 d8:00.xx: empty.
373 2. Type-B2: Purpose - Skylake Xeon TG for FD.io performance testing.
374     - Quantity: ---
375     - Physical connectivity:
376         - IPMI and host management ports.
377         - NIC ports connected into 2-node and 3-node topologies.
378     - Main HW configuration:
379         - Chassis: SuperMicro SYS-7049GP-TRT.
380         - Motherboard: SuperMicro X11DPG-QT.
381         - Processors: 2* Intel Platinum 8180 2.3 GHz.
382         - RAM Memory: 16* 16GB DDR4-2666MHz.
383         - Disks: 2* 1.6TB 6G SATA SSD.
384     - NICs configuration:
385         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
386             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
387             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
388             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
389         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
390             - PCIe Slot6 86:00.xx: empty.
391             - PCIe Slot8 af:00.xx: empty.
392             - PCIe Slot10 d8:00.xx: x710-4p10GE Intel.
393 3. Type-B3: Purpose - TaiShan Arm Huawei SUT for FD.io performance testing.
394     - Quantity: 2
395     - Physical connectivity:
396         - IPMI(?) and host management ports.
397         - NIC ports connected into 3-node topology.
398     - Main HW configuration:
399         - Chassis: Huawei TaiShan 2280.
400         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72
401         - RAM Memory: 8* 16GB DDR4-2400MT/s
402         - Disks: 1* 4TB SATA HDD
403     - NICs configuration:
404         - PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox.
405         - PCIe Slot6 11:00.xx: 82599-2p10GE Intel.
406 4. Type-B4: Purpose - MACCHIATObin Arm Marvell SUT for FD.io performance testing.
407     - Quantity: 3
408     - Physical connectivity:
409         - Host management ports.
410         - NIC ports connected into 2-node and 3-node topologies.
411     - Main HW configuration:
412         - Chassis: MACCHIATObin.
413         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72
414         - RAM Memory: 1* 16GB DDR4
415         - Disks: 1* 128GB(?) SATA SDD
416     - NICs configuration:
417         - pp2-2p10GE Marvell (on-chip Ethernet ports ; marvell plugin in VPP)
418 5. Type-B5: Purpose - Rangeley Atom SUT for FD.io performance testing.
419     - Quantity: TBD based on testbed allocation.
420     - Physical connectivity:
421         - Management: serial Port (usb) for console
422         - NIC ports connected into 2-node.
423     - Main HW configuration:
424         - Chassis: Netgate XG-2758-1u
425         - Processors: 1* Rangeley (Atom) C2758 2.4 GHz
426         - RAM Memory: 16GB ECC
427         - Disks: 150 GB
428     - NICs configuration:
429         - 2x 10Gb Intel 82599ES
430         - 4x 1GB Intel I354
431 6. Type-B6: Purpose - Skylake Xeon SUT for FD.io VPP_Device functional tests.
432     - Quantity: 2.
433     - Physical connectivity:
434         - IPMI and host management ports.
435         - NIC ports connected into 2-node and 3-node topologies.
436     - Main HW configuration:
437         - Chassis: SuperMicro SYS-7049GP-TRT.
438         - Motherboard: SuperMicro X11DPG-QT.
439         - Processors: 2* Intel Platinum 8180 2.3 GHz.
440         - RAM Memory: 16* 16GB DDR4-2666MHz.
441         - Disks: 2* 1.6TB 6G SATA SSD.
442     - NICs configuration:
443         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
444             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
445             - PCIe Slot4 3b:00.xx: x710-4p10GE Intel.
446             - PCIe Slot9 5e:00.xx: empty.
447         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
448             - PCIe Slot6 86:00.xx: empty.
449             - PCIe Slot8 af:00.xx: empty.
450             - PCIe Slot10 d8:00.xx: empty.
451 7. Type-B7: Purpose - Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests.
452     - Quantity: 1.
453     - Physical connectivity:
454         - Host management interface: 10/100/1000-BaseT.
455         - 8-port 10GE SFP+ integrated NIC.
456     - Main HW configuration:
457         - Chassis: PS10GE4NG.
458         - Motherboard: SuperMicro X11DPG-QT.
459         - Processors: Quad-Core, Intel Processor.
460         - HW accelerators: FPGA offload.
461         - RAM Memory: 64GB.
462         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
463         - Physical Interfaces: 4 * 10GE SFP+.
464         - Operating System: Native IxOS.
465     - Interface configuration:
466         - Port-1: 10GE SFP+.
467         - Port-2: 10GE SFP+.
468         - Port-3: 10GE SFP+.
469         - Port-4: 10GE SFP+.
470 8. Type-B8: Purpose - Skylake Xeon SUT for TCP/IP host stack tests.
471     - Quantity: 1.
472     - Physical connectivity:
473         - IPMI and host management ports.
474         - NIC ports.
475     - Main HW configuration:
476         - Chassis: SuperMicro SYS-7049GP-TRT.
477         - Motherboard: SuperMicro X11DPG-QT.
478         - Processors: 2* Intel Platinum 8180 2.3 GHz.
479         - RAM Memory: 16* 16GB DDR4-2666MHz.
480         - Disks: 2* 1.6TB 6G SATA SSD.
481     - NICs configuration:
482         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
483             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
484             - PCIe Slot4 3b:00.xx: empty.
485             - PCIe Slot9 5e:00.xx: empty.
486         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
487             - PCIe Slot6 86:00.xx: empty.
488             - PCIe Slot8 af:00.xx: empty.
489             - PCIe Slot10 d8:00.xx: empty.
490 9. Type-B9: Purpose - ThunderX2 Arm Marvell SUT for FD.io VPP_Device functional tests.
491     - Quantity: 1
492     - Physical connectivity:
493         - IPMI and host management ports.
494         - NIC ports connected into 1-node topologies.
495     - Main HW configuration:
496         - Chassis: Gigabyte R181-T90 1U
497         - Motheboard: MT91-FS1
498         - Processors: 1* ThunderX2 ARMv8 CN9975 2.0 GHz
499         - RAM Memory: 4* 32GB RDIMM
500         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
501     - NICs configuration:
502         - Numa0:
503             - PCIe Slot1 05:00.xx: XL710-QDA2.
504             - PCIe Slot3 08:00.xx: XL710-QDA2.
505         - Numa1:
506             - PCIe Slot6 85:00.xx: XL710-QDA2.
507 10. Type-B10: Purpose - Denverton Atom SUT for FD.io performance testing.
508     - Quantity: 4
509     - Physical connectivity:
510         - IPMI and host management ports.
511         - NIC ports.
512     - Main HW configuration:
513         - Chassis: SuperMicro SYS-E300-9A
514         - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
515         - RAM Memory: 32GB ECC
516         - Disks: 480 GB
517     - NICs configuration:
518         - 2x 10Gb Intel x553 fiber ports
519         - 2x 10Gb Intel x553 copper ports
520         - 4x 1GB Intel I350 ports
521 ```
522
523 ### Server and Port Naming
524
525 Following naming convention is used within this page to specify physical
526 connectivity and wiring across defined CSIT testbeds:
527
528 ```
529 - testbedname: testbedN.
530 - hostname:
531     - traffic-generator: tN-tgW.
532     - system-under-testX: tN-sutX.
533 - portnames:
534     - tN-tgW-cY/pZ.
535     - tN-sutX-cY/pZ.
536 - where:
537     - N - testbed number.
538     - tgW - server acts as traffic-generator with W index.
539     - sutX - server acts as system-under-test with X index.
540     - Y - PCIe slot number denoting a NIC card number within the host.
541     - Z - port number on the NIC card.
542 ```
543
544 ## Testbeds Configuration
545
546 ### Per Testbed Server Allocation and Naming
547
548 #### 1-Node-Skylake (1n-skx) PROD
549
550 ```
551 - ServerB1 [Type-B6]:
552     - testbedname: testbed11.
553     - hostname: s1-t11-sut1.
554     - IPMI IP: 10.30.50.47
555     - Host IP: 10.30.51.50
556     - portnames:
557         - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
558         - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
559         - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
560         - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
561         - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
562         - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
563         - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
564         - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
565 - ServerB2 [Type-B6]:
566     - testbedname: testbed12.
567     - hostname: s2-t12-sut1.
568     - IPMI IP: 10.30.50.48
569     - Host IP: 10.30.51.51
570     - portnames:
571         - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
572         - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
573         - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
574         - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
575         - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
576         - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
577         - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
578         - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
579 ```
580
581 #### 1-Node-Thunderx2 (1n-tx2) WIP
582
583 ```
584 - ServerB17 [Type-B9]:
585     - testbedname: testbed13.
586     - hostname: s27-t13-sut1.
587     - IPMI IP: 10.30.50.69
588     - Host IP: 10.30.51.69
589     - portnames:
590         - s27-t13-sut1-c1/p1 - 40GE-port1 XL710-QDA2-2p40GE.
591         - s27-t13-sut1-c1/p2 - 40GE-port2 XL710-QDA2-2p40GE.
592         - s27-t13-sut1-c3/p1 - 40GE-port1 XL710-QDA2-2p40GE.
593         - s27-t13-sut1-c3/p2 - 40GE-port2 XL710-QDA2-2p40GE.
594         - s27-t13-sut1-c6/p1 - 40GE-port1 XL710-QDA2-2p40GE.
595         - s27-t13-sut1-c6/p2 - 40GE-port2 XL710-QDA2-2p40GE.
596 ```
597
598 #### 2-Node-Skylake (2n-skx) PROD
599
600 ```
601 - ServerB3 [Type-B1]:
602     - testbedname: testbed21.
603     - hostname: s3-t21-sut1.
604     - IPMI IP: 10.30.50.41
605     - Host IP: 10.30.51.44
606     - portnames:
607         - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
608         - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
609         - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
610         - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
611         - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
612         - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
613         - s3-t21-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
614         - s3-t21-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
615 - ServerB4 [Type-B2]:
616     - testbedname: testbed21.
617     - hostname: s4-t21-tg1.
618     - IPMI IP: 10.30.50.42
619     - Host IP: 10.30.51.45
620     - portnames:
621         - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
622         - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
623         - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
624         - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
625         - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
626         - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
627         - s4-t21-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
628         - s4-t21-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
629 - ServerB5 [Type-B1]:
630     - testbedname: testbed22.
631     - hostname: s5-t22-sut1.
632     - IPMI IP: 10.30.50.49
633     - Host IP: 10.30.51.52
634     - portnames:
635         - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
636         - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
637         - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
638         - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
639         - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
640         - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
641         - s5-t22-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
642         - s5-t22-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
643 - ServerB6 [Type-B2]:
644     - testbedname: testbed22.
645     - hostname: s6-t22-tg1.
646     - IPMI IP: 10.30.50.50
647     - Host IP: 10.30.51.53
648     - portnames:
649         - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
650         - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
651         - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
652         - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
653         - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
654         - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
655         - s6-t22-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
656         - s6-t22-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
657 - ServerB7 [Type-B1]:
658     - testbedname: testbed23.
659     - hostname: s7-t23-sut1.
660     - IPMI IP: 10.30.50.51
661     - Host IP: 10.30.51.54
662     - portnames:
663         - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
664         - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
665         - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
666         - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
667         - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
668         - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
669         - s7-t23-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
670         - s7-t23-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
671 - ServerB8 [Type-B2]:
672     - testbedname: testbed23.
673     - hostname: s8-t23-tg1.
674     - IPMI IP: 10.30.50.52
675     - Host IP: 10.30.51.55
676     - portnames:
677         - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
678         - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
679         - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
680         - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
681         - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
682         - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
683         - s8-t23-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
684         - s8-t23-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
685 - ServerB9 [Type-B1]:
686     - testbedname: testbed24.
687     - hostname: s9-t24-sut1.
688     - IPMI IP: 10.30.50.53
689     - Host IP: 10.30.51.56
690     - portnames:
691         - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
692         - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
693         - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
694         - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
695         - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
696         - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
697         - s9-t24-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
698         - s9-t24-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
699 - ServerB10 [Type-B2]:
700     - testbedname: testbed24.
701     - hostname: s10-t24-tg1.
702     - IPMI IP: 10.30.50.54
703     - Host IP: 10.30.51.57
704     - portnames:
705         - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
706         - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
707         - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
708         - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
709         - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
710         - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
711         - s10-t24-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
712         - s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
713 ```
714
715 #### 2-Node-Denverton (2n-dnv) TODO
716
717 ```
718 To be completed.
719 ```
720
721 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
722
723 ```
724 - ServerB25 [Type-B8]:
725     - testbedname: testbed25.
726     - hostname: s25-t25-sut1.
727     - IPMI IP: 10.30.50.58
728     - Host IP: 10.30.51.61
729     - portnames:
730         - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
731         - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
732         - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
733         - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
734 - ServerB26 [Type-B7]:
735     - testbedname: testbed25.
736     - hostname: s26-t25-tg1.
737     - IPMI IP: 10.30.50.59
738     - Host IP: 10.30.51.62
739     - portnames:
740         - s26-t25-tg1-p1 - 10GE-port1.
741         - s26-t25-tg1-p2 - 10GE-port2.
742         - s26-t25-tg1-p3 - 10GE-port3.
743         - s26-t25-tg1-p4 - 10GE-port4.
744 ```
745
746 #### 3-Node-Haswell (3n-hsw) PROD
747
748 ```
749  1. Server1 of Type-1:
750     - testbedname: testbed1.
751     - hostname: t1-sut1.
752     - CIMC IP: 10.30.50.17
753     - Host IP: 10.30.51.17
754     - portnames:
755         - t1-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
756         - t1-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
757         - t1-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
758         - t1-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
759         - t1-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
760         - t1-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
761         - t1-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
762         - t1-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
763         - t1-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
764         - t1-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
765  2. Server2 of Type-1:
766     - testbedname: testbed1.
767     - hostname: t1-sut2.
768     - CIMC IP: 10.30.50.18
769     - Host IP: 10.30.51.18
770     - portnames:
771         - t1-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
772         - t1-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
773         - t1-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
774         - t1-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
775         - t1-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
776         - t1-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
777         - t1-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
778         - t1-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
779         - t1-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
780         - t1-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
781  3. Server3 of Type-2:
782     - testbedname: testbed1.
783     - hostname: t1-tg1.
784     - CIMC IP: 10.30.50.16
785     - Host IP: 10.30.51.16
786     - portnames:
787         - t1-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
788         - t1-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
789         - t1-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
790         - t1-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
791         - t1-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
792         - t1-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
793         - t1-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
794         - t1-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
795         - t1-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
796         - t1-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
797         - t1-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
798         - t1-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
799  4. Server4 of Type-1:
800     - testbedname: testbed2.
801     - hostname: t2-sut1.
802     - CIMC IP: 10.30.50.21
803     - Host IP: 10.30.51.21
804     - portnames:
805         - t2-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
806         - t2-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
807         - t2-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
808         - t2-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
809         - t2-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
810         - t2-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
811         - t2-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
812         - t2-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
813         - t2-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
814         - t2-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
815  5. Server5 of Type-1:
816     - testbedname: testbed2.
817     - hostname: t2-sut2.
818     - CIMC IP: 10.30.50.22
819     - Host IP: 10.30.51.22
820     - portnames:
821         - t2-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
822         - t2-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
823         - t2-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
824         - t2-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
825         - t2-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
826         - t2-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
827         - t2-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
828         - t2-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
829         - t2-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
830         - t2-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
831  6. Server6 of Type-2:
832     - testbedname: testbed2.
833     - hostname: t2-tg1.
834     - CIMC IP: 10.30.50.20
835     - Host IP: 10.30.51.20
836     - portnames:
837         - t2-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
838         - t2-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
839         - t2-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
840         - t2-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
841         - t2-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
842         - t2-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
843         - t2-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
844         - t2-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
845         - t2-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
846         - t2-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
847         - t2-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
848         - t2-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
849  7. Server7 of Type-1:
850     - testbedname: testbed3.
851     - hostname: t3-sut1.
852     - CIMC IP: 10.30.50.25
853     - Host IP: 10.30.51.25
854     - portnames:
855         - t3-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
856         - t3-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
857         - t3-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
858         - t3-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
859         - t3-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
860         - t3-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
861         - t3-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
862         - t3-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
863         - t3-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
864         - t3-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
865  8. Server8 of Type-1:
866     - testbedname: testbed3.
867     - hostname: t3-sut2.
868     - CIMC IP: 10.30.50.26
869     - Host IP: 10.30.51.26
870     - portnames:
871         - t3-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
872         - t3-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
873         - t3-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
874         - t3-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
875         - t3-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
876         - t3-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
877         - t3-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
878         - t3-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
879         - t3-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
880         - t3-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
881  9. Server9 of Type-2:
882     - testbedname: testbed3.
883     - hostname: t3-tg1.
884     - CIMC IP: 10.30.50.24
885     - Host IP: 10.30.51.24
886     - portnames:
887         - t3-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
888         - t3-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
889         - t3-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
890         - t3-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
891         - t3-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
892         - t3-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
893         - t3-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
894         - t3-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
895         - t3-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
896         - t3-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
897         - t3-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
898         - t3-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
899 ```
900
901 #### 3-Node-Skylake (3n-skx) PROD
902
903 ```
904 - ServerB11 [Type-B1]:
905     - testbedname: testbed31.
906     - hostname: s11-t31-sut1.
907     - IPMI IP: 10.30.50.43
908     - Host IP: 10.30.51.46
909     - portnames:
910         - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
911         - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
912         - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
913         - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
914         - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
915         - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
916         - s11-t31-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
917         - s11-t31-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
918 - ServerB12 [Type-B1]:
919     - testbedname: testbed31.
920     - hostname: s12-t31-sut2.
921     - IPMI IP: 10.30.50.44
922     - Host IP: 10.30.51.47
923     - portnames:
924         - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
925         - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
926         - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
927         - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
928         - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
929         - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
930         - s12-t31-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
931         - s12-t31-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
932 - ServerB13 [Type-B2]:
933     - testbedname: testbed31.
934     - hostname: s13-t31-tg1.
935     - IPMI IP: 10.30.50.45
936     - Host IP: 10.30.51.48
937     - portnames:
938         - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
939         - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
940         - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
941         - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
942         - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
943         - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
944         - s13-t31-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
945         - s13-t31-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
946 - ServerB14 [Type-B1]:
947     - testbedname: testbed32.
948     - hostname: s14-t32-sut1.
949     - IPMI IP: 10.30.50.55
950     - Host IP: 10.30.51.58
951     - portnames:
952         - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
953         - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
954         - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
955         - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
956         - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
957         - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
958         - s14-t32-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
959         - s14-t32-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
960 - ServerB15 [Type-B1]:
961     - testbedname: testbed32.
962     - hostname: s15-t32-sut2.
963     - IPMI IP: 10.30.50.56
964     - Host IP: 10.30.51.59
965     - portnames:
966         - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
967         - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
968         - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
969         - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
970         - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
971         - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
972         - s15-t32-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
973         - s15-t32-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
974 - ServerB16 [Type-B2]:
975     - testbedname: testbed32.
976     - hostname: s16-t32-tg1.
977     - IPMI IP: 10.30.50.57
978     - Host IP: 10.30.51.60
979     - portnames:
980         - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
981         - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
982         - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
983         - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
984         - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
985         - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
986         - s16-t32-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
987         - s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
988 ```
989
990 Note: ServerB19 (TG) is shared between testbed33 & testbed34
991
992 #### 3-Node-Rangeley (3n-rng) VERIFY
993
994 Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
995
996 ```
997 - ServerB22 [Type-B5]:
998     - testbedname: testbed35.
999     - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1).
1000     - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0
1001     - Host IP: 10.30.51.9
1002     - portnames:
1003         - s22-t35-sut1-p1 - 10GE-port1 ix0 82599.
1004         - s22-t35-sut1-p2 - 10GE-port2 ix1 82599.
1005     - 1GB ports (tbd)
1006 - ServerB23 [Type-B5]:
1007     - testbedname: testbed35.
1008     - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2).
1009     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1
1010     - Host IP: 10.30.51.10
1011     - portnames:
1012         - s23-t35-sut1-p1 - 10GE-port1 ix0 82599.
1013         - s23-t35-sut1-p2 - 10GE-port2 ix1 82599.
1014     - 1GB ports (tbd)
1015 - ServerB24 [Type-B5]:
1016     - testbedname: testbed35.
1017     - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3).
1018     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2
1019     - Host IP: 10.30.51.11
1020     - portnames:
1021         - s24-t35-sut1-p1 - 10GE-port1 ix0 82599.
1022         - s24-t35-sut1-p2 - 10GE-port2 ix1 82599.
1023     - 1GB ports (tbd)
1024 ```
1025
1026 #### 3-Node-Taishan (3n-tsh) WIP
1027
1028 ```
1029 - ServerB17 [Type-B3]:
1030     - testbedname: testbed33.
1031     - hostname: s17-t33-sut1.
1032     - IPMI IP: 10.30.50.36
1033     - Host IP: 10.30.51.36
1034     - portnames:
1035         - s17-t33-sut1-c6/p1 - 10GE-port1 82599-2p10GE.
1036         - s17-t33-sut1-c6/p2 - 10GE-port2 82599-2p10GE.
1037         - s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE.
1038         - s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE.
1039 - ServerB18 [Type-B3]:
1040     - testbedname: testbed33.
1041     - hostname: s18-t33-sut2.
1042     - IPMI IP: 10.30.50.37
1043     - Host IP: 10.30.51.37
1044     - portnames:
1045         - s18-t33-sut2-c6/p1 - 10GE-port1 82599-2p10GE.
1046         - s18-t33-sut2-c6/p2 - 10GE-port2 82599-2p10GE.
1047         - s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE.
1048         - s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE.
1049 - ServerB19 [Type-B2]:
1050     - testbednames: testbed33 and testbed34.
1051     - hostname: s19-t33t34-tg1.
1052     - IPMI IP: 10.30.50.46
1053     - Host IP: 10.30.51.49
1054     - portnames:
1055         - s19-t33t34-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
1056         - s19-t33t34-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
1057         - s19-t33t34-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
1058         - s19-t33t34-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
1059         - s19-t33t34-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
1060         - s19-t33t34-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
1061         - s19-t33t34-tg1-c10/p1 - 10GE-port1 x710-4p10GE.
1062         - s19-t33t34-tg1-c10/p2 - 10GE-port2 x710-4p10GE.
1063         - s19-t33t34-tg1-c10/p3 - 10GE-port3 x710-4p10GE.
1064         - s19-t33t34-tg1-c10/p4 - 10GE-port4 x710-4p10GE.
1065 - ServerB20 [Type-B4]:
1066     - testbedname: testbed34.
1067     - hostname: s20-t34-sut1.
1068     - IPMI IP: N/A
1069     - Host IP: 10.30.51.41
1070     - portnames:
1071         - s20-t34-sut1-ca/p1 - 10GE-port1 Marvell.
1072         - s20-t34-sut1-ca/p2 - 10GE-port2 Marvell.
1073 - ServerB21 [Type-B4]:
1074     - testbedname: testbed34.
1075     - hostname: s21-t34-sut2.
1076     - IPMI IP: N/A
1077     - Host IP: 10.30.51.42
1078     - portnames:
1079         - s21-t34-sut2-ca/p1 - 10GE-port1 Marvell.
1080         - s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
1081 ```
1082
1083 #### 3-Node-Mcbin (3n-mcb) TODO
1084
1085 ```
1086 To be completed.
1087 ```
1088
1089 ### Per Testbed Wiring
1090
1091 #### 1-Node-Skylake (1n-skx) PROD
1092
1093 ```
1094 - testbed11:
1095     - ring1 10GE-ports x710-4p10GE:
1096         - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1.
1097     - ring2 10GE-ports x710-4p10GE:
1098         - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2.
1099     - ring3 10GE-ports x710-4p10GE:
1100         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1101     - ring4 10GE-ports x710-4p10GE:
1102         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1103 - testbed12:
1104     - ring1 10GE-ports x710-4p10GE:
1105         - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1.
1106     - ring2 10GE-ports x710-4p10GE:
1107         - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2.
1108     - ring3 10GE-ports x710-4p10GE:
1109         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1110     - ring4 10GE-ports x710-4p10GE:
1111         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1112 ```
1113
1114 #### 1-Node-Thunderx2 (1n-tx2) WIP
1115
1116 ```
1117 - testbed13:
1118     - ring1 40GE-ports XL710-QDA2-2p40GE on SUTs:
1119         - s27-t13-sut1-c1/p2 - s27-t13-sut1-c3/p1.
1120     - ring2 40GE-ports XL710-QDA2-2p40GE on SUTs:
1121         - s27-t13-sut1-c3/p2 - s27-t13-sut1-c6/p1.
1122     - ring3 40GE-ports XL710-QDA2-2p40GE on SUTs:
1123         - s27-t13-sut1-c6/p2 - s27-t13-sut1-c1/p1.
1124 ```
1125
1126 #### 2-Node-Skylake (2n-skx) PROD
1127
1128 ```
1129 - testbed21:
1130     - ring1 10GE-ports x710-4p10GE on SUT:
1131         - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1.
1132         - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2.
1133     - ring2 10GE-ports x710-4p10GE on SUT:
1134         - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3.
1135         - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4.
1136     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1137         - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1.
1138         - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2.
1139     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1140         - s4-t21-tg1-c9/p1 to s3-t21-sut1-c9/p1.
1141         - s3-t21-sut1-c9/p2 to s4-t21-tg1-c9/p2.
1142     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1143         - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2.
1144         - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4.
1145 - testbed22:
1146     - ring1 10GE-ports x710-4p10GE on SUT:
1147         - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1.
1148         - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2.
1149     - ring2 10GE-ports x710-4p10GE on SUT:
1150         - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3.
1151         - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4.
1152     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1153         - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1.
1154         - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2.
1155     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1156         - t22-tg1-c9/p1 to s5-t22-sut1-c9/p1.
1157         - s5-t22-sut1-c9/p2 to s6-t22-tg1-c9/p2.
1158     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1159         - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2.
1160         - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4.
1161 - testbed23:
1162     - ring1 10GE-ports x710-4p10GE on SUT:
1163         - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1.
1164         - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2.
1165     - ring2 10GE-ports x710-4p10GE on SUT:
1166         - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3.
1167         - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4.
1168     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1169         - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1.
1170         - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2.
1171     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1172         - s8-t23-tg1-c9/p1 to s7-t23-sut1-c9/p1.
1173         - s7-t23-sut1-c9/p2 to s8-t23-tg1-c9/p2.
1174     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1175         - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2.
1176         - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4.
1177 - testbed24:
1178     - ring1 10GE-ports x710-4p10GE on SUT:
1179         - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1.
1180         - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2.
1181     - ring2 10GE-ports x710-4p10GE on SUT:
1182         - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3.
1183         - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4.
1184     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1185         - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1.
1186         - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2.
1187     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1188         - s10-t24-tg1-c9/p1 to s9-t24-sut1-c9/p1.
1189         - s9-t24-sut1-c9/p2 to s10-t24-tg1-c9/p2.
1190     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1191         - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2.
1192         - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
1193 ```
1194
1195 #### 2-Node-Denverton (2n-dnv) TODO
1196
1197 ```
1198 To be completed.
1199 ```
1200
1201 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
1202
1203 ```
1204 - testbed25:
1205     - link1 10GE-port x710-4p10GE on SUT:
1206         - t25-tg1-p1 to t25-sut1-c2/p1.
1207     - link2 10GE-port x710-4p10GE on SUT:
1208         - t25-tg1-p2 to t25-sut1-c2/p2.
1209     - link3 10GE-port x710-4p10GE on SUT:
1210         - t25-tg1-p3 to t25-sut1-c2/p3.
1211     - link4 10GE-port x710-4p10GE on SUT:
1212         - t25-tg1-p4 to t25-sut1-c2/p4.
1213 ```
1214
1215 #### 3-Node-Haswell (3n-hsw) PROD
1216
1217 ```
1218  1. testbed1:
1219     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1220         - t1-tg1-c1/p1 to t1-sut1-c1/p2.
1221         - t1-sut1-c1/p1 to t1-sut2-c1/p2.
1222         - t1-sut2-c1/p1 to t1-tg1-c1/p2.
1223     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1224         - t1-tg1-c2/p1 to t1-sut1-c2/p2.
1225         - t1-sut1-c2/p1 to t1-sut2-c2/p2.
1226         - t1-sut2-c2/p1 to t1-tg1-c2/p2.
1227     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1228         - t1-tg1-c4/p1 to t1-sut1-c4/p2.
1229         - t1-sut1-c4/p1 to t1-sut2-c4/p2.
1230         - t1-sut2-c4/p1 to t1-tg1-c4/p2.
1231     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1232         - t1-tg1-c5/p1 to t1-sut1-c5/p2.
1233         - t1-sut1-c5/p1 to t1-sut2-c5/p2.
1234         - t1-sut2-c5/p1 to t1-tg1-c5/p2.
1235     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1236         - t1-tg1-c2/p1 to t1-sut1-cm/p2.
1237         - t1-sut1-cm/p1 to t1-sut2-cm/p2.
1238         - t1-sut2-cm/p1 to t1-tg1-c2/p2.
1239     - TG loopback ports Intel NIC x710 2p10GE
1240         - t1-tg1-c6/p1 to t1-tg1-c6/p2.
1241
1242  2. testbed2:
1243     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1244         - t2-tg1-c1/p1 to t2-sut1-c1/p2.
1245         - t2-sut1-c1/p1 to t2-sut2-c1/p2.
1246         - t2-sut2-c1/p1 to t2-tg1-c1/p2.
1247     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1248         - t2-tg1-c2/p1 to t2-sut1-c2/p2.
1249         - t2-sut1-c2/p1 to t2-sut2-c2/p2.
1250         - t2-sut2-c2/p1 to t2-tg1-c2/p2.
1251     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1252         - t2-tg1-c4/p1 to t2-sut1-c4/p2.
1253         - t2-sut1-c4/p1 to t2-sut2-c4/p2.
1254         - t2-sut2-c4/p1 to t2-tg1-c4/p2.
1255     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1256         - t2-tg1-c5/p1 to t2-sut1-c5/p2.
1257         - t2-sut1-c5/p1 to t2-sut2-c5/p2.
1258         - t2-sut2-c5/p1 to t2-tg1-c5/p2.
1259     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1260         - t2-tg1-c2/p1 to t2-sut1-cm/p2.
1261         - t2-sut1-cm/p1 to t2-sut2-cm/p2.
1262         - t2-sut2-cm/p1 to t2-tg1-c2/p2.
1263     - TG loopback ports Intel NIC x710 2p10GE
1264         - t2-tg1-c6/p1 to t2-tg1-c6/p2.
1265
1266  3. testbed3:
1267     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1268         - t3-tg1-c1/p1 to t3-sut1-c1/p2.
1269         - t3-sut1-c1/p1 to t3-sut2-c1/p2.
1270         - t3-sut2-c1/p1 to t3-tg1-c1/p2.
1271     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1272         - t3-tg1-c2/p1 to t3-sut1-c2/p2.
1273         - t3-sut1-c2/p1 to t3-sut2-c2/p2.
1274         - t3-sut2-c2/p1 to t3-tg1-c2/p2.
1275     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1276         - t3-tg1-c4/p1 to t3-sut1-c4/p2.
1277         - t3-sut1-c4/p1 to t3-sut2-c4/p2.
1278         - t3-sut2-c4/p1 to t3-tg1-c4/p2.
1279     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1280         - t3-tg1-c5/p1 to t3-sut1-c5/p2.
1281         - t3-sut1-c5/p1 to t3-sut2-c5/p2.
1282         - t3-sut2-c5/p1 to t3-tg1-c5/p2.
1283     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1284         - t3-tg1-c2/p1 to t3-sut1-cm/p2.
1285         - t3-sut1-cm/p1 to t3-sut2-cm/p2.
1286         - t3-sut2-cm/p1 to t3-tg1-c2/p2.
1287     - TG loopback ports Intel NIC x710 2p10GE
1288         - t3-tg1-c6/p1 to t3-tg1-c6/p2.
1289 ```
1290
1291 #### 3-Node-Skylake (3n-skx) PROD
1292
1293 ```
1294 - testbed31:
1295     - ring1 10GE-ports x710-4p10GE on SUTs:
1296         - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1.
1297         - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2.
1298         - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2.
1299     - ring2 10GE-ports x710-4p10GE on SUT:
1300         - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3.
1301         - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4.
1302         - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4.
1303     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1304         - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1.
1305         - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2.
1306         - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2.
1307     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1308         - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1.
1309         - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2.
1310         - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2.
1311     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1312         - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2.
1313         - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4.
1314 - testbed32:
1315     - ring1 10GE-ports x710-4p10GE on SUTs:
1316         - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1.
1317         - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2.
1318         - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2.
1319     - ring2 10GE-ports x710-4p10GE on SUT:
1320         - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3.
1321         - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4.
1322         - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4.
1323     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1324         - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1.
1325         - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2.
1326         - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2.
1327     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1328         - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1.
1329         - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2.
1330         - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2.
1331     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1332         - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2.
1333         - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4.
1334 ```
1335
1336 #### 3-Node-Rangeley (3n-rng) TODO
1337
1338 ```
1339 To be completed.
1340 ```
1341
1342 #### 3-Node-Taishan (3n-tsh) WIP
1343
1344 ```
1345 - testbed33:
1346     - ring1 10GE-ports 82599-2p10GE on SUTs:
1347         - t33t34-tg1-c2/p2 - t33-sut1-c6/p2.
1348         - t33-sut1-c6/p1 - t33-sut2-c6/p2.
1349         - t33-sut2-c6/p1 - t33t34-tg1-c2/p1.
1350     - ring2 25GE-ports cx4-2p25GE on SUTs:
1351         - t33t34-tg1-c4/p2 - t33-sut1-c4/p2.
1352         - t33-sut1-c4/p1 - t33-sut2-c4/p2.
1353         - t33-sut2-c4/p1 - t33t34-tg1-c4/p1.
1354 ```
1355
1356 #### 3-Node-Mcbin (3n-mcb) WIP
1357
1358 ```
1359 - testbed34:
1360     - ring1 10GE-ports Marvell on SUTs:
1361         - t33t34-tg1-c2/p3 - t34-sut1-ca/p1.
1362         - t34-sut1-ca/p2 - t34-sut2-ca/p1.
1363         - t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
1364 ```
1365
1366 ## Inventory
1367
1368 ### Appliances
1369
1370 ```
1371 1. Ixia PerfectStorm One Appliance
1372     - 1 * PS10GE4NG
1373         - Chassis: PS10GE4NG.
1374         - Motherboard: SuperMicro X11DPG-QT.
1375         - Processors: Quad-Core, Intel Processor.
1376         - HW accelerators: FPGA offload.
1377         - RAM Memory: 64GB.
1378         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
1379         - Physical Interfaces: 4 * 10GE SFP+.
1380         - Operating System: Native IxOS.
1381 ```
1382
1383 ### Arm Servers
1384
1385 ```
1386 1. Arm Cortex A-72 servers
1387     - 1 * ThunderX2
1388         - Chassis: Marvell ThunderX2
1389         - Processors: 2* ThunderX2 CN9975 ~ 112* ThunderX2.
1390         - RAM Memory: 4* 32GB RDIMM
1391         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
1392     - 2 * Huawei TaiShan 2280.
1393         - Chassis: Huawei TaiShan 2280.
1394         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72.
1395         - RAM Memory: 8* 16GB DDR4-2400MT/s.
1396         - Disks: 1* 4TB SATA HDD.
1397     - 3 * MACCHIATObin
1398         - Chassis: MACCHIATObin.
1399         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72.
1400         - RAM Memory: 1* 16GB DDR4.
1401         - Disks: 1* 128GB(?) SATA SDD.
1402 ```
1403
1404 ### Xeon and Atom Servers
1405
1406 ```
1407 1. Intel Xeon servers:
1408     - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors.
1409         - Chassis: SuperMicro SYS-7049GP-TRT.
1410         - Motherboard: SuperMicro X11DPG-QT.
1411         - Processors: 2* Intel Platinum 8180 2.3 GHz.
1412         - RAM Memory: 16* 16GB DDR4-2666MHz.
1413         - Disks: 2* 1.6TB 6G SATA SSD.
1414 2. Intel Atom servers with Rangely processors.
1415     - 3 * Netgate XG-2758-1u
1416         - Chassis: Netgate XG-2758-1u
1417         - Processors: 1* Rangely (Atom) C2758 2.4 GHz
1418         - RAM Memory: 16GB ECC
1419         - Disks: 150 GB
1420 ```
1421
1422 ### Network Interface Cards
1423
1424 ```
1425 1. 10GE NICs
1426     - 14 * Intel® Ethernet Converged Network Adapter X710-DA4
1427     - 6 * Intel® Ethernet Converged Network Adapter X710-DA2
1428     - 6 * Intel® Ethernet Converged Network Adapter X520-DA2
1429 2. 25GE NICs
1430     - 12 * Intel® Ethernet Network Adapter XXV710-DA2
1431 3. 40GE NICs
1432     - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2
1433 4. 100GE NICs
1434     - 4 * mcx556a-edat NICs (not on site yet, in transit)
1435 ```
1436
1437 ### Pluggables and Cables
1438
1439 Pluggables:
1440
1441 ```
1442 1. 10GE SFP+
1443     - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics
1444     - 80 * 10G SR optic (generic, "Intel" compatible branded)
1445 2. 25GE SFP28
1446     - None
1447 3. 40GE QSFP+
1448     - None
1449 4. 100GE
1450     - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit)
1451 ```
1452
1453 Standalone cables:
1454
1455 ```
1456 1. 10GE
1457     - None
1458 2. 25GE
1459     - None
1460 3. 40GE QSFP+
1461     - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable
1462 4. 100GE
1463     - None
1464 ```
1465
1466 ### Other Parts
1467
1468 None.