docs/lab: merged testbed specifications, separated out detailed HW and BIOS configs.
[csit.git] / docs / lab / testbed_specifications.md
1 <!-- TOC depthFrom:1 depthTo:6 withLinks:1 updateOnSave:1 orderedList:0 -->
2
3         - [FD.io CSIT Testbed Specifications](#fdio-csit-testbed-specifications)
4         - [Testbeds Overview](#testbeds-overview)
5                 - [Summary List](#summary-list)
6                 - [1-Node-Skylake Xeon Intel (1n-skx)](#1-node-skylake-xeon-intel-1n-skx)
7                 - [1-Node-ThunderX2 Arm Marvell (1n-tx2)](#1-node-thunderx2-arm-marvell-1n-tx2)
8                 - [2-Node-Skylake Xeon Intel (2n-skx)](#2-node-skylake-xeon-intel-2n-skx)
9                 - [2-Node-Denverton Atom Intel (2n-dnv)](#2-node-denverton-atom-intel-2n-dnv)
10                 - [2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)](#2-node-ixiaps1l47-ixia-psone-l47-2n-ps1)
11                 - [3-Node-Haswell Xeon Intel (3n-skx)](#3-node-haswell-xeon-intel-3n-skx)
12                 - [3-Node-Skylake Xeon Intel (3n-skx)](#3-node-skylake-xeon-intel-3n-skx)
13                 - [3-Node-TaiShan Arm Huawei (3n-tsh)](#3-node-taishan-arm-huawei-3n-tsh)
14                 - [3-Node-MACCHIATObin Arm Marvell](#3-node-macchiatobin-arm-marvell)
15                 - [3-Node-Rangeley Atom Testbeds](#3-node-rangeley-atom-testbeds)
16         - [Server Management](#server-management)
17                 - [Requirements](#requirements)
18                 - [Addressing](#addressing)
19                 - [LOM (IPMI) VLAN IP Addresses](#lom-ipmi-vlan-ip-addresses)
20                 - [Management VLAN IP Addresses](#management-vlan-ip-addresses)
21         - [Server Type Specification](#server-type-specification)
22                 - [Server and Port Naming](#server-and-port-naming)
23         - [Testbeds Configuration](#testbeds-configuration)
24                 - [Per Testbed Server Allocation and Naming](#per-testbed-server-allocation-and-naming)
25                         - [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
26                         - [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
27                         - [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
28                         - [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
29                         - [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
30                         - [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
31                         - [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
32                         - [3-Node-Rangeley (3n-rng) VERIFY](#3-node-rangeley-3n-rng-verify)
33                         - [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
34                         - [3-Node-Mcbin (3n-mcb) TODO](#3-node-mcbin-3n-mcb-todo)
35                 - [Per Testbed Wiring](#per-testbed-wiring)
36                         - [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
37                         - [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
38                         - [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
39                         - [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
40                         - [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
41                         - [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
42                         - [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
43                         - [3-Node-Rangeley (3n-rng) TODO](#3-node-rangeley-3n-rng-todo)
44                         - [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
45                         - [3-Node-Mcbin (3n-mcb) WIP](#3-node-mcbin-3n-mcb-wip)
46         - [Inventory](#inventory)
47                 - [Appliances](#appliances)
48                 - [Arm Servers](#arm-servers)
49                 - [Xeon and Atom Servers](#xeon-and-atom-servers)
50                 - [Network Interface Cards](#network-interface-cards)
51                 - [Pluggables and Cables](#pluggables-and-cables)
52                 - [Other Parts](#other-parts)
53
54 <!-- /TOC -->
55 ## FD.io CSIT Testbed Specifications
56
57 This note includes specification of the physical testbed infrastructure
58 hosted by LFN FD.io CSIT project.
59
60 ## Testbeds Overview
61
62 ### Summary List
63
64 ```
65  #. CSIT_tb          Purpose  SUT   TG    #TB  #SUT #TG  #hsw #skx #ps1 #rng #dnv #tx2 #tsh #mcb
66  1. 1-Node-Skylake     func   skx   na    2    2    0    0    2    0    0    0    0    0    0
67  2. 1-Node-Thunderx2   func   tx2   na    1    1    0    0    0    0    0    0    1    0    0
68  3. 2-Node-Skylake     perf   skx   skx   4    4    4    0    8    0    0    0    0    0    0
69  4. 2-Node-Denverton   perf   dnv   skx   1    1    1    0    .5   0    0    1    0    0    0
70  5. 2-Node-IxiaPS1L47  tcp    skx   ps1   1    1    1    0    1    1    0    0    0    0    0
71  6. 3-Node-Haswell     perf   hsw   hsw   3    6    3    9    0    0    0    0    0    0    0
72  7. 3-Node-Skylake     perf   skx   skx   2    4    2    0    6    0    0    0    0    0    0
73  8. 3-Node-Rangeley    perf   rng   skx   1    3    1    0    0    0    2    0    0    0    0
74  9. 3-Node-Taishan     perf   tsh   skx   1    2    1    0    .5   0    0    0    0    2    0
75 10. 3-Node-Mcbin       perf   mcb   skx   1    2    1    0    .5   0    0    0    0    0    2
76 11. 1-Node-VIRL        func   hsw   ---   3    3    0    3    0    0    0    0    0    0    0
77                                  Totals: 17   26   14   12   19    1    2    1    1    2    2
78 ```
79
80 ### 1-Node-Skylake Xeon Intel (1n-skx)
81
82 Each 1-Node-Skylake testbed includes one SUT (Type-B6 server) with NIC
83 ports connected back-to-back.
84 Used for FD.io VPP_Device functional driver tests.
85
86 ### 1-Node-ThunderX2 Arm Marvell (1n-tx2)
87
88 Each 1-Node-ThunderX2 testbed includes one SUT (Type-B9 server) with NIC
89 ports connected back-to-back.
90 Used for FD.io VPP_Device functional driver tests.
91
92 ### 2-Node-Skylake Xeon Intel (2n-skx)
93
94 Each 2-Node-Skylake testbed includes one SUT (Type-B1 server) and one TG
95 (Type-B2 server) connected back-to-back.
96 Used for FD.io performance tests.
97
98 ### 2-Node-Denverton Atom Intel (2n-dnv)
99
100 Each 2-Node-Skylake testbed includes one SUT (Type-B10 server) and one TG
101 (Type-B2 server) connected back-to-back.
102 Used for FD.io performance tests.
103
104 ### 2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)
105
106 Each 2-Node-IxiaPS1L47 testbed includes one SUT (Type-B1 server) and one
107 TG (Ixia PSOne appliance) with 10GE interfaces connected back-to-back.
108 Used for FD.io TCP/IP and HTTP performance tests.
109
110 ### 3-Node-Haswell Xeon Intel (3n-skx)
111
112 ### 3-Node-Skylake Xeon Intel (3n-skx)
113
114 Each 3-Node-Skylake testbed includes two SUTs (Type-B1 servers) and one
115 TG (Type-B2 server) connected in full-mesh triangle.
116 Used for FD.io performance tests.
117
118 ### 3-Node-TaiShan Arm Huawei (3n-tsh)
119
120 Each 3-Node-TaiShan testbed includes two SUTs (Type-B3 server) and one TG
121 (Type-B2 server) connected in full-mesh triangle.
122 Used for FD.io performance tests.
123
124 ### 3-Node-MACCHIATObin Arm Marvell
125
126 Each 3-Node-MACCHIATObin testbed includes two SUTs (Type-B4 server) and
127 one TG (Type-B2 server) connected in full-mesh triangle.
128 Used for FD.io performance tests.
129
130 ### 3-Node-Rangeley Atom Testbeds
131
132 Each 3-Node-Rangeley testbed includes two SUTs (Type-B5 Netgate device)
133 and one TG (Type-2 server) connected in full-mesh triangle.
134 Used for FD.io performance tests.
135
136 ## Server Management
137
138 ### Requirements
139
140 For management purposes, each server must have following two ports
141 connected to the management network:
142
143 ```
144 - 1GE IPMI port
145   - IPMI - Intelligent Platform Management Interface.
146   - Required for access to embedded server management with WebUI, CLI, SNMPv3,
147     IPMIv2.0, for firmware (BIOS) and OS updates.
148 - 1GE/10GE/40GE management port
149   - hostOS management port for general system management.
150 ```
151
152 ### Addressing
153
154 Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management
155 port, which are connected to two different VLANs.
156
157 ```
158 1. LOM (IPMI) VLAN:
159     - Subnet: 10.30.50.0/24
160     - Gateway: 10.30.50.1
161     - Broadcast: 10.30.50.255
162     - DNS1: 199.204.44.24
163     - DNS2: 199.204.47.54
164 2. Management Vlan:
165     - Subnet: 10.30.51.0/24
166     - Gateway: 10.30.51.1
167     - Broadcast: 10.30.51.255
168     - DNS1: 199.204.44.24
169     - DNS2: 199.204.47.54
170 ```
171
172 To access these hosts, VPN connection is required.
173
174 ### LOM (IPMI) VLAN IP Addresses
175
176 Name         | Comment
177 ------------ | -------
178 10.30.50.0   | network
179 10.30.51.1   | Router
180 10.30.50.2   | LF Reserved
181 10.30.50.3   | LF Reserved
182 10.30.50.4   | LF Reserved
183 10.30.50.5   | LF Reserved
184 10.30.50.6   | LF Reserved
185 10.30.50.7   | LF Reserved
186 10.30.50.8   | LF Reserved
187 10.30.50.9   | LF Reserved
188 10.30.50.10  | LF Reserved
189 10.30.50.11  | LF Reserved
190 10.30.50.12  | LF Reserved
191 10.30.50.13  | LF Reserved
192 10.30.50.14  | LF Reserved
193 10.30.50.15  | LF Reserved
194 10.30.50.16  | t1-tg1
195 10.30.50.17  | t1-sut1
196 10.30.50.18  | t1-sut2
197 10.30.50.20  | t2-tg1
198 10.30.50.21  | t2-sut1
199 10.30.50.22  | t2-sut2
200 10.30.50.24  | t3-tg1
201 10.30.50.25  | t3-sut1
202 10.30.50.26  | t3-sut-2
203 10.30.50.28  | t4-sut1
204 10.30.50.29  | t4-sut2
205 10.30.50.30  | t4-sut3
206 10.30.50.36  | s17-t33-sut1
207 10.30.50.37  | s18-t33-sut2
208 10.30.50.41  | s3-t21-sut1
209 10.30.50.42  | s4-t21-tg1
210 10.30.50.43  | s11-t31-sut1
211 10.30.50.44  | s12-t31-sut2
212 10.30.50.45  | s13-t31-tg1
213 10.30.50.46  | s19-t33t34-tg1
214 10.30.50.47  | s1-t11-sut1
215 10.30.50.48  | s2-t12-sut1
216 10.30.50.49  | s5-t22-sut1
217 10.30.50.50  | s6-t22-tg1
218 10.30.50.51  | s7-t23-sut1
219 10.30.50.52  | s8-t23-tg1
220 10.30.50.53  | s9-t24-sut1
221 10.30.50.54  | s10-t24-tg1
222 10.30.50.55  | s14-t32-sut1
223 10.30.50.56  | s15-t32-sut2
224 10.30.50.57  | s16-t32-tg1
225 10.30.50.58  | s25-t25-sut1
226 10.30.50.59  | s26-t25-tg1
227 10.30.50.69  | s27-t13-sut
228 10.30.50.255 | Broadcast
229
230 ### Management VLAN IP Addresses
231
232 Name                      | Comment
233 ------------------------- | -------
234 10.30.51.0                | network
235 10.30.51.1                | Router
236 10.30.51.2                | LF Reserved
237 10.30.51.3                | LF Reserved
238 10.30.51.4                | LF Reserved
239 10.30.51.5                | LF Reserved
240 10.30.51.6                | LF Reserved
241 10.30.51.7                | LF Reserved
242 10.30.51.8                | LF Reserved
243 10.30.51.9                | s22-t35-sut1 (netgate-1)
244 10.30.51.10               | s23-t35-sut2 (netgate-2)
245 10.30.51.11               | s24-t35-sut3 (netgate-3)
246 10.30.51.12               | softiron-1
247 10.30.51.13               | softiron-2
248 10.30.51.14               | softiron-3
249 10.30.51.15               | LF Reserved
250 10.30.51.16               | t1-tg1
251 10.30.51.17               | t1-sut1
252 10.30.51.18               | t1-sut2
253 10.30.51.20               | t2-tg1
254 10.30.51.21               | t2-sut1
255 10.30.51.22               | t2-sut2
256 10.30.51.24               | t3-tg1
257 10.30.51.25               | t3-sut1
258 10.30.51.26               | t3-sut-2
259 10.30.51.28               | t4-sut1
260 10.30.51.29               | t4-sut2
261 10.30.51.29               | s22-t35-sut1 screen -r /dev/ttyUSB0, TO BE VERIFIED
262 10.30.51.30               | t4-sut3
263 10.30.51.30               | s23-t35-sut2 screen -r /dev/ttyUSB1, TO BE VERIFIED
264 10.30.51.30               | s24-t35-sut3 screen -r /dev/ttyUSB2, TO BE VERIFIED
265 10.30.51.36               | s17-t33-sut1
266 10.30.51.37               | s18-t33-sut2
267 10.30.51.41               | s20-t34-sut1
268 10.30.51.42               | s21-t34-sut2
269 10.30.51.44               | s3-t21-sut1
270 10.30.51.45               | s4-t21-tg1
271 10.30.51.46               | s11-t31-sut1
272 10.30.51.47               | s12-t31-sut2
273 10.30.51.48               | s13-t31-tg1
274 10.30.51.49               | s19-t33t34-tg1
275 10.30.51.50               | s1-t11-sut1
276 10.30.51.51               | s2-t12-sut1
277 10.30.51.52               | s5-t22-sut1
278 10.30.51.53               | s6-t22-tg1
279 10.30.51.54               | s7-t23-sut1
280 10.30.51.55               | s8-t23-tg1
281 10.30.51.56               | s9-t24-sut1
282 10.30.51.57               | s10-t24-tg1
283 10.30.51.58               | s14-t32-sut1
284 10.30.51.59               | s15-t32-sut2
285 10.30.51.60               | s16-t32-tg1
286 10.30.51.61               | s25-t25-sut1
287 10.30.51.62               | s26-t25-tg1
288 10.30.51.69               | s27-t13-sut1
289 10.30.51.70-10.30.51.105  | VIRL1 TO BE VERIFIED
290 10.30.51.106-10.30.51.180 | VIRL2
291 10.30.51.181-10.30.51.254 | VIRL3
292 10.30.51.255              | Broadcast
293
294 ## Server Type Specification
295
296 FD.io CSIT lab contains following server types:
297 ```
298 1. Type-A1: Purpose - Haswell Xeon SUT (Systems Under Test) for FD.io performance testing.
299     - Quantity: 6 servers.
300     - Physical connectivity:
301         - CIMC and host management ports.
302         - NIC ports connected in 3-node topologies.
303     - Main HW configuration:
304         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
305         - Processors: 2* E5-2699v3 2.3 GHz.
306         - RAM Memory: 16* 32GB DDR4-2133MHz.
307         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
308     - NICs configuration:
309         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes)
310             - PCIe Slot1: Cisco VIC 1385 2p40GE.
311             - PCIe Slot2: Intel NIC x520 2p10GE.
312             - PCIe Slot3: empty.
313         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes)
314             - PCIe Slot4: Intel NIC xl710 2p40GE.
315             - PCIe Slot5: Intel NIC x710 2p10GE.
316             - PCIe Slot6: Intel QAT 8950 50G (Walnut Hill)
317         - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
318 2. Type-A2: Purpose - Haswell Xeon TG (Traffic Generators) for FD.io performance testing.
319     - Quantity: 3 servers.
320     - Physical connectivity:
321         - CIMC and host management ports.
322         - NIC ports connected in 3-node topologies.
323     - Main HW configuration:
324         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
325         - Processors: 2* E5-2699v3 2.3 GHz.
326         - RAM Memory: 16* 32GB DDR4-2133MHz.
327         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
328     - NICs configuration:
329         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
330             - PCIe Slot1: Intel NIC xl710 2p40GE.
331             - PCIe Slot2: Intel NIC x710 2p10GE.
332             - PCIe Slot3: Intel NIC x710 2p10GE.
333         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
334             - PCIe Slot4: Intel NIC xl710 2p40GE.
335             - PCIe Slot5: Intel NIC x710 2p10GE.
336             - PCIe Slot6: Intel NIC x710 2p10GE.
337         - MLOM slot: empty.
338 3. Type-A3: Purpose - Haswell Xeon VIRL hosts for FD.io functional testing.
339     - Quantity: 3 servers.
340     - Physical connectivity:
341         - CIMC and host management ports.
342         - no NIC ports, standalone setup.
343     - Main HW configuration:
344         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
345         - Processors: 2* E5-2699v3 2.3 GHz.
346         - RAM Memory: 16* 32GB DDR4-2133MHz.
347         - Disks: 2* 480 GB 2.5inch 6G SATA SSD.
348     - NICs configuration:
349         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
350             - no cards.
351         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
352             - no cards.
353         - MLOM slot: empty.
354 4. Type-B1: Purpose - Skylake Xeon SUT for FD.io performance testing.
355     - Quantity: ---
356     - Physical connectivity:
357         - IPMI and host management ports.
358         - NIC ports connected into 2-node and 3-node topologies.
359     - Main HW configuration:
360         - Chassis: SuperMicro SYS-7049GP-TRT.
361         - Motherboard: SuperMicro X11DPG-QT.
362         - Processors: 2* Intel Platinum 8180 2.3 GHz.
363         - RAM Memory: 16* 16GB DDR4-2666MHz.
364         - Disks: 2* 1.6TB 6G SATA SSD.
365     - NICs configuration:
366         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
367             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
368             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
369             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
370         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
371             - PCIe Slot6 86:00.xx: empty.
372             - PCIe Slot8 af:00.xx: empty.
373             - PCIe Slot10 d8:00.xx: empty.
374 2. Type-B2: Purpose - Skylake Xeon TG for FD.io performance testing.
375     - Quantity: ---
376     - Physical connectivity:
377         - IPMI and host management ports.
378         - NIC ports connected into 2-node and 3-node topologies.
379     - Main HW configuration:
380         - Chassis: SuperMicro SYS-7049GP-TRT.
381         - Motherboard: SuperMicro X11DPG-QT.
382         - Processors: 2* Intel Platinum 8180 2.3 GHz.
383         - RAM Memory: 16* 16GB DDR4-2666MHz.
384         - Disks: 2* 1.6TB 6G SATA SSD.
385     - NICs configuration:
386         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
387             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
388             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
389             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
390         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
391             - PCIe Slot6 86:00.xx: empty.
392             - PCIe Slot8 af:00.xx: empty.
393             - PCIe Slot10 d8:00.xx: x710-4p10GE Intel.
394 3. Type-B3: Purpose - TaiShan Arm Huawei SUT for FD.io performance testing.
395     - Quantity: 2
396     - Physical connectivity:
397         - IPMI(?) and host management ports.
398         - NIC ports connected into 3-node topology.
399     - Main HW configuration:
400         - Chassis: Huawei TaiShan 2280.
401         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72
402         - RAM Memory: 8* 16GB DDR4-2400MT/s
403         - Disks: 1* 4TB SATA HDD
404     - NICs configuration:
405         - PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox.
406         - PCIe Slot6 11:00.xx: 82599-2p10GE Intel.
407 4. Type-B4: Purpose - MACCHIATObin Arm Marvell SUT for FD.io performance testing.
408     - Quantity: 3
409     - Physical connectivity:
410         - Host management ports.
411         - NIC ports connected into 2-node and 3-node topologies.
412     - Main HW configuration:
413         - Chassis: MACCHIATObin.
414         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72
415         - RAM Memory: 1* 16GB DDR4
416         - Disks: 1* 128GB(?) SATA SDD
417     - NICs configuration:
418         - pp2-2p10GE Marvell (on-chip Ethernet ports ; marvell plugin in VPP)
419 5. Type-B5: Purpose - Rangeley Atom SUT for FD.io performance testing.
420     - Quantity: TBD based on testbed allocation.
421     - Physical connectivity:
422         - Management: serial Port (usb) for console
423         - NIC ports connected into 2-node.
424     - Main HW configuration:
425         - Chassis: Netgate XG-2758-1u
426         - Processors: 1* Rangeley (Atom) C2758 2.4 GHz
427         - RAM Memory: 16GB ECC
428         - Disks: 150 GB
429     - NICs configuration:
430         - 2x 10Gb Intel 82599ES
431         - 4x 1GB Intel I354
432 6. Type-B6: Purpose - Skylake Xeon SUT for FD.io VPP_Device functional tests.
433     - Quantity: 2.
434     - Physical connectivity:
435         - IPMI and host management ports.
436         - NIC ports connected into 2-node and 3-node topologies.
437     - Main HW configuration:
438         - Chassis: SuperMicro SYS-7049GP-TRT.
439         - Motherboard: SuperMicro X11DPG-QT.
440         - Processors: 2* Intel Platinum 8180 2.3 GHz.
441         - RAM Memory: 16* 16GB DDR4-2666MHz.
442         - Disks: 2* 1.6TB 6G SATA SSD.
443     - NICs configuration:
444         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
445             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
446             - PCIe Slot4 3b:00.xx: x710-4p10GE Intel.
447             - PCIe Slot9 5e:00.xx: empty.
448         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
449             - PCIe Slot6 86:00.xx: empty.
450             - PCIe Slot8 af:00.xx: empty.
451             - PCIe Slot10 d8:00.xx: empty.
452 7. Type-B7: Purpose - Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests.
453     - Quantity: 1.
454     - Physical connectivity:
455         - Host management interface: 10/100/1000-BaseT.
456         - 8-port 10GE SFP+ integrated NIC.
457     - Main HW configuration:
458         - Chassis: PS10GE4NG.
459         - Motherboard: SuperMicro X11DPG-QT.
460         - Processors: Quad-Core, Intel Processor.
461         - HW accelerators: FPGA offload.
462         - RAM Memory: 64GB.
463         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
464         - Physical Interfaces: 4 * 10GE SFP+.
465         - Operating System: Native IxOS.
466     - Interface configuration:
467         - Port-1: 10GE SFP+.
468         - Port-2: 10GE SFP+.
469         - Port-3: 10GE SFP+.
470         - Port-4: 10GE SFP+.
471 8. Type-B8: Purpose - Skylake Xeon SUT for TCP/IP host stack tests.
472     - Quantity: 1.
473     - Physical connectivity:
474         - IPMI and host management ports.
475         - NIC ports.
476     - Main HW configuration:
477         - Chassis: SuperMicro SYS-7049GP-TRT.
478         - Motherboard: SuperMicro X11DPG-QT.
479         - Processors: 2* Intel Platinum 8180 2.3 GHz.
480         - RAM Memory: 16* 16GB DDR4-2666MHz.
481         - Disks: 2* 1.6TB 6G SATA SSD.
482     - NICs configuration:
483         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
484             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
485             - PCIe Slot4 3b:00.xx: empty.
486             - PCIe Slot9 5e:00.xx: empty.
487         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
488             - PCIe Slot6 86:00.xx: empty.
489             - PCIe Slot8 af:00.xx: empty.
490             - PCIe Slot10 d8:00.xx: empty.
491 9. Type-B9: Purpose - ThunderX2 Arm Marvell SUT for FD.io VPP_Device functional tests.
492     - Quantity: 1
493     - Physical connectivity:
494         - IPMI and host management ports.
495         - NIC ports connected into 1-node topologies.
496     - Main HW configuration:
497         - Chassis: Gigabyte R181-T90 1U
498         - Motheboard: MT91-FS1
499         - Processors: 1* ThunderX2 ARMv8 CN9975 2.0 GHz
500         - RAM Memory: 4* 32GB RDIMM
501         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
502     - NICs configuration:
503         - Numa0:
504             - PCIe Slot1 05:00.xx: XL710-QDA2.
505             - PCIe Slot3 08:00.xx: XL710-QDA2.
506         - Numa1:
507             - PCIe Slot6 85:00.xx: XL710-QDA2.
508 10. Type-B10: Purpose - Denverton Atom SUT for FD.io performance testing.
509     - Quantity: 4
510     - Physical connectivity:
511         - IPMI and host management ports.
512         - NIC ports.
513     - Main HW configuration:
514         - Chassis: SuperMicro SYS-E300-9A
515         - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
516         - RAM Memory: 32GB ECC
517         - Disks: 480 GB
518     - NICs configuration:
519         - 2x 10Gb Intel x553 fiber ports
520         - 2x 10Gb Intel x553 copper ports
521         - 4x 1GB Intel I350 ports
522 ```
523
524 ### Server and Port Naming
525
526 Following naming convention is used within this page to specify physical
527 connectivity and wiring across defined CSIT testbeds:
528
529 ```
530 - testbedname: testbedN.
531 - hostname:
532     - traffic-generator: tN-tgW.
533     - system-under-testX: tN-sutX.
534 - portnames:
535     - tN-tgW-cY/pZ.
536     - tN-sutX-cY/pZ.
537 - where:
538     - N - testbed number.
539     - tgW - server acts as traffic-generator with W index.
540     - sutX - server acts as system-under-test with X index.
541     - Y - PCIe slot number denoting a NIC card number within the host.
542     - Z - port number on the NIC card.
543 ```
544
545 ## Testbeds Configuration
546
547 ### Per Testbed Server Allocation and Naming
548
549 #### 1-Node-Skylake (1n-skx) PROD
550
551 ```
552 - ServerB1 [Type-B6]:
553     - testbedname: testbed11.
554     - hostname: s1-t11-sut1.
555     - IPMI IP: 10.30.50.47
556     - Host IP: 10.30.51.50
557     - portnames:
558         - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
559         - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
560         - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
561         - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
562         - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
563         - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
564         - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
565         - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
566 - ServerB2 [Type-B6]:
567     - testbedname: testbed12.
568     - hostname: s2-t12-sut1.
569     - IPMI IP: 10.30.50.48
570     - Host IP: 10.30.51.51
571     - portnames:
572         - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
573         - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
574         - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
575         - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
576         - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
577         - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
578         - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
579         - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
580 ```
581
582 #### 1-Node-Thunderx2 (1n-tx2) WIP
583
584 ```
585 - ServerB17 [Type-B9]:
586     - testbedname: testbed13.
587     - hostname: s27-t13-sut1.
588     - IPMI IP: 10.30.50.69
589     - Host IP: 10.30.51.69
590     - portnames:
591         - s27-t13-sut1-c1/p1 - 40GE-port1 XL710-QDA2-2p40GE.
592         - s27-t13-sut1-c1/p2 - 40GE-port2 XL710-QDA2-2p40GE.
593         - s27-t13-sut1-c3/p1 - 40GE-port1 XL710-QDA2-2p40GE.
594         - s27-t13-sut1-c3/p2 - 40GE-port2 XL710-QDA2-2p40GE.
595         - s27-t13-sut1-c6/p1 - 40GE-port1 XL710-QDA2-2p40GE.
596         - s27-t13-sut1-c6/p2 - 40GE-port2 XL710-QDA2-2p40GE.
597 ```
598
599 #### 2-Node-Skylake (2n-skx) PROD
600
601 ```
602 - ServerB3 [Type-B1]:
603     - testbedname: testbed21.
604     - hostname: s3-t21-sut1.
605     - IPMI IP: 10.30.50.41
606     - Host IP: 10.30.51.44
607     - portnames:
608         - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
609         - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
610         - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
611         - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
612         - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
613         - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
614         - s3-t21-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
615         - s3-t21-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
616 - ServerB4 [Type-B2]:
617     - testbedname: testbed21.
618     - hostname: s4-t21-tg1.
619     - IPMI IP: 10.30.50.42
620     - Host IP: 10.30.51.45
621     - portnames:
622         - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
623         - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
624         - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
625         - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
626         - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
627         - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
628         - s4-t21-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
629         - s4-t21-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
630 - ServerB5 [Type-B1]:
631     - testbedname: testbed22.
632     - hostname: s5-t22-sut1.
633     - IPMI IP: 10.30.50.49
634     - Host IP: 10.30.51.52
635     - portnames:
636         - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
637         - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
638         - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
639         - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
640         - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
641         - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
642         - s5-t22-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
643         - s5-t22-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
644 - ServerB6 [Type-B2]:
645     - testbedname: testbed22.
646     - hostname: s6-t22-tg1.
647     - IPMI IP: 10.30.50.50
648     - Host IP: 10.30.51.53
649     - portnames:
650         - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
651         - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
652         - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
653         - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
654         - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
655         - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
656         - s6-t22-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
657         - s6-t22-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
658 - ServerB7 [Type-B1]:
659     - testbedname: testbed23.
660     - hostname: s7-t23-sut1.
661     - IPMI IP: 10.30.50.51
662     - Host IP: 10.30.51.54
663     - portnames:
664         - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
665         - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
666         - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
667         - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
668         - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
669         - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
670         - s7-t23-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
671         - s7-t23-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
672 - ServerB8 [Type-B2]:
673     - testbedname: testbed23.
674     - hostname: s8-t23-tg1.
675     - IPMI IP: 10.30.50.52
676     - Host IP: 10.30.51.55
677     - portnames:
678         - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
679         - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
680         - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
681         - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
682         - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
683         - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
684         - s8-t23-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
685         - s8-t23-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
686 - ServerB9 [Type-B1]:
687     - testbedname: testbed24.
688     - hostname: s9-t24-sut1.
689     - IPMI IP: 10.30.50.53
690     - Host IP: 10.30.51.56
691     - portnames:
692         - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
693         - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
694         - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
695         - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
696         - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
697         - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
698         - s9-t24-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
699         - s9-t24-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
700 - ServerB10 [Type-B2]:
701     - testbedname: testbed24.
702     - hostname: s10-t24-tg1.
703     - IPMI IP: 10.30.50.54
704     - Host IP: 10.30.51.57
705     - portnames:
706         - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
707         - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
708         - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
709         - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
710         - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
711         - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
712         - s10-t24-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
713         - s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
714 ```
715
716 #### 2-Node-Denverton (2n-dnv) TODO
717
718 ```
719 To be completed.
720 ```
721
722 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
723
724 ```
725 - ServerB25 [Type-B8]:
726     - testbedname: testbed25.
727     - hostname: s25-t25-sut1.
728     - IPMI IP: 10.30.50.58
729     - Host IP: 10.30.51.61
730     - portnames:
731         - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
732         - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
733         - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
734         - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
735 - ServerB26 [Type-B7]:
736     - testbedname: testbed25.
737     - hostname: s26-t25-tg1.
738     - IPMI IP: 10.30.50.59
739     - Host IP: 10.30.51.62
740     - portnames:
741         - s26-t25-tg1-p1 - 10GE-port1.
742         - s26-t25-tg1-p2 - 10GE-port2.
743         - s26-t25-tg1-p3 - 10GE-port3.
744         - s26-t25-tg1-p4 - 10GE-port4.
745 ```
746
747 #### 3-Node-Haswell (3n-hsw) PROD
748
749 ```
750  1. Server1 of Type-1:
751     - testbedname: testbed1.
752     - hostname: t1-sut1.
753     - CIMC IP: 10.30.50.17
754     - Host IP: 10.30.51.17
755     - portnames:
756         - t1-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
757         - t1-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
758         - t1-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
759         - t1-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
760         - t1-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
761         - t1-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
762         - t1-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
763         - t1-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
764         - t1-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
765         - t1-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
766  2. Server2 of Type-1:
767     - testbedname: testbed1.
768     - hostname: t1-sut2.
769     - CIMC IP: 10.30.50.18
770     - Host IP: 10.30.51.18
771     - portnames:
772         - t1-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
773         - t1-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
774         - t1-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
775         - t1-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
776         - t1-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
777         - t1-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
778         - t1-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
779         - t1-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
780         - t1-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
781         - t1-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
782  3. Server3 of Type-2:
783     - testbedname: testbed1.
784     - hostname: t1-tg1.
785     - CIMC IP: 10.30.50.16
786     - Host IP: 10.30.51.16
787     - portnames:
788         - t1-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
789         - t1-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
790         - t1-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
791         - t1-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
792         - t1-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
793         - t1-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
794         - t1-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
795         - t1-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
796         - t1-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
797         - t1-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
798         - t1-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
799         - t1-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
800  4. Server4 of Type-1:
801     - testbedname: testbed2.
802     - hostname: t2-sut1.
803     - CIMC IP: 10.30.50.21
804     - Host IP: 10.30.51.21
805     - portnames:
806         - t2-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
807         - t2-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
808         - t2-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
809         - t2-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
810         - t2-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
811         - t2-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
812         - t2-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
813         - t2-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
814         - t2-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
815         - t2-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
816  5. Server5 of Type-1:
817     - testbedname: testbed2.
818     - hostname: t2-sut2.
819     - CIMC IP: 10.30.50.22
820     - Host IP: 10.30.51.22
821     - portnames:
822         - t2-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
823         - t2-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
824         - t2-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
825         - t2-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
826         - t2-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
827         - t2-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
828         - t2-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
829         - t2-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
830         - t2-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
831         - t2-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
832  6. Server6 of Type-2:
833     - testbedname: testbed2.
834     - hostname: t2-tg1.
835     - CIMC IP: 10.30.50.20
836     - Host IP: 10.30.51.20
837     - portnames:
838         - t2-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
839         - t2-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
840         - t2-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
841         - t2-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
842         - t2-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
843         - t2-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
844         - t2-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
845         - t2-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
846         - t2-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
847         - t2-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
848         - t2-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
849         - t2-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
850  7. Server7 of Type-1:
851     - testbedname: testbed3.
852     - hostname: t3-sut1.
853     - CIMC IP: 10.30.50.25
854     - Host IP: 10.30.51.25
855     - portnames:
856         - t3-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
857         - t3-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
858         - t3-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
859         - t3-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
860         - t3-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
861         - t3-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
862         - t3-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
863         - t3-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
864         - t3-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
865         - t3-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
866  8. Server8 of Type-1:
867     - testbedname: testbed3.
868     - hostname: t3-sut2.
869     - CIMC IP: 10.30.50.26
870     - Host IP: 10.30.51.26
871     - portnames:
872         - t3-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
873         - t3-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
874         - t3-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
875         - t3-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
876         - t3-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
877         - t3-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
878         - t3-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
879         - t3-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
880         - t3-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
881         - t3-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
882  9. Server9 of Type-2:
883     - testbedname: testbed3.
884     - hostname: t3-tg1.
885     - CIMC IP: 10.30.50.24
886     - Host IP: 10.30.51.24
887     - portnames:
888         - t3-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
889         - t3-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
890         - t3-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
891         - t3-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
892         - t3-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
893         - t3-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
894         - t3-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
895         - t3-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
896         - t3-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
897         - t3-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
898         - t3-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
899         - t3-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
900 ```
901
902 #### 3-Node-Skylake (3n-skx) PROD
903
904 ```
905 - ServerB11 [Type-B1]:
906     - testbedname: testbed31.
907     - hostname: s11-t31-sut1.
908     - IPMI IP: 10.30.50.43
909     - Host IP: 10.30.51.46
910     - portnames:
911         - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
912         - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
913         - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
914         - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
915         - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
916         - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
917         - s11-t31-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
918         - s11-t31-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
919 - ServerB12 [Type-B1]:
920     - testbedname: testbed31.
921     - hostname: s12-t31-sut2.
922     - IPMI IP: 10.30.50.44
923     - Host IP: 10.30.51.47
924     - portnames:
925         - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
926         - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
927         - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
928         - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
929         - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
930         - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
931         - s12-t31-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
932         - s12-t31-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
933 - ServerB13 [Type-B2]:
934     - testbedname: testbed31.
935     - hostname: s13-t31-tg1.
936     - IPMI IP: 10.30.50.45
937     - Host IP: 10.30.51.48
938     - portnames:
939         - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
940         - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
941         - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
942         - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
943         - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
944         - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
945         - s13-t31-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
946         - s13-t31-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
947 - ServerB14 [Type-B1]:
948     - testbedname: testbed32.
949     - hostname: s14-t32-sut1.
950     - IPMI IP: 10.30.50.55
951     - Host IP: 10.30.51.58
952     - portnames:
953         - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
954         - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
955         - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
956         - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
957         - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
958         - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
959         - s14-t32-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
960         - s14-t32-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
961 - ServerB15 [Type-B1]:
962     - testbedname: testbed32.
963     - hostname: s15-t32-sut2.
964     - IPMI IP: 10.30.50.56
965     - Host IP: 10.30.51.59
966     - portnames:
967         - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
968         - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
969         - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
970         - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
971         - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
972         - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
973         - s15-t32-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
974         - s15-t32-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
975 - ServerB16 [Type-B2]:
976     - testbedname: testbed32.
977     - hostname: s16-t32-tg1.
978     - IPMI IP: 10.30.50.57
979     - Host IP: 10.30.51.60
980     - portnames:
981         - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
982         - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
983         - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
984         - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
985         - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
986         - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
987         - s16-t32-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
988         - s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
989 ```
990
991 Note: ServerB19 (TG) is shared between testbed33 & testbed34
992
993 #### 3-Node-Rangeley (3n-rng) VERIFY
994
995 Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
996
997 ```
998 - ServerB22 [Type-B5]:
999     - testbedname: testbed35.
1000     - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1).
1001     - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0
1002     - Host IP: 10.30.51.9
1003     - portnames:
1004         - s22-t35-sut1-p1 - 10GE-port1 ix0 82599.
1005         - s22-t35-sut1-p2 - 10GE-port2 ix1 82599.
1006     - 1GB ports (tbd)
1007 - ServerB23 [Type-B5]:
1008     - testbedname: testbed35.
1009     - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2).
1010     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1
1011     - Host IP: 10.30.51.10
1012     - portnames:
1013         - s23-t35-sut1-p1 - 10GE-port1 ix0 82599.
1014         - s23-t35-sut1-p2 - 10GE-port2 ix1 82599.
1015     - 1GB ports (tbd)
1016 - ServerB24 [Type-B5]:
1017     - testbedname: testbed35.
1018     - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3).
1019     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2
1020     - Host IP: 10.30.51.11
1021     - portnames:
1022         - s24-t35-sut1-p1 - 10GE-port1 ix0 82599.
1023         - s24-t35-sut1-p2 - 10GE-port2 ix1 82599.
1024     - 1GB ports (tbd)
1025 ```
1026
1027 #### 3-Node-Taishan (3n-tsh) WIP
1028
1029 ```
1030 - ServerB17 [Type-B3]:
1031     - testbedname: testbed33.
1032     - hostname: s17-t33-sut1.
1033     - IPMI IP: 10.30.50.36
1034     - Host IP: 10.30.51.36
1035     - portnames:
1036         - s17-t33-sut1-c6/p1 - 10GE-port1 82599-2p10GE.
1037         - s17-t33-sut1-c6/p2 - 10GE-port2 82599-2p10GE.
1038         - s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE.
1039         - s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE.
1040 - ServerB18 [Type-B3]:
1041     - testbedname: testbed33.
1042     - hostname: s18-t33-sut2.
1043     - IPMI IP: 10.30.50.37
1044     - Host IP: 10.30.51.37
1045     - portnames:
1046         - s18-t33-sut2-c6/p1 - 10GE-port1 82599-2p10GE.
1047         - s18-t33-sut2-c6/p2 - 10GE-port2 82599-2p10GE.
1048         - s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE.
1049         - s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE.
1050 - ServerB19 [Type-B2]:
1051     - testbednames: testbed33 and testbed34.
1052     - hostname: s19-t33t34-tg1.
1053     - IPMI IP: 10.30.50.46
1054     - Host IP: 10.30.51.49
1055     - portnames:
1056         - s19-t33t34-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
1057         - s19-t33t34-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
1058         - s19-t33t34-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
1059         - s19-t33t34-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
1060         - s19-t33t34-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
1061         - s19-t33t34-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
1062         - s19-t33t34-tg1-c10/p1 - 10GE-port1 x710-4p10GE.
1063         - s19-t33t34-tg1-c10/p2 - 10GE-port2 x710-4p10GE.
1064         - s19-t33t34-tg1-c10/p3 - 10GE-port3 x710-4p10GE.
1065         - s19-t33t34-tg1-c10/p4 - 10GE-port4 x710-4p10GE.
1066 - ServerB20 [Type-B4]:
1067     - testbedname: testbed34.
1068     - hostname: s20-t34-sut1.
1069     - IPMI IP: N/A
1070     - Host IP: 10.30.51.41
1071     - portnames:
1072         - s20-t34-sut1-ca/p1 - 10GE-port1 Marvell.
1073         - s20-t34-sut1-ca/p2 - 10GE-port2 Marvell.
1074 - ServerB21 [Type-B4]:
1075     - testbedname: testbed34.
1076     - hostname: s21-t34-sut2.
1077     - IPMI IP: N/A
1078     - Host IP: 10.30.51.42
1079     - portnames:
1080         - s21-t34-sut2-ca/p1 - 10GE-port1 Marvell.
1081         - s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
1082 ```
1083
1084 #### 3-Node-Mcbin (3n-mcb) TODO
1085
1086 ```
1087 To be completed.
1088 ```
1089
1090 ### Per Testbed Wiring
1091
1092 #### 1-Node-Skylake (1n-skx) PROD
1093
1094 ```
1095 - testbed11:
1096     - ring1 10GE-ports x710-4p10GE:
1097         - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1.
1098     - ring2 10GE-ports x710-4p10GE:
1099         - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2.
1100     - ring3 10GE-ports x710-4p10GE:
1101         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1102     - ring4 10GE-ports x710-4p10GE:
1103         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1104 - testbed12:
1105     - ring1 10GE-ports x710-4p10GE:
1106         - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1.
1107     - ring2 10GE-ports x710-4p10GE:
1108         - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2.
1109     - ring3 10GE-ports x710-4p10GE:
1110         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1111     - ring4 10GE-ports x710-4p10GE:
1112         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1113 ```
1114
1115 #### 1-Node-Thunderx2 (1n-tx2) WIP
1116
1117 ```
1118 - testbed13:
1119     - ring1 40GE-ports XL710-QDA2-2p40GE on SUTs:
1120         - s27-t13-sut1-c1/p2 - s27-t13-sut1-c3/p1.
1121     - ring2 40GE-ports XL710-QDA2-2p40GE on SUTs:
1122         - s27-t13-sut1-c3/p2 - s27-t13-sut1-c6/p1.
1123     - ring3 40GE-ports XL710-QDA2-2p40GE on SUTs:
1124         - s27-t13-sut1-c6/p2 - s27-t13-sut1-c1/p1.
1125 ```
1126
1127 #### 2-Node-Skylake (2n-skx) PROD
1128
1129 ```
1130 - testbed21:
1131     - ring1 10GE-ports x710-4p10GE on SUT:
1132         - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1.
1133         - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2.
1134     - ring2 10GE-ports x710-4p10GE on SUT:
1135         - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3.
1136         - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4.
1137     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1138         - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1.
1139         - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2.
1140     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1141         - s4-t21-tg1-c9/p1 to s3-t21-sut1-c9/p1.
1142         - s3-t21-sut1-c9/p2 to s4-t21-tg1-c9/p2.
1143     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1144         - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2.
1145         - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4.
1146 - testbed22:
1147     - ring1 10GE-ports x710-4p10GE on SUT:
1148         - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1.
1149         - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2.
1150     - ring2 10GE-ports x710-4p10GE on SUT:
1151         - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3.
1152         - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4.
1153     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1154         - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1.
1155         - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2.
1156     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1157         - t22-tg1-c9/p1 to s5-t22-sut1-c9/p1.
1158         - s5-t22-sut1-c9/p2 to s6-t22-tg1-c9/p2.
1159     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1160         - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2.
1161         - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4.
1162 - testbed23:
1163     - ring1 10GE-ports x710-4p10GE on SUT:
1164         - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1.
1165         - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2.
1166     - ring2 10GE-ports x710-4p10GE on SUT:
1167         - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3.
1168         - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4.
1169     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1170         - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1.
1171         - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2.
1172     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1173         - s8-t23-tg1-c9/p1 to s7-t23-sut1-c9/p1.
1174         - s7-t23-sut1-c9/p2 to s8-t23-tg1-c9/p2.
1175     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1176         - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2.
1177         - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4.
1178 - testbed24:
1179     - ring1 10GE-ports x710-4p10GE on SUT:
1180         - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1.
1181         - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2.
1182     - ring2 10GE-ports x710-4p10GE on SUT:
1183         - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3.
1184         - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4.
1185     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1186         - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1.
1187         - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2.
1188     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1189         - s10-t24-tg1-c9/p1 to s9-t24-sut1-c9/p1.
1190         - s9-t24-sut1-c9/p2 to s10-t24-tg1-c9/p2.
1191     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1192         - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2.
1193         - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
1194 ```
1195
1196 #### 2-Node-Denverton (2n-dnv) TODO
1197
1198 ```
1199 To be completed.
1200 ```
1201
1202 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
1203
1204 ```
1205 - testbed25:
1206     - link1 10GE-port x710-4p10GE on SUT:
1207         - t25-tg1-p1 to t25-sut1-c2/p1.
1208     - link2 10GE-port x710-4p10GE on SUT:
1209         - t25-tg1-p2 to t25-sut1-c2/p2.
1210     - link3 10GE-port x710-4p10GE on SUT:
1211         - t25-tg1-p3 to t25-sut1-c2/p3.
1212     - link4 10GE-port x710-4p10GE on SUT:
1213         - t25-tg1-p4 to t25-sut1-c2/p4.
1214 ```
1215
1216 #### 3-Node-Haswell (3n-hsw) PROD
1217
1218 ```
1219  1. testbed1:
1220     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1221         - t1-tg1-c1/p1 to t1-sut1-c1/p2.
1222         - t1-sut1-c1/p1 to t1-sut2-c1/p2.
1223         - t1-sut2-c1/p1 to t1-tg1-c1/p2.
1224     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1225         - t1-tg1-c2/p1 to t1-sut1-c2/p2.
1226         - t1-sut1-c2/p1 to t1-sut2-c2/p2.
1227         - t1-sut2-c2/p1 to t1-tg1-c2/p2.
1228     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1229         - t1-tg1-c4/p1 to t1-sut1-c4/p2.
1230         - t1-sut1-c4/p1 to t1-sut2-c4/p2.
1231         - t1-sut2-c4/p1 to t1-tg1-c4/p2.
1232     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1233         - t1-tg1-c5/p1 to t1-sut1-c5/p2.
1234         - t1-sut1-c5/p1 to t1-sut2-c5/p2.
1235         - t1-sut2-c5/p1 to t1-tg1-c5/p2.
1236     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1237         - t1-tg1-c2/p1 to t1-sut1-cm/p2.
1238         - t1-sut1-cm/p1 to t1-sut2-cm/p2.
1239         - t1-sut2-cm/p1 to t1-tg1-c2/p2.
1240     - TG loopback ports Intel NIC x710 2p10GE
1241         - t1-tg1-c6/p1 to t1-tg1-c6/p2.
1242
1243  2. testbed2:
1244     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1245         - t2-tg1-c1/p1 to t2-sut1-c1/p2.
1246         - t2-sut1-c1/p1 to t2-sut2-c1/p2.
1247         - t2-sut2-c1/p1 to t2-tg1-c1/p2.
1248     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1249         - t2-tg1-c2/p1 to t2-sut1-c2/p2.
1250         - t2-sut1-c2/p1 to t2-sut2-c2/p2.
1251         - t2-sut2-c2/p1 to t2-tg1-c2/p2.
1252     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1253         - t2-tg1-c4/p1 to t2-sut1-c4/p2.
1254         - t2-sut1-c4/p1 to t2-sut2-c4/p2.
1255         - t2-sut2-c4/p1 to t2-tg1-c4/p2.
1256     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1257         - t2-tg1-c5/p1 to t2-sut1-c5/p2.
1258         - t2-sut1-c5/p1 to t2-sut2-c5/p2.
1259         - t2-sut2-c5/p1 to t2-tg1-c5/p2.
1260     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1261         - t2-tg1-c2/p1 to t2-sut1-cm/p2.
1262         - t2-sut1-cm/p1 to t2-sut2-cm/p2.
1263         - t2-sut2-cm/p1 to t2-tg1-c2/p2.
1264     - TG loopback ports Intel NIC x710 2p10GE
1265         - t2-tg1-c6/p1 to t2-tg1-c6/p2.
1266
1267  3. testbed3:
1268     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1269         - t3-tg1-c1/p1 to t3-sut1-c1/p2.
1270         - t3-sut1-c1/p1 to t3-sut2-c1/p2.
1271         - t3-sut2-c1/p1 to t3-tg1-c1/p2.
1272     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1273         - t3-tg1-c2/p1 to t3-sut1-c2/p2.
1274         - t3-sut1-c2/p1 to t3-sut2-c2/p2.
1275         - t3-sut2-c2/p1 to t3-tg1-c2/p2.
1276     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1277         - t3-tg1-c4/p1 to t3-sut1-c4/p2.
1278         - t3-sut1-c4/p1 to t3-sut2-c4/p2.
1279         - t3-sut2-c4/p1 to t3-tg1-c4/p2.
1280     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1281         - t3-tg1-c5/p1 to t3-sut1-c5/p2.
1282         - t3-sut1-c5/p1 to t3-sut2-c5/p2.
1283         - t3-sut2-c5/p1 to t3-tg1-c5/p2.
1284     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1285         - t3-tg1-c2/p1 to t3-sut1-cm/p2.
1286         - t3-sut1-cm/p1 to t3-sut2-cm/p2.
1287         - t3-sut2-cm/p1 to t3-tg1-c2/p2.
1288     - TG loopback ports Intel NIC x710 2p10GE
1289         - t3-tg1-c6/p1 to t3-tg1-c6/p2.
1290 ```
1291
1292 #### 3-Node-Skylake (3n-skx) PROD
1293
1294 ```
1295 - testbed31:
1296     - ring1 10GE-ports x710-4p10GE on SUTs:
1297         - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1.
1298         - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2.
1299         - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2.
1300     - ring2 10GE-ports x710-4p10GE on SUT:
1301         - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3.
1302         - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4.
1303         - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4.
1304     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1305         - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1.
1306         - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2.
1307         - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2.
1308     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1309         - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1.
1310         - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2.
1311         - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2.
1312     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1313         - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2.
1314         - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4.
1315 - testbed32:
1316     - ring1 10GE-ports x710-4p10GE on SUTs:
1317         - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1.
1318         - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2.
1319         - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2.
1320     - ring2 10GE-ports x710-4p10GE on SUT:
1321         - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3.
1322         - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4.
1323         - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4.
1324     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1325         - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1.
1326         - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2.
1327         - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2.
1328     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1329         - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1.
1330         - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2.
1331         - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2.
1332     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1333         - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2.
1334         - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4.
1335 ```
1336
1337 #### 3-Node-Rangeley (3n-rng) TODO
1338
1339 ```
1340 To be completed.
1341 ```
1342
1343 #### 3-Node-Taishan (3n-tsh) WIP
1344
1345 ```
1346 - testbed33:
1347     - ring1 10GE-ports 82599-2p10GE on SUTs:
1348         - t33t34-tg1-c2/p2 - t33-sut1-c6/p2.
1349         - t33-sut1-c6/p1 - t33-sut2-c6/p2.
1350         - t33-sut2-c6/p1 - t33t34-tg1-c2/p1.
1351     - ring2 25GE-ports cx4-2p25GE on SUTs:
1352         - t33t34-tg1-c4/p2 - t33-sut1-c4/p2.
1353         - t33-sut1-c4/p1 - t33-sut2-c4/p2.
1354         - t33-sut2-c4/p1 - t33t34-tg1-c4/p1.
1355 ```
1356
1357 #### 3-Node-Mcbin (3n-mcb) WIP
1358
1359 ```
1360 - testbed34:
1361     - ring1 10GE-ports Marvell on SUTs:
1362         - t33t34-tg1-c2/p3 - t34-sut1-ca/p1.
1363         - t34-sut1-ca/p2 - t34-sut2-ca/p1.
1364         - t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
1365 ```
1366
1367 ## Inventory
1368
1369 ### Appliances
1370
1371 ```
1372 1. Ixia PerfectStorm One Appliance
1373     - 1 * PS10GE4NG
1374         - Chassis: PS10GE4NG.
1375         - Motherboard: SuperMicro X11DPG-QT.
1376         - Processors: Quad-Core, Intel Processor.
1377         - HW accelerators: FPGA offload.
1378         - RAM Memory: 64GB.
1379         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
1380         - Physical Interfaces: 4 * 10GE SFP+.
1381         - Operating System: Native IxOS.
1382 ```
1383
1384 ### Arm Servers
1385
1386 ```
1387 1. Arm Cortex A-72 servers
1388     - 1 * ThunderX2
1389         - Chassis: Marvell ThunderX2
1390         - Processors: 2* ThunderX2 CN9975 ~ 112* ThunderX2.
1391         - RAM Memory: 4* 32GB RDIMM
1392         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
1393     - 2 * Huawei TaiShan 2280.
1394         - Chassis: Huawei TaiShan 2280.
1395         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72.
1396         - RAM Memory: 8* 16GB DDR4-2400MT/s.
1397         - Disks: 1* 4TB SATA HDD.
1398     - 3 * MACCHIATObin
1399         - Chassis: MACCHIATObin.
1400         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72.
1401         - RAM Memory: 1* 16GB DDR4.
1402         - Disks: 1* 128GB(?) SATA SDD.
1403 ```
1404
1405 ### Xeon and Atom Servers
1406
1407 ```
1408 1. Intel Xeon servers:
1409     - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors.
1410         - Chassis: SuperMicro SYS-7049GP-TRT.
1411         - Motherboard: SuperMicro X11DPG-QT.
1412         - Processors: 2* Intel Platinum 8180 2.3 GHz.
1413         - RAM Memory: 16* 16GB DDR4-2666MHz.
1414         - Disks: 2* 1.6TB 6G SATA SSD.
1415 2. Intel Atom servers with Rangely processors.
1416     - 3 * Netgate XG-2758-1u
1417         - Chassis: Netgate XG-2758-1u
1418         - Processors: 1* Rangely (Atom) C2758 2.4 GHz
1419         - RAM Memory: 16GB ECC
1420         - Disks: 150 GB
1421 ```
1422
1423 ### Network Interface Cards
1424
1425 ```
1426 1. 10GE NICs
1427     - 14 * Intel® Ethernet Converged Network Adapter X710-DA4
1428     - 6 * Intel® Ethernet Converged Network Adapter X710-DA2
1429     - 6 * Intel® Ethernet Converged Network Adapter X520-DA2
1430 2. 25GE NICs
1431     - 12 * Intel® Ethernet Network Adapter XXV710-DA2
1432 3. 40GE NICs
1433     - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2
1434 4. 100GE NICs
1435     - 4 * mcx556a-edat NICs (not on site yet, in transit)
1436 ```
1437
1438 ### Pluggables and Cables
1439
1440 Pluggables:
1441
1442 ```
1443 1. 10GE SFP+
1444     - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics
1445     - 80 * 10G SR optic (generic, "Intel" compatible branded)
1446 2. 25GE SFP28
1447     - None
1448 3. 40GE QSFP+
1449     - None
1450 4. 100GE
1451     - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit)
1452 ```
1453
1454 Standalone cables:
1455
1456 ```
1457 1. 10GE
1458     - None
1459 2. 25GE
1460     - None
1461 3. 40GE QSFP+
1462     - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable
1463 4. 100GE
1464     - None
1465 ```
1466
1467 ### Other Parts
1468
1469 None.