docs/lab: re-fixed TOC hyperlinks and editing nits
[csit.git] / docs / lab / testbed_specifications.md
1 # FD.io CSIT Testbed Specifications
2
3 1. [Purpose](#purpose)
4 1. [Testbeds Overview](#testbeds-overview)
5    1. [Summary List](#summary-list)
6    1. [1-Node-Skylake Xeon Intel (1n-skx)](#1-node-skylake-xeon-intel-1n-skx)
7    1. [1-Node-ThunderX2 Arm Marvell (1n-tx2)](#1-node-thunderx2-arm-marvell-1n-tx2)
8    1. [2-Node-Skylake Xeon Intel (2n-skx)](#2-node-skylake-xeon-intel-2n-skx)
9    1. [2-Node-Denverton Atom Intel (2n-dnv)](#2-node-denverton-atom-intel-2n-dnv)
10    1. [2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)](#2-node-ixiaps1l47-ixia-psone-l47-2n-ps1)
11    1. [3-Node-Haswell Xeon Intel (3n-skx)](#3-node-haswell-xeon-intel-3n-skx)
12    1. [3-Node-Skylake Xeon Intel (3n-skx)](#3-node-skylake-xeon-intel-3n-skx)
13    1. [3-Node-TaiShan Arm Huawei (3n-tsh)](#3-node-taishan-arm-huawei-3n-tsh)
14    1. [3-Node-MACCHIATObin Arm Marvell](#3-node-macchiatobin-arm-marvell)
15    1. [3-Node-Rangeley Atom Testbeds](#3-node-rangeley-atom-testbeds)
16 1. [Server Management](#server-management)
17    1. [Requirements](#requirements)
18    1. [Addressing](#addressing)
19    1. [LOM (IPMI) VLAN IP Addresses](#lom-ipmi-vlan-ip-addresses)
20    1. [Management VLAN IP Addresses](#management-vlan-ip-addresses)
21 1. [Server Type Specification](#server-type-specification)
22    1. [Server and Port Naming](#server-and-port-naming)
23 1. [Testbeds Configuration](#testbeds-configuration)
24    1. [Per Testbed Server Allocation and Naming](#per-testbed-server-allocation-and-naming)
25       1. [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
26       1. [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
27       1. [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
28       1. [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
29       1. [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
30       1. [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
31       1. [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
32       1. [3-Node-Rangeley (3n-rng) VERIFY](#3-node-rangeley-3n-rng-verify)
33       1. [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
34       1. [3-Node-Mcbin (3n-mcb) TODO](#3-node-mcbin-3n-mcb-todo)
35    1. [Per Testbed Wiring](#per-testbed-wiring)
36       1. [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
37       1. [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
38       1. [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
39       1. [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
40       1. [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
41       1. [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
42       1. [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
43       1. [3-Node-Rangeley (3n-rng) TODO](#3-node-rangeley-3n-rng-todo)
44       1. [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
45       1. [3-Node-Mcbin (3n-mcb) WIP](#3-node-mcbin-3n-mcb-wip)
46 1. [Inventory](#inventory)
47    1. [Appliances](#appliances)
48    1. [Arm Servers](#arm-servers)
49    1. [Xeon and Atom Servers](#xeon-and-atom-servers)
50    1. [Network Interface Cards](#network-interface-cards)
51    1. [Pluggables and Cables](#pluggables-and-cables)
52    1. [Other Parts](#other-parts)
53
54 ## Purpose
55
56 This note includes specification of the physical testbed infrastructure
57 hosted by LFN FD.io CSIT project.
58
59 ## Testbeds Overview
60
61 ### Summary List
62
63 ```
64  #. CSIT_tb          Purpose  SUT   TG    #TB  #SUT #TG  #hsw #skx #ps1 #rng #dnv #tx2 #tsh #mcb
65  1. 1-Node-Skylake     func   skx   na    2    2    0    0    2    0    0    0    0    0    0
66  2. 1-Node-Thunderx2   func   tx2   na    1    1    0    0    0    0    0    0    1    0    0
67  3. 2-Node-Skylake     perf   skx   skx   4    4    4    0    8    0    0    0    0    0    0
68  4. 2-Node-Denverton   perf   dnv   skx   1    1    1    0    .5   0    0    1    0    0    0
69  5. 2-Node-IxiaPS1L47  tcp    skx   ps1   1    1    1    0    1    1    0    0    0    0    0
70  6. 3-Node-Haswell     perf   hsw   hsw   3    6    3    9    0    0    0    0    0    0    0
71  7. 3-Node-Skylake     perf   skx   skx   2    4    2    0    6    0    0    0    0    0    0
72  8. 3-Node-Rangeley    perf   rng   skx   1    3    1    0    0    0    2    0    0    0    0
73  9. 3-Node-Taishan     perf   tsh   skx   1    2    1    0    .5   0    0    0    0    2    0
74 10. 3-Node-Mcbin       perf   mcb   skx   1    2    1    0    .5   0    0    0    0    0    2
75 11. 1-Node-VIRL        func   hsw   ---   3    3    0    3    0    0    0    0    0    0    0
76                                  Totals: 17   26   14   12   19    1    2    1    1    2    2
77 ```
78
79 ### 1-Node-Skylake Xeon Intel (1n-skx)
80
81 Each 1-Node-Skylake testbed includes one SUT (Type-B6 server) with NIC
82 ports connected back-to-back.
83 Used for FD.io VPP_Device functional driver tests.
84
85 ### 1-Node-ThunderX2 Arm Marvell (1n-tx2)
86
87 Each 1-Node-ThunderX2 testbed includes one SUT (Type-B9 server) with NIC
88 ports connected back-to-back.
89 Used for FD.io VPP_Device functional driver tests.
90
91 ### 2-Node-Skylake Xeon Intel (2n-skx)
92
93 Each 2-Node-Skylake testbed includes one SUT (Type-B1 server) and one TG
94 (Type-B2 server) connected back-to-back.
95 Used for FD.io performance tests.
96
97 ### 2-Node-Denverton Atom Intel (2n-dnv)
98
99 Each 2-Node-Skylake testbed includes one SUT (Type-B10 server) and one TG
100 (Type-B2 server) connected back-to-back.
101 Used for FD.io performance tests.
102
103 ### 2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)
104
105 Each 2-Node-IxiaPS1L47 testbed includes one SUT (Type-B1 server) and one
106 TG (Ixia PSOne appliance) with 10GE interfaces connected back-to-back.
107 Used for FD.io TCP/IP and HTTP performance tests.
108
109 ### 3-Node-Haswell Xeon Intel (3n-hsw)
110
111 Each 3-Node-Haswell testbed includes two SUTs (Type-A1 servers) and one
112 TG (Type-A2 server) connected in full-mesh triangle.
113 Used for FD.io performance tests.
114
115 ### 3-Node-Skylake Xeon Intel (3n-skx)
116
117 Each 3-Node-Skylake testbed includes two SUTs (Type-B1 servers) and one
118 TG (Type-B2 server) connected in full-mesh triangle.
119 Used for FD.io performance tests.
120
121 ### 3-Node-TaiShan Arm Huawei (3n-tsh)
122
123 Each 3-Node-TaiShan testbed includes two SUTs (Type-B3 server) and one TG
124 (Type-B2 server) connected in full-mesh triangle.
125 Used for FD.io performance tests.
126
127 ### 3-Node-MACCHIATObin Arm Marvell
128
129 Each 3-Node-MACCHIATObin testbed includes two SUTs (Type-B4 server) and
130 one TG (Type-B2 server) connected in full-mesh triangle.
131 Used for FD.io performance tests.
132
133 ### 3-Node-Rangeley Atom Testbeds
134
135 Each 3-Node-Rangeley testbed includes two SUTs (Type-B5 Netgate device)
136 and one TG (Type-2 server) connected in full-mesh triangle.
137 Used for FD.io performance tests.
138
139 ## Server Management
140
141 ### Requirements
142
143 For management purposes, each server must have following two ports
144 connected to the management network:
145
146 ```
147 - 1GE IPMI port
148   - IPMI - Intelligent Platform Management Interface.
149   - Required for access to embedded server management with WebUI, CLI, SNMPv3,
150     IPMIv2.0, for firmware (BIOS) and OS updates.
151 - 1GE/10GE/40GE management port
152   - hostOS management port for general system management.
153 ```
154
155 ### Addressing
156
157 Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management
158 port, which are connected to two different VLANs.
159
160 ```
161 1. LOM (IPMI) VLAN:
162     - Subnet: 10.30.50.0/24
163     - Gateway: 10.30.50.1
164     - Broadcast: 10.30.50.255
165     - DNS1: 199.204.44.24
166     - DNS2: 199.204.47.54
167 2. Management Vlan:
168     - Subnet: 10.30.51.0/24
169     - Gateway: 10.30.51.1
170     - Broadcast: 10.30.51.255
171     - DNS1: 199.204.44.24
172     - DNS2: 199.204.47.54
173 ```
174
175 To access these hosts, VPN connection is required.
176
177 ### LOM (IPMI) VLAN IP Addresses
178
179 Name         | Comment
180 ------------ | -------
181 10.30.50.0   | network
182 10.30.51.1   | Router
183 10.30.50.2   | LF Reserved
184 10.30.50.3   | LF Reserved
185 10.30.50.4   | LF Reserved
186 10.30.50.5   | LF Reserved
187 10.30.50.6   | LF Reserved
188 10.30.50.7   | LF Reserved
189 10.30.50.8   | LF Reserved
190 10.30.50.9   | LF Reserved
191 10.30.50.10  | LF Reserved
192 10.30.50.11  | LF Reserved
193 10.30.50.12  | LF Reserved
194 10.30.50.13  | LF Reserved
195 10.30.50.14  | LF Reserved
196 10.30.50.15  | LF Reserved
197 10.30.50.16  | t1-tg1
198 10.30.50.17  | t1-sut1
199 10.30.50.18  | t1-sut2
200 10.30.50.20  | t2-tg1
201 10.30.50.21  | t2-sut1
202 10.30.50.22  | t2-sut2
203 10.30.50.24  | t3-tg1
204 10.30.50.25  | t3-sut1
205 10.30.50.26  | t3-sut-2
206 10.30.50.28  | t4-sut1
207 10.30.50.29  | t4-sut2
208 10.30.50.30  | t4-sut3
209 10.30.50.36  | s17-t33-sut1
210 10.30.50.37  | s18-t33-sut2
211 10.30.50.41  | s3-t21-sut1
212 10.30.50.42  | s4-t21-tg1
213 10.30.50.43  | s11-t31-sut1
214 10.30.50.44  | s12-t31-sut2
215 10.30.50.45  | s13-t31-tg1
216 10.30.50.46  | s19-t33t34-tg1
217 10.30.50.47  | s1-t11-sut1
218 10.30.50.48  | s2-t12-sut1
219 10.30.50.49  | s5-t22-sut1
220 10.30.50.50  | s6-t22-tg1
221 10.30.50.51  | s7-t23-sut1
222 10.30.50.52  | s8-t23-tg1
223 10.30.50.53  | s9-t24-sut1
224 10.30.50.54  | s10-t24-tg1
225 10.30.50.55  | s14-t32-sut1
226 10.30.50.56  | s15-t32-sut2
227 10.30.50.57  | s16-t32-tg1
228 10.30.50.58  | s25-t25-sut1
229 10.30.50.59  | s26-t25-tg1
230 10.30.50.69  | s27-t13-sut
231 10.30.50.255 | Broadcast
232
233 ### Management VLAN IP Addresses
234
235 Name                      | Comment
236 ------------------------- | -------
237 10.30.51.0                | network
238 10.30.51.1                | Router
239 10.30.51.2                | LF Reserved
240 10.30.51.3                | LF Reserved
241 10.30.51.4                | LF Reserved
242 10.30.51.5                | LF Reserved
243 10.30.51.6                | LF Reserved
244 10.30.51.7                | LF Reserved
245 10.30.51.8                | LF Reserved
246 10.30.51.9                | s22-t35-sut1 (netgate-1)
247 10.30.51.10               | s23-t35-sut2 (netgate-2)
248 10.30.51.11               | s24-t35-sut3 (netgate-3)
249 10.30.51.12               | softiron-1
250 10.30.51.13               | softiron-2
251 10.30.51.14               | softiron-3
252 10.30.51.15               | LF Reserved
253 10.30.51.16               | t1-tg1
254 10.30.51.17               | t1-sut1
255 10.30.51.18               | t1-sut2
256 10.30.51.20               | t2-tg1
257 10.30.51.21               | t2-sut1
258 10.30.51.22               | t2-sut2
259 10.30.51.24               | t3-tg1
260 10.30.51.25               | t3-sut1
261 10.30.51.26               | t3-sut-2
262 10.30.51.28               | t4-sut1
263 10.30.51.29               | t4-sut2
264 10.30.51.29               | s22-t35-sut1 screen -r /dev/ttyUSB0, TO BE VERIFIED
265 10.30.51.30               | t4-sut3
266 10.30.51.30               | s23-t35-sut2 screen -r /dev/ttyUSB1, TO BE VERIFIED
267 10.30.51.30               | s24-t35-sut3 screen -r /dev/ttyUSB2, TO BE VERIFIED
268 10.30.51.36               | s17-t33-sut1
269 10.30.51.37               | s18-t33-sut2
270 10.30.51.41               | s20-t34-sut1
271 10.30.51.42               | s21-t34-sut2
272 10.30.51.44               | s3-t21-sut1
273 10.30.51.45               | s4-t21-tg1
274 10.30.51.46               | s11-t31-sut1
275 10.30.51.47               | s12-t31-sut2
276 10.30.51.48               | s13-t31-tg1
277 10.30.51.49               | s19-t33t34-tg1
278 10.30.51.50               | s1-t11-sut1
279 10.30.51.51               | s2-t12-sut1
280 10.30.51.52               | s5-t22-sut1
281 10.30.51.53               | s6-t22-tg1
282 10.30.51.54               | s7-t23-sut1
283 10.30.51.55               | s8-t23-tg1
284 10.30.51.56               | s9-t24-sut1
285 10.30.51.57               | s10-t24-tg1
286 10.30.51.58               | s14-t32-sut1
287 10.30.51.59               | s15-t32-sut2
288 10.30.51.60               | s16-t32-tg1
289 10.30.51.61               | s25-t25-sut1
290 10.30.51.62               | s26-t25-tg1
291 10.30.51.69               | s27-t13-sut1
292 10.30.51.70-10.30.51.105  | VIRL1 TO BE VERIFIED
293 10.30.51.106-10.30.51.180 | VIRL2
294 10.30.51.181-10.30.51.254 | VIRL3
295 10.30.51.255              | Broadcast
296
297 ## Server Type Specification
298
299 FD.io CSIT lab contains following server types:
300 ```
301 1. Type-A1: Purpose - Haswell Xeon SUT (Systems Under Test) for FD.io performance testing.
302     - Quantity: 6 servers.
303     - Physical connectivity:
304         - CIMC and host management ports.
305         - NIC ports connected in 3-node topologies.
306     - Main HW configuration:
307         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
308         - Processors: 2* E5-2699v3 2.3 GHz.
309         - RAM Memory: 16* 32GB DDR4-2133MHz.
310         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
311     - NICs configuration:
312         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes)
313             - PCIe Slot1: Cisco VIC 1385 2p40GE.
314             - PCIe Slot2: Intel NIC x520 2p10GE.
315             - PCIe Slot3: empty.
316         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes)
317             - PCIe Slot4: Intel NIC xl710 2p40GE.
318             - PCIe Slot5: Intel NIC x710 2p10GE.
319             - PCIe Slot6: Intel QAT 8950 50G (Walnut Hill)
320         - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
321 2. Type-A2: Purpose - Haswell Xeon TG (Traffic Generators) for FD.io performance testing.
322     - Quantity: 3 servers.
323     - Physical connectivity:
324         - CIMC and host management ports.
325         - NIC ports connected in 3-node topologies.
326     - Main HW configuration:
327         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
328         - Processors: 2* E5-2699v3 2.3 GHz.
329         - RAM Memory: 16* 32GB DDR4-2133MHz.
330         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
331     - NICs configuration:
332         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
333             - PCIe Slot1: Intel NIC xl710 2p40GE.
334             - PCIe Slot2: Intel NIC x710 2p10GE.
335             - PCIe Slot3: Intel NIC x710 2p10GE.
336         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
337             - PCIe Slot4: Intel NIC xl710 2p40GE.
338             - PCIe Slot5: Intel NIC x710 2p10GE.
339             - PCIe Slot6: Intel NIC x710 2p10GE.
340         - MLOM slot: empty.
341 3. Type-A3: Purpose - Haswell Xeon VIRL hosts for FD.io functional testing.
342     - Quantity: 3 servers.
343     - Physical connectivity:
344         - CIMC and host management ports.
345         - no NIC ports, standalone setup.
346     - Main HW configuration:
347         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
348         - Processors: 2* E5-2699v3 2.3 GHz.
349         - RAM Memory: 16* 32GB DDR4-2133MHz.
350         - Disks: 2* 480 GB 2.5inch 6G SATA SSD.
351     - NICs configuration:
352         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
353             - no cards.
354         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
355             - no cards.
356         - MLOM slot: empty.
357 4. Type-B1: Purpose - Skylake Xeon SUT for FD.io performance testing.
358     - Quantity: ---
359     - Physical connectivity:
360         - IPMI and host management ports.
361         - NIC ports connected into 2-node and 3-node topologies.
362     - Main HW configuration:
363         - Chassis: SuperMicro SYS-7049GP-TRT.
364         - Motherboard: SuperMicro X11DPG-QT.
365         - Processors: 2* Intel Platinum 8180 2.3 GHz.
366         - RAM Memory: 16* 16GB DDR4-2666MHz.
367         - Disks: 2* 1.6TB 6G SATA SSD.
368     - NICs configuration:
369         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
370             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
371             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
372             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
373         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
374             - PCIe Slot6 86:00.xx: empty.
375             - PCIe Slot8 af:00.xx: empty.
376             - PCIe Slot10 d8:00.xx: empty.
377 2. Type-B2: Purpose - Skylake Xeon TG for FD.io performance testing.
378     - Quantity: ---
379     - Physical connectivity:
380         - IPMI and host management ports.
381         - NIC ports connected into 2-node and 3-node topologies.
382     - Main HW configuration:
383         - Chassis: SuperMicro SYS-7049GP-TRT.
384         - Motherboard: SuperMicro X11DPG-QT.
385         - Processors: 2* Intel Platinum 8180 2.3 GHz.
386         - RAM Memory: 16* 16GB DDR4-2666MHz.
387         - Disks: 2* 1.6TB 6G SATA SSD.
388     - NICs configuration:
389         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
390             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
391             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
392             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
393         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
394             - PCIe Slot6 86:00.xx: empty.
395             - PCIe Slot8 af:00.xx: empty.
396             - PCIe Slot10 d8:00.xx: x710-4p10GE Intel.
397 3. Type-B3: Purpose - TaiShan Arm Huawei SUT for FD.io performance testing.
398     - Quantity: 2
399     - Physical connectivity:
400         - IPMI(?) and host management ports.
401         - NIC ports connected into 3-node topology.
402     - Main HW configuration:
403         - Chassis: Huawei TaiShan 2280.
404         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72
405         - RAM Memory: 8* 16GB DDR4-2400MT/s
406         - Disks: 1* 4TB SATA HDD
407     - NICs configuration:
408         - PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox.
409         - PCIe Slot6 11:00.xx: 82599-2p10GE Intel.
410 4. Type-B4: Purpose - MACCHIATObin Arm Marvell SUT for FD.io performance testing.
411     - Quantity: 3
412     - Physical connectivity:
413         - Host management ports.
414         - NIC ports connected into 2-node and 3-node topologies.
415     - Main HW configuration:
416         - Chassis: MACCHIATObin.
417         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72
418         - RAM Memory: 1* 16GB DDR4
419         - Disks: 1* 128GB(?) SATA SDD
420     - NICs configuration:
421         - pp2-2p10GE Marvell (on-chip Ethernet ports ; marvell plugin in VPP)
422 5. Type-B5: Purpose - Rangeley Atom SUT for FD.io performance testing.
423     - Quantity: TBD based on testbed allocation.
424     - Physical connectivity:
425         - Management: serial Port (usb) for console
426         - NIC ports connected into 2-node.
427     - Main HW configuration:
428         - Chassis: Netgate XG-2758-1u
429         - Processors: 1* Rangeley (Atom) C2758 2.4 GHz
430         - RAM Memory: 16GB ECC
431         - Disks: 150 GB
432     - NICs configuration:
433         - 2x 10Gb Intel 82599ES
434         - 4x 1GB Intel I354
435 6. Type-B6: Purpose - Skylake Xeon SUT for FD.io VPP_Device functional tests.
436     - Quantity: 2.
437     - Physical connectivity:
438         - IPMI and host management ports.
439         - NIC ports connected into 2-node and 3-node topologies.
440     - Main HW configuration:
441         - Chassis: SuperMicro SYS-7049GP-TRT.
442         - Motherboard: SuperMicro X11DPG-QT.
443         - Processors: 2* Intel Platinum 8180 2.3 GHz.
444         - RAM Memory: 16* 16GB DDR4-2666MHz.
445         - Disks: 2* 1.6TB 6G SATA SSD.
446     - NICs configuration:
447         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
448             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
449             - PCIe Slot4 3b:00.xx: x710-4p10GE Intel.
450             - PCIe Slot9 5e:00.xx: empty.
451         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
452             - PCIe Slot6 86:00.xx: empty.
453             - PCIe Slot8 af:00.xx: empty.
454             - PCIe Slot10 d8:00.xx: empty.
455 7. Type-B7: Purpose - Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests.
456     - Quantity: 1.
457     - Physical connectivity:
458         - Host management interface: 10/100/1000-BaseT.
459         - 8-port 10GE SFP+ integrated NIC.
460     - Main HW configuration:
461         - Chassis: PS10GE4NG.
462         - Motherboard: SuperMicro X11DPG-QT.
463         - Processors: Quad-Core, Intel Processor.
464         - HW accelerators: FPGA offload.
465         - RAM Memory: 64GB.
466         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
467         - Physical Interfaces: 4 * 10GE SFP+.
468         - Operating System: Native IxOS.
469     - Interface configuration:
470         - Port-1: 10GE SFP+.
471         - Port-2: 10GE SFP+.
472         - Port-3: 10GE SFP+.
473         - Port-4: 10GE SFP+.
474 8. Type-B8: Purpose - Skylake Xeon SUT for TCP/IP host stack tests.
475     - Quantity: 1.
476     - Physical connectivity:
477         - IPMI and host management ports.
478         - NIC ports.
479     - Main HW configuration:
480         - Chassis: SuperMicro SYS-7049GP-TRT.
481         - Motherboard: SuperMicro X11DPG-QT.
482         - Processors: 2* Intel Platinum 8180 2.3 GHz.
483         - RAM Memory: 16* 16GB DDR4-2666MHz.
484         - Disks: 2* 1.6TB 6G SATA SSD.
485     - NICs configuration:
486         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
487             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
488             - PCIe Slot4 3b:00.xx: empty.
489             - PCIe Slot9 5e:00.xx: empty.
490         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
491             - PCIe Slot6 86:00.xx: empty.
492             - PCIe Slot8 af:00.xx: empty.
493             - PCIe Slot10 d8:00.xx: empty.
494 9. Type-B9: Purpose - ThunderX2 Arm Marvell SUT for FD.io VPP_Device functional tests.
495     - Quantity: 1
496     - Physical connectivity:
497         - IPMI and host management ports.
498         - NIC ports connected into 1-node topologies.
499     - Main HW configuration:
500         - Chassis: Gigabyte R181-T90 1U
501         - Motheboard: MT91-FS1
502         - Processors: 1* ThunderX2 ARMv8 CN9975 2.0 GHz
503         - RAM Memory: 4* 32GB RDIMM
504         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
505     - NICs configuration:
506         - Numa0:
507             - PCIe Slot1 05:00.xx: XL710-QDA2.
508             - PCIe Slot3 08:00.xx: XL710-QDA2.
509         - Numa1:
510             - PCIe Slot6 85:00.xx: XL710-QDA2.
511 10. Type-B10: Purpose - Denverton Atom SUT for FD.io performance testing.
512     - Quantity: 4
513     - Physical connectivity:
514         - IPMI and host management ports.
515         - NIC ports.
516     - Main HW configuration:
517         - Chassis: SuperMicro SYS-E300-9A
518         - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
519         - RAM Memory: 32GB ECC
520         - Disks: 480 GB
521     - NICs configuration:
522         - 2x 10Gb Intel x553 fiber ports
523         - 2x 10Gb Intel x553 copper ports
524         - 4x 1GB Intel I350 ports
525 ```
526
527 ### Server and Port Naming
528
529 Following naming convention is used within this page to specify physical
530 connectivity and wiring across defined CSIT testbeds:
531
532 ```
533 - testbedname: testbedN.
534 - hostname:
535     - traffic-generator: tN-tgW.
536     - system-under-testX: tN-sutX.
537 - portnames:
538     - tN-tgW-cY/pZ.
539     - tN-sutX-cY/pZ.
540 - where:
541     - N - testbed number.
542     - tgW - server acts as traffic-generator with W index.
543     - sutX - server acts as system-under-test with X index.
544     - Y - PCIe slot number denoting a NIC card number within the host.
545     - Z - port number on the NIC card.
546 ```
547
548 ## Testbeds Configuration
549
550 ### Per Testbed Server Allocation and Naming
551
552 #### 1-Node-Skylake (1n-skx) PROD
553
554 ```
555 - ServerB1 [Type-B6]:
556     - testbedname: testbed11.
557     - hostname: s1-t11-sut1.
558     - IPMI IP: 10.30.50.47
559     - Host IP: 10.30.51.50
560     - portnames:
561         - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
562         - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
563         - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
564         - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
565         - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
566         - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
567         - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
568         - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
569 - ServerB2 [Type-B6]:
570     - testbedname: testbed12.
571     - hostname: s2-t12-sut1.
572     - IPMI IP: 10.30.50.48
573     - Host IP: 10.30.51.51
574     - portnames:
575         - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
576         - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
577         - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
578         - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
579         - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
580         - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
581         - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
582         - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
583 ```
584
585 #### 1-Node-Thunderx2 (1n-tx2) WIP
586
587 ```
588 - ServerB17 [Type-B9]:
589     - testbedname: testbed13.
590     - hostname: s27-t13-sut1.
591     - IPMI IP: 10.30.50.69
592     - Host IP: 10.30.51.69
593     - portnames:
594         - s27-t13-sut1-c1/p1 - 40GE-port1 XL710-QDA2-2p40GE.
595         - s27-t13-sut1-c1/p2 - 40GE-port2 XL710-QDA2-2p40GE.
596         - s27-t13-sut1-c3/p1 - 40GE-port1 XL710-QDA2-2p40GE.
597         - s27-t13-sut1-c3/p2 - 40GE-port2 XL710-QDA2-2p40GE.
598         - s27-t13-sut1-c6/p1 - 40GE-port1 XL710-QDA2-2p40GE.
599         - s27-t13-sut1-c6/p2 - 40GE-port2 XL710-QDA2-2p40GE.
600 ```
601
602 #### 2-Node-Skylake (2n-skx) PROD
603
604 ```
605 - ServerB3 [Type-B1]:
606     - testbedname: testbed21.
607     - hostname: s3-t21-sut1.
608     - IPMI IP: 10.30.50.41
609     - Host IP: 10.30.51.44
610     - portnames:
611         - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
612         - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
613         - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
614         - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
615         - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
616         - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
617         - s3-t21-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
618         - s3-t21-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
619 - ServerB4 [Type-B2]:
620     - testbedname: testbed21.
621     - hostname: s4-t21-tg1.
622     - IPMI IP: 10.30.50.42
623     - Host IP: 10.30.51.45
624     - portnames:
625         - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
626         - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
627         - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
628         - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
629         - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
630         - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
631         - s4-t21-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
632         - s4-t21-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
633 - ServerB5 [Type-B1]:
634     - testbedname: testbed22.
635     - hostname: s5-t22-sut1.
636     - IPMI IP: 10.30.50.49
637     - Host IP: 10.30.51.52
638     - portnames:
639         - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
640         - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
641         - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
642         - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
643         - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
644         - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
645         - s5-t22-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
646         - s5-t22-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
647 - ServerB6 [Type-B2]:
648     - testbedname: testbed22.
649     - hostname: s6-t22-tg1.
650     - IPMI IP: 10.30.50.50
651     - Host IP: 10.30.51.53
652     - portnames:
653         - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
654         - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
655         - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
656         - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
657         - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
658         - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
659         - s6-t22-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
660         - s6-t22-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
661 - ServerB7 [Type-B1]:
662     - testbedname: testbed23.
663     - hostname: s7-t23-sut1.
664     - IPMI IP: 10.30.50.51
665     - Host IP: 10.30.51.54
666     - portnames:
667         - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
668         - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
669         - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
670         - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
671         - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
672         - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
673         - s7-t23-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
674         - s7-t23-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
675 - ServerB8 [Type-B2]:
676     - testbedname: testbed23.
677     - hostname: s8-t23-tg1.
678     - IPMI IP: 10.30.50.52
679     - Host IP: 10.30.51.55
680     - portnames:
681         - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
682         - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
683         - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
684         - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
685         - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
686         - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
687         - s8-t23-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
688         - s8-t23-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
689 - ServerB9 [Type-B1]:
690     - testbedname: testbed24.
691     - hostname: s9-t24-sut1.
692     - IPMI IP: 10.30.50.53
693     - Host IP: 10.30.51.56
694     - portnames:
695         - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
696         - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
697         - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
698         - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
699         - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
700         - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
701         - s9-t24-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
702         - s9-t24-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
703 - ServerB10 [Type-B2]:
704     - testbedname: testbed24.
705     - hostname: s10-t24-tg1.
706     - IPMI IP: 10.30.50.54
707     - Host IP: 10.30.51.57
708     - portnames:
709         - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
710         - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
711         - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
712         - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
713         - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
714         - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
715         - s10-t24-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
716         - s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
717 ```
718
719 #### 2-Node-Denverton (2n-dnv) TODO
720
721 ```
722 To be completed.
723 ```
724
725 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
726
727 ```
728 - ServerB25 [Type-B8]:
729     - testbedname: testbed25.
730     - hostname: s25-t25-sut1.
731     - IPMI IP: 10.30.50.58
732     - Host IP: 10.30.51.61
733     - portnames:
734         - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
735         - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
736         - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
737         - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
738 - ServerB26 [Type-B7]:
739     - testbedname: testbed25.
740     - hostname: s26-t25-tg1.
741     - IPMI IP: 10.30.50.59
742     - Host IP: 10.30.51.62
743     - portnames:
744         - s26-t25-tg1-p1 - 10GE-port1.
745         - s26-t25-tg1-p2 - 10GE-port2.
746         - s26-t25-tg1-p3 - 10GE-port3.
747         - s26-t25-tg1-p4 - 10GE-port4.
748 ```
749
750 #### 3-Node-Haswell (3n-hsw) PROD
751
752 ```
753  1. Server1 of Type-1:
754     - testbedname: testbed1.
755     - hostname: t1-sut1.
756     - CIMC IP: 10.30.50.17
757     - Host IP: 10.30.51.17
758     - portnames:
759         - t1-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
760         - t1-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
761         - t1-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
762         - t1-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
763         - t1-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
764         - t1-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
765         - t1-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
766         - t1-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
767         - t1-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
768         - t1-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
769  2. Server2 of Type-1:
770     - testbedname: testbed1.
771     - hostname: t1-sut2.
772     - CIMC IP: 10.30.50.18
773     - Host IP: 10.30.51.18
774     - portnames:
775         - t1-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
776         - t1-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
777         - t1-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
778         - t1-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
779         - t1-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
780         - t1-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
781         - t1-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
782         - t1-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
783         - t1-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
784         - t1-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
785  3. Server3 of Type-2:
786     - testbedname: testbed1.
787     - hostname: t1-tg1.
788     - CIMC IP: 10.30.50.16
789     - Host IP: 10.30.51.16
790     - portnames:
791         - t1-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
792         - t1-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
793         - t1-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
794         - t1-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
795         - t1-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
796         - t1-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
797         - t1-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
798         - t1-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
799         - t1-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
800         - t1-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
801         - t1-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
802         - t1-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
803  4. Server4 of Type-1:
804     - testbedname: testbed2.
805     - hostname: t2-sut1.
806     - CIMC IP: 10.30.50.21
807     - Host IP: 10.30.51.21
808     - portnames:
809         - t2-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
810         - t2-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
811         - t2-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
812         - t2-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
813         - t2-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
814         - t2-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
815         - t2-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
816         - t2-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
817         - t2-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
818         - t2-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
819  5. Server5 of Type-1:
820     - testbedname: testbed2.
821     - hostname: t2-sut2.
822     - CIMC IP: 10.30.50.22
823     - Host IP: 10.30.51.22
824     - portnames:
825         - t2-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
826         - t2-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
827         - t2-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
828         - t2-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
829         - t2-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
830         - t2-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
831         - t2-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
832         - t2-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
833         - t2-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
834         - t2-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
835  6. Server6 of Type-2:
836     - testbedname: testbed2.
837     - hostname: t2-tg1.
838     - CIMC IP: 10.30.50.20
839     - Host IP: 10.30.51.20
840     - portnames:
841         - t2-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
842         - t2-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
843         - t2-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
844         - t2-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
845         - t2-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
846         - t2-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
847         - t2-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
848         - t2-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
849         - t2-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
850         - t2-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
851         - t2-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
852         - t2-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
853  7. Server7 of Type-1:
854     - testbedname: testbed3.
855     - hostname: t3-sut1.
856     - CIMC IP: 10.30.50.25
857     - Host IP: 10.30.51.25
858     - portnames:
859         - t3-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
860         - t3-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
861         - t3-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
862         - t3-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
863         - t3-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
864         - t3-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
865         - t3-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
866         - t3-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
867         - t3-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
868         - t3-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
869  8. Server8 of Type-1:
870     - testbedname: testbed3.
871     - hostname: t3-sut2.
872     - CIMC IP: 10.30.50.26
873     - Host IP: 10.30.51.26
874     - portnames:
875         - t3-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
876         - t3-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
877         - t3-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
878         - t3-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
879         - t3-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
880         - t3-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
881         - t3-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
882         - t3-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
883         - t3-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
884         - t3-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
885  9. Server9 of Type-2:
886     - testbedname: testbed3.
887     - hostname: t3-tg1.
888     - CIMC IP: 10.30.50.24
889     - Host IP: 10.30.51.24
890     - portnames:
891         - t3-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
892         - t3-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
893         - t3-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
894         - t3-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
895         - t3-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
896         - t3-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
897         - t3-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
898         - t3-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
899         - t3-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
900         - t3-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
901         - t3-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
902         - t3-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
903 ```
904
905 #### 3-Node-Skylake (3n-skx) PROD
906
907 ```
908 - ServerB11 [Type-B1]:
909     - testbedname: testbed31.
910     - hostname: s11-t31-sut1.
911     - IPMI IP: 10.30.50.43
912     - Host IP: 10.30.51.46
913     - portnames:
914         - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
915         - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
916         - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
917         - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
918         - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
919         - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
920         - s11-t31-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
921         - s11-t31-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
922 - ServerB12 [Type-B1]:
923     - testbedname: testbed31.
924     - hostname: s12-t31-sut2.
925     - IPMI IP: 10.30.50.44
926     - Host IP: 10.30.51.47
927     - portnames:
928         - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
929         - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
930         - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
931         - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
932         - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
933         - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
934         - s12-t31-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
935         - s12-t31-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
936 - ServerB13 [Type-B2]:
937     - testbedname: testbed31.
938     - hostname: s13-t31-tg1.
939     - IPMI IP: 10.30.50.45
940     - Host IP: 10.30.51.48
941     - portnames:
942         - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
943         - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
944         - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
945         - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
946         - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
947         - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
948         - s13-t31-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
949         - s13-t31-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
950 - ServerB14 [Type-B1]:
951     - testbedname: testbed32.
952     - hostname: s14-t32-sut1.
953     - IPMI IP: 10.30.50.55
954     - Host IP: 10.30.51.58
955     - portnames:
956         - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
957         - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
958         - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
959         - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
960         - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
961         - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
962         - s14-t32-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
963         - s14-t32-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
964 - ServerB15 [Type-B1]:
965     - testbedname: testbed32.
966     - hostname: s15-t32-sut2.
967     - IPMI IP: 10.30.50.56
968     - Host IP: 10.30.51.59
969     - portnames:
970         - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
971         - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
972         - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
973         - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
974         - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
975         - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
976         - s15-t32-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
977         - s15-t32-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
978 - ServerB16 [Type-B2]:
979     - testbedname: testbed32.
980     - hostname: s16-t32-tg1.
981     - IPMI IP: 10.30.50.57
982     - Host IP: 10.30.51.60
983     - portnames:
984         - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
985         - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
986         - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
987         - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
988         - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
989         - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
990         - s16-t32-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
991         - s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
992 ```
993
994 Note: ServerB19 (TG) is shared between testbed33 & testbed34
995
996 #### 3-Node-Rangeley (3n-rng) VERIFY
997
998 Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
999
1000 ```
1001 - ServerB22 [Type-B5]:
1002     - testbedname: testbed35.
1003     - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1).
1004     - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0
1005     - Host IP: 10.30.51.9
1006     - portnames:
1007         - s22-t35-sut1-p1 - 10GE-port1 ix0 82599.
1008         - s22-t35-sut1-p2 - 10GE-port2 ix1 82599.
1009     - 1GB ports (tbd)
1010 - ServerB23 [Type-B5]:
1011     - testbedname: testbed35.
1012     - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2).
1013     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1
1014     - Host IP: 10.30.51.10
1015     - portnames:
1016         - s23-t35-sut1-p1 - 10GE-port1 ix0 82599.
1017         - s23-t35-sut1-p2 - 10GE-port2 ix1 82599.
1018     - 1GB ports (tbd)
1019 - ServerB24 [Type-B5]:
1020     - testbedname: testbed35.
1021     - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3).
1022     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2
1023     - Host IP: 10.30.51.11
1024     - portnames:
1025         - s24-t35-sut1-p1 - 10GE-port1 ix0 82599.
1026         - s24-t35-sut1-p2 - 10GE-port2 ix1 82599.
1027     - 1GB ports (tbd)
1028 ```
1029
1030 #### 3-Node-Taishan (3n-tsh) WIP
1031
1032 ```
1033 - ServerB17 [Type-B3]:
1034     - testbedname: testbed33.
1035     - hostname: s17-t33-sut1.
1036     - IPMI IP: 10.30.50.36
1037     - Host IP: 10.30.51.36
1038     - portnames:
1039         - s17-t33-sut1-c6/p1 - 10GE-port1 82599-2p10GE.
1040         - s17-t33-sut1-c6/p2 - 10GE-port2 82599-2p10GE.
1041         - s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE.
1042         - s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE.
1043 - ServerB18 [Type-B3]:
1044     - testbedname: testbed33.
1045     - hostname: s18-t33-sut2.
1046     - IPMI IP: 10.30.50.37
1047     - Host IP: 10.30.51.37
1048     - portnames:
1049         - s18-t33-sut2-c6/p1 - 10GE-port1 82599-2p10GE.
1050         - s18-t33-sut2-c6/p2 - 10GE-port2 82599-2p10GE.
1051         - s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE.
1052         - s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE.
1053 - ServerB19 [Type-B2]:
1054     - testbednames: testbed33 and testbed34.
1055     - hostname: s19-t33t34-tg1.
1056     - IPMI IP: 10.30.50.46
1057     - Host IP: 10.30.51.49
1058     - portnames:
1059         - s19-t33t34-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
1060         - s19-t33t34-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
1061         - s19-t33t34-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
1062         - s19-t33t34-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
1063         - s19-t33t34-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
1064         - s19-t33t34-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
1065         - s19-t33t34-tg1-c10/p1 - 10GE-port1 x710-4p10GE.
1066         - s19-t33t34-tg1-c10/p2 - 10GE-port2 x710-4p10GE.
1067         - s19-t33t34-tg1-c10/p3 - 10GE-port3 x710-4p10GE.
1068         - s19-t33t34-tg1-c10/p4 - 10GE-port4 x710-4p10GE.
1069 - ServerB20 [Type-B4]:
1070     - testbedname: testbed34.
1071     - hostname: s20-t34-sut1.
1072     - IPMI IP: N/A
1073     - Host IP: 10.30.51.41
1074     - portnames:
1075         - s20-t34-sut1-ca/p1 - 10GE-port1 Marvell.
1076         - s20-t34-sut1-ca/p2 - 10GE-port2 Marvell.
1077 - ServerB21 [Type-B4]:
1078     - testbedname: testbed34.
1079     - hostname: s21-t34-sut2.
1080     - IPMI IP: N/A
1081     - Host IP: 10.30.51.42
1082     - portnames:
1083         - s21-t34-sut2-ca/p1 - 10GE-port1 Marvell.
1084         - s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
1085 ```
1086
1087 #### 3-Node-Mcbin (3n-mcb) TODO
1088
1089 ```
1090 To be completed.
1091 ```
1092
1093 ### Per Testbed Wiring
1094
1095 #### 1-Node-Skylake (1n-skx) PROD
1096
1097 ```
1098 - testbed11:
1099     - ring1 10GE-ports x710-4p10GE:
1100         - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1.
1101     - ring2 10GE-ports x710-4p10GE:
1102         - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2.
1103     - ring3 10GE-ports x710-4p10GE:
1104         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1105     - ring4 10GE-ports x710-4p10GE:
1106         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1107 - testbed12:
1108     - ring1 10GE-ports x710-4p10GE:
1109         - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1.
1110     - ring2 10GE-ports x710-4p10GE:
1111         - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2.
1112     - ring3 10GE-ports x710-4p10GE:
1113         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1114     - ring4 10GE-ports x710-4p10GE:
1115         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1116 ```
1117
1118 #### 1-Node-Thunderx2 (1n-tx2) WIP
1119
1120 ```
1121 - testbed13:
1122     - ring1 40GE-ports XL710-QDA2-2p40GE on SUTs:
1123         - s27-t13-sut1-c1/p2 - s27-t13-sut1-c3/p1.
1124     - ring2 40GE-ports XL710-QDA2-2p40GE on SUTs:
1125         - s27-t13-sut1-c3/p2 - s27-t13-sut1-c6/p1.
1126     - ring3 40GE-ports XL710-QDA2-2p40GE on SUTs:
1127         - s27-t13-sut1-c6/p2 - s27-t13-sut1-c1/p1.
1128 ```
1129
1130 #### 2-Node-Skylake (2n-skx) PROD
1131
1132 ```
1133 - testbed21:
1134     - ring1 10GE-ports x710-4p10GE on SUT:
1135         - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1.
1136         - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2.
1137     - ring2 10GE-ports x710-4p10GE on SUT:
1138         - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3.
1139         - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4.
1140     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1141         - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1.
1142         - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2.
1143     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1144         - s4-t21-tg1-c9/p1 to s3-t21-sut1-c9/p1.
1145         - s3-t21-sut1-c9/p2 to s4-t21-tg1-c9/p2.
1146     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1147         - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2.
1148         - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4.
1149 - testbed22:
1150     - ring1 10GE-ports x710-4p10GE on SUT:
1151         - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1.
1152         - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2.
1153     - ring2 10GE-ports x710-4p10GE on SUT:
1154         - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3.
1155         - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4.
1156     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1157         - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1.
1158         - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2.
1159     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1160         - t22-tg1-c9/p1 to s5-t22-sut1-c9/p1.
1161         - s5-t22-sut1-c9/p2 to s6-t22-tg1-c9/p2.
1162     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1163         - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2.
1164         - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4.
1165 - testbed23:
1166     - ring1 10GE-ports x710-4p10GE on SUT:
1167         - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1.
1168         - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2.
1169     - ring2 10GE-ports x710-4p10GE on SUT:
1170         - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3.
1171         - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4.
1172     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1173         - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1.
1174         - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2.
1175     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1176         - s8-t23-tg1-c9/p1 to s7-t23-sut1-c9/p1.
1177         - s7-t23-sut1-c9/p2 to s8-t23-tg1-c9/p2.
1178     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1179         - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2.
1180         - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4.
1181 - testbed24:
1182     - ring1 10GE-ports x710-4p10GE on SUT:
1183         - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1.
1184         - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2.
1185     - ring2 10GE-ports x710-4p10GE on SUT:
1186         - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3.
1187         - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4.
1188     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1189         - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1.
1190         - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2.
1191     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1192         - s10-t24-tg1-c9/p1 to s9-t24-sut1-c9/p1.
1193         - s9-t24-sut1-c9/p2 to s10-t24-tg1-c9/p2.
1194     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1195         - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2.
1196         - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
1197 ```
1198
1199 #### 2-Node-Denverton (2n-dnv) TODO
1200
1201 ```
1202 To be completed.
1203 ```
1204
1205 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
1206
1207 ```
1208 - testbed25:
1209     - link1 10GE-port x710-4p10GE on SUT:
1210         - t25-tg1-p1 to t25-sut1-c2/p1.
1211     - link2 10GE-port x710-4p10GE on SUT:
1212         - t25-tg1-p2 to t25-sut1-c2/p2.
1213     - link3 10GE-port x710-4p10GE on SUT:
1214         - t25-tg1-p3 to t25-sut1-c2/p3.
1215     - link4 10GE-port x710-4p10GE on SUT:
1216         - t25-tg1-p4 to t25-sut1-c2/p4.
1217 ```
1218
1219 #### 3-Node-Haswell (3n-hsw) PROD
1220
1221 ```
1222  1. testbed1:
1223     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1224         - t1-tg1-c1/p1 to t1-sut1-c1/p2.
1225         - t1-sut1-c1/p1 to t1-sut2-c1/p2.
1226         - t1-sut2-c1/p1 to t1-tg1-c1/p2.
1227     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1228         - t1-tg1-c2/p1 to t1-sut1-c2/p2.
1229         - t1-sut1-c2/p1 to t1-sut2-c2/p2.
1230         - t1-sut2-c2/p1 to t1-tg1-c2/p2.
1231     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1232         - t1-tg1-c4/p1 to t1-sut1-c4/p2.
1233         - t1-sut1-c4/p1 to t1-sut2-c4/p2.
1234         - t1-sut2-c4/p1 to t1-tg1-c4/p2.
1235     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1236         - t1-tg1-c5/p1 to t1-sut1-c5/p2.
1237         - t1-sut1-c5/p1 to t1-sut2-c5/p2.
1238         - t1-sut2-c5/p1 to t1-tg1-c5/p2.
1239     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1240         - t1-tg1-c2/p1 to t1-sut1-cm/p2.
1241         - t1-sut1-cm/p1 to t1-sut2-cm/p2.
1242         - t1-sut2-cm/p1 to t1-tg1-c2/p2.
1243     - TG loopback ports Intel NIC x710 2p10GE
1244         - t1-tg1-c6/p1 to t1-tg1-c6/p2.
1245
1246  2. testbed2:
1247     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1248         - t2-tg1-c1/p1 to t2-sut1-c1/p2.
1249         - t2-sut1-c1/p1 to t2-sut2-c1/p2.
1250         - t2-sut2-c1/p1 to t2-tg1-c1/p2.
1251     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1252         - t2-tg1-c2/p1 to t2-sut1-c2/p2.
1253         - t2-sut1-c2/p1 to t2-sut2-c2/p2.
1254         - t2-sut2-c2/p1 to t2-tg1-c2/p2.
1255     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1256         - t2-tg1-c4/p1 to t2-sut1-c4/p2.
1257         - t2-sut1-c4/p1 to t2-sut2-c4/p2.
1258         - t2-sut2-c4/p1 to t2-tg1-c4/p2.
1259     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1260         - t2-tg1-c5/p1 to t2-sut1-c5/p2.
1261         - t2-sut1-c5/p1 to t2-sut2-c5/p2.
1262         - t2-sut2-c5/p1 to t2-tg1-c5/p2.
1263     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1264         - t2-tg1-c2/p1 to t2-sut1-cm/p2.
1265         - t2-sut1-cm/p1 to t2-sut2-cm/p2.
1266         - t2-sut2-cm/p1 to t2-tg1-c2/p2.
1267     - TG loopback ports Intel NIC x710 2p10GE
1268         - t2-tg1-c6/p1 to t2-tg1-c6/p2.
1269
1270  3. testbed3:
1271     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1272         - t3-tg1-c1/p1 to t3-sut1-c1/p2.
1273         - t3-sut1-c1/p1 to t3-sut2-c1/p2.
1274         - t3-sut2-c1/p1 to t3-tg1-c1/p2.
1275     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1276         - t3-tg1-c2/p1 to t3-sut1-c2/p2.
1277         - t3-sut1-c2/p1 to t3-sut2-c2/p2.
1278         - t3-sut2-c2/p1 to t3-tg1-c2/p2.
1279     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1280         - t3-tg1-c4/p1 to t3-sut1-c4/p2.
1281         - t3-sut1-c4/p1 to t3-sut2-c4/p2.
1282         - t3-sut2-c4/p1 to t3-tg1-c4/p2.
1283     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1284         - t3-tg1-c5/p1 to t3-sut1-c5/p2.
1285         - t3-sut1-c5/p1 to t3-sut2-c5/p2.
1286         - t3-sut2-c5/p1 to t3-tg1-c5/p2.
1287     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1288         - t3-tg1-c2/p1 to t3-sut1-cm/p2.
1289         - t3-sut1-cm/p1 to t3-sut2-cm/p2.
1290         - t3-sut2-cm/p1 to t3-tg1-c2/p2.
1291     - TG loopback ports Intel NIC x710 2p10GE
1292         - t3-tg1-c6/p1 to t3-tg1-c6/p2.
1293 ```
1294
1295 #### 3-Node-Skylake (3n-skx) PROD
1296
1297 ```
1298 - testbed31:
1299     - ring1 10GE-ports x710-4p10GE on SUTs:
1300         - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1.
1301         - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2.
1302         - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2.
1303     - ring2 10GE-ports x710-4p10GE on SUT:
1304         - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3.
1305         - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4.
1306         - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4.
1307     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1308         - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1.
1309         - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2.
1310         - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2.
1311     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1312         - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1.
1313         - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2.
1314         - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2.
1315     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1316         - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2.
1317         - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4.
1318 - testbed32:
1319     - ring1 10GE-ports x710-4p10GE on SUTs:
1320         - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1.
1321         - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2.
1322         - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2.
1323     - ring2 10GE-ports x710-4p10GE on SUT:
1324         - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3.
1325         - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4.
1326         - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4.
1327     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1328         - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1.
1329         - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2.
1330         - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2.
1331     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1332         - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1.
1333         - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2.
1334         - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2.
1335     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1336         - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2.
1337         - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4.
1338 ```
1339
1340 #### 3-Node-Rangeley (3n-rng) TODO
1341
1342 ```
1343 To be completed.
1344 ```
1345
1346 #### 3-Node-Taishan (3n-tsh) WIP
1347
1348 ```
1349 - testbed33:
1350     - ring1 10GE-ports 82599-2p10GE on SUTs:
1351         - t33t34-tg1-c2/p2 - t33-sut1-c6/p2.
1352         - t33-sut1-c6/p1 - t33-sut2-c6/p2.
1353         - t33-sut2-c6/p1 - t33t34-tg1-c2/p1.
1354     - ring2 25GE-ports cx4-2p25GE on SUTs:
1355         - t33t34-tg1-c4/p2 - t33-sut1-c4/p2.
1356         - t33-sut1-c4/p1 - t33-sut2-c4/p2.
1357         - t33-sut2-c4/p1 - t33t34-tg1-c4/p1.
1358 ```
1359
1360 #### 3-Node-Mcbin (3n-mcb) WIP
1361
1362 ```
1363 - testbed34:
1364     - ring1 10GE-ports Marvell on SUTs:
1365         - t33t34-tg1-c2/p3 - t34-sut1-ca/p1.
1366         - t34-sut1-ca/p2 - t34-sut2-ca/p1.
1367         - t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
1368 ```
1369
1370 ## Inventory
1371
1372 ### Appliances
1373
1374 ```
1375 1. Ixia PerfectStorm One Appliance
1376     - 1 * PS10GE4NG
1377         - Chassis: PS10GE4NG.
1378         - Motherboard: SuperMicro X11DPG-QT.
1379         - Processors: Quad-Core, Intel Processor.
1380         - HW accelerators: FPGA offload.
1381         - RAM Memory: 64GB.
1382         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
1383         - Physical Interfaces: 4 * 10GE SFP+.
1384         - Operating System: Native IxOS.
1385 ```
1386
1387 ### Arm Servers
1388
1389 ```
1390 1. Arm Cortex A-72 servers
1391     - 1 * ThunderX2
1392         - Chassis: Marvell ThunderX2
1393         - Processors: 2* ThunderX2 CN9975 ~ 112* ThunderX2.
1394         - RAM Memory: 4* 32GB RDIMM
1395         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
1396     - 2 * Huawei TaiShan 2280.
1397         - Chassis: Huawei TaiShan 2280.
1398         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72.
1399         - RAM Memory: 8* 16GB DDR4-2400MT/s.
1400         - Disks: 1* 4TB SATA HDD.
1401     - 3 * MACCHIATObin
1402         - Chassis: MACCHIATObin.
1403         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72.
1404         - RAM Memory: 1* 16GB DDR4.
1405         - Disks: 1* 128GB(?) SATA SDD.
1406 ```
1407
1408 ### Xeon and Atom Servers
1409
1410 ```
1411 1. Intel Xeon servers:
1412     - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors.
1413         - Chassis: SuperMicro SYS-7049GP-TRT.
1414         - Motherboard: SuperMicro X11DPG-QT.
1415         - Processors: 2* Intel Platinum 8180 2.3 GHz.
1416         - RAM Memory: 16* 16GB DDR4-2666MHz.
1417         - Disks: 2* 1.6TB 6G SATA SSD.
1418 2. Intel Atom servers with Rangely processors.
1419     - 3 * Netgate XG-2758-1u
1420         - Chassis: Netgate XG-2758-1u
1421         - Processors: 1* Rangely (Atom) C2758 2.4 GHz
1422         - RAM Memory: 16GB ECC
1423         - Disks: 150 GB
1424 ```
1425
1426 ### Network Interface Cards
1427
1428 ```
1429 1. 10GE NICs
1430     - 14 * Intel® Ethernet Converged Network Adapter X710-DA4
1431     - 6 * Intel® Ethernet Converged Network Adapter X710-DA2
1432     - 6 * Intel® Ethernet Converged Network Adapter X520-DA2
1433 2. 25GE NICs
1434     - 12 * Intel® Ethernet Network Adapter XXV710-DA2
1435 3. 40GE NICs
1436     - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2
1437 4. 100GE NICs
1438     - 4 * mcx556a-edat NICs (not on site yet, in transit)
1439 ```
1440
1441 ### Pluggables and Cables
1442
1443 Pluggables:
1444
1445 ```
1446 1. 10GE SFP+
1447     - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics
1448     - 80 * 10G SR optic (generic, "Intel" compatible branded)
1449 2. 25GE SFP28
1450     - None
1451 3. 40GE QSFP+
1452     - None
1453 4. 100GE
1454     - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit)
1455 ```
1456
1457 Standalone cables:
1458
1459 ```
1460 1. 10GE
1461     - None
1462 2. 25GE
1463     - None
1464 3. 40GE QSFP+
1465     - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable
1466 4. 100GE
1467     - None
1468 ```
1469
1470 ### Other Parts
1471
1472 None.