docs/lab/testbed_specifications.md

   1 # FD.io CSIT Testbed Specifications
   2
   3 1. [Purpose](#purpose)
   4 1. [Testbeds Overview](#testbeds-overview)
   5    1. [Summary List](#summary-list)
   6    1. [1-Node-Skylake Xeon Intel (1n-skx)](#1-node-skylake-xeon-intel-1n-skx)
   7    1. [1-Node-ThunderX2 Arm Marvell (1n-tx2)](#1-node-thunderx2-arm-marvell-1n-tx2)
   8    1. [2-Node-Skylake Xeon Intel (2n-skx)](#2-node-skylake-xeon-intel-2n-skx)
   9    1. [2-Node-Denverton Atom Intel (2n-dnv)](#2-node-denverton-atom-intel-2n-dnv)
  10    1. [2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)](#2-node-ixiaps1l47-ixia-psone-l47-2n-ps1)
  11    1. [3-Node-Haswell Xeon Intel (3n-skx)](#3-node-haswell-xeon-intel-3n-skx)
  12    1. [3-Node-Skylake Xeon Intel (3n-skx)](#3-node-skylake-xeon-intel-3n-skx)
  13    1. [3-Node-TaiShan Arm Huawei (3n-tsh)](#3-node-taishan-arm-huawei-3n-tsh)
  14    1. [3-Node-MACCHIATObin Arm Marvell](#3-node-macchiatobin-arm-marvell)
  15    1. [3-Node-Rangeley Atom Testbeds](#3-node-rangeley-atom-testbeds)
  16 1. [Server Management](#server-management)
  17    1. [Requirements](#requirements)
  18    1. [Addressing](#addressing)
  19    1. [LOM (IPMI) VLAN IP Addresses](#lom-ipmi-vlan-ip-addresses)
  20    1. [Management VLAN IP Addresses](#management-vlan-ip-addresses)
  21 1. [Server Type Specification](#server-type-specification)
  22    1. [Server and Port Naming](#server-and-port-naming)
  23 1. [Testbeds Configuration](#testbeds-configuration)
  24    1. [Per Testbed Server Allocation and Naming](#per-testbed-server-allocation-and-naming)
  25       1. [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
  26       1. [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
  27       1. [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
  28       1. [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
  29       1. [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
  30       1. [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
  31       1. [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
  32       1. [3-Node-Rangeley (3n-rng) VERIFY](#3-node-rangeley-3n-rng-verify)
  33       1. [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
  34       1. [3-Node-Mcbin (3n-mcb) TODO](#3-node-mcbin-3n-mcb-todo)
  35    1. [Per Testbed Wiring](#per-testbed-wiring)
  36       1. [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
  37       1. [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
  38       1. [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
  39       1. [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
  40       1. [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
  41       1. [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
  42       1. [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
  43       1. [3-Node-Rangeley (3n-rng) TODO](#3-node-rangeley-3n-rng-todo)
  44       1. [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
  45       1. [3-Node-Mcbin (3n-mcb) WIP](#3-node-mcbin-3n-mcb-wip)
  46 1. [Inventory](#inventory)
  47    1. [Appliances](#appliances)
  48    1. [Arm Servers](#arm-servers)
  49    1. [Xeon and Atom Servers](#xeon-and-atom-servers)
  50    1. [Network Interface Cards](#network-interface-cards)
  51    1. [Pluggables and Cables](#pluggables-and-cables)
  52    1. [Other Parts](#other-parts)
  53
  54 ## Purpose
  55
  56 This note includes specification of the physical testbed infrastructure
  57 hosted by LFN FD.io CSIT project.
  58
  59 ## Testbeds Overview
  60
  61 ### Summary List
  62
  63 ```
  64  #. CSIT_tb          Purpose  SUT   TG    #TB  #SUT #TG  #hsw #skx #ps1 #rng #dnv #tx2 #tsh #mcb
  65  1. 1-Node-Skylake     func   skx   na    2    2    0    0    2    0    0    0    0    0    0
  66  2. 1-Node-Thunderx2   func   tx2   na    1    1    0    0    0    0    0    0    1    0    0
  67  3. 2-Node-Skylake     perf   skx   skx   4    4    4    0    8    0    0    0    0    0    0
  68  4. 2-Node-Denverton   perf   dnv   skx   1    1    1    0    .5   0    0    1    0    0    0
  69  5. 2-Node-IxiaPS1L47  tcp    skx   ps1   1    1    1    0    1    1    0    0    0    0    0
  70  6. 3-Node-Haswell     perf   hsw   hsw   3    6    3    9    0    0    0    0    0    0    0
  71  7. 3-Node-Skylake     perf   skx   skx   2    4    2    0    6    0    0    0    0    0    0
  72  8. 3-Node-Rangeley    perf   rng   skx   1    3    1    0    0    0    2    0    0    0    0
  73  9. 3-Node-Taishan     perf   tsh   skx   1    2    1    0    .5   0    0    0    0    2    0
  74 10. 3-Node-Mcbin       perf   mcb   skx   1    2    1    0    .5   0    0    0    0    0    2
  75 11. 1-Node-VIRL        func   hsw   ---   3    3    0    3    0    0    0    0    0    0    0
  76 12. 3-Node-Denverton   perf   dnv   skx   1    2    1    0    .5   0    0    2    0    0    0
  77                                  Totals: 18   28   15   12   19    1    2    3    1    2    2
  78 ```
  79
  80 ### 1-Node-Skylake Xeon Intel (1n-skx)
  81
  82 Each 1-Node-Skylake testbed includes one SUT (Type-B6 server) with NIC
  83 ports connected back-to-back.
  84 Used for FD.io VPP_Device functional driver tests.
  85
  86 ### 1-Node-ThunderX2 Arm Marvell (1n-tx2)
  87
  88 Each 1-Node-ThunderX2 testbed includes one SUT (Type-B9 server) with NIC
  89 ports connected back-to-back.
  90 Used for FD.io VPP_Device functional driver tests.
  91
  92 ### 2-Node-Skylake Xeon Intel (2n-skx)
  93
  94 Each 2-Node-Skylake testbed includes one SUT (Type-B1 server) and one TG
  95 (Type-B2 server) connected back-to-back.
  96 Used for FD.io performance tests.
  97
  98 ### 2-Node-Denverton Atom Intel (2n-dnv)
  99
 100 Each 2-Node-Skylake testbed includes one SUT (Type-B10 server) and one TG
 101 (Type-B2 server) connected back-to-back.
 102 Used for FD.io performance tests.
 103
 104 ### 2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)
 105
 106 Each 2-Node-IxiaPS1L47 testbed includes one SUT (Type-B1 server) and one
 107 TG (Ixia PSOne appliance) with 10GE interfaces connected back-to-back.
 108 Used for FD.io TCP/IP and HTTP performance tests.
 109
 110 ### 3-Node-Haswell Xeon Intel (3n-hsw)
 111
 112 Each 3-Node-Haswell testbed includes two SUTs (Type-A1 servers) and one
 113 TG (Type-A2 server) connected in full-mesh triangle.
 114 Used for FD.io performance tests.
 115
 116 ### 3-Node-Skylake Xeon Intel (3n-skx)
 117
 118 Each 3-Node-Skylake testbed includes two SUTs (Type-B1 servers) and one
 119 TG (Type-B2 server) connected in full-mesh triangle.
 120 Used for FD.io performance tests.
 121
 122 ### 3-Node-TaiShan Arm Huawei (3n-tsh)
 123
 124 Each 3-Node-TaiShan testbed includes two SUTs (Type-B3 server) and one TG
 125 (Type-B2 server) connected in full-mesh triangle.
 126 Used for FD.io performance tests.
 127
 128 ### 3-Node-MACCHIATObin Arm Marvell
 129
 130 Each 3-Node-MACCHIATObin testbed includes two SUTs (Type-B4 server) and
 131 one TG (Type-B2 server) connected in full-mesh triangle.
 132 Used for FD.io performance tests.
 133
 134 ### 3-Node-Rangeley Atom Testbeds
 135
 136 Each 3-Node-Rangeley testbed includes two SUTs (Type-B5 Netgate device)
 137 and one TG (Type-2 server) connected in full-mesh triangle.
 138 Used for FD.io performance tests.
 139
 140 ## Server Management
 141
 142 ### Requirements
 143
 144 For management purposes, each server must have following two ports
 145 connected to the management network:
 146
 147 ```
 148 - 1GE IPMI port
 149   - IPMI - Intelligent Platform Management Interface.
 150   - Required for access to embedded server management with WebUI, CLI, SNMPv3,
 151     IPMIv2.0, for firmware (BIOS) and OS updates.
 152 - 1GE/10GE/40GE management port
 153   - hostOS management port for general system management.
 154 ```
 155
 156 ### Addressing
 157
 158 Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management
 159 port, which are connected to two different VLANs.
 160
 161 ```
 162 1. LOM (IPMI) VLAN:
 163     - Subnet: 10.30.50.0/24
 164     - Gateway: 10.30.50.1
 165     - Broadcast: 10.30.50.255
 166     - DNS1: 199.204.44.24
 167     - DNS2: 199.204.47.54
 168 2. Management Vlan:
 169     - Subnet: 10.30.51.0/24
 170     - Gateway: 10.30.51.1
 171     - Broadcast: 10.30.51.255
 172     - DNS1: 199.204.44.24
 173     - DNS2: 199.204.47.54
 174 ```
 175
 176 To access these hosts, VPN connection is required.
 177
 178 ### LOM (IPMI) VLAN IP Addresses
 179
 180 Name         | Comment
 181 ------------ | -------
 182 10.30.50.0   | network
 183 10.30.51.1   | Router
 184 10.30.50.2   | LF Reserved
 185 10.30.50.3   | LF Reserved
 186 10.30.50.4   | LF Reserved
 187 10.30.50.5   | LF Reserved
 188 10.30.50.6   | LF Reserved
 189 10.30.50.7   | LF Reserved
 190 10.30.50.8   | LF Reserved
 191 10.30.50.9   | LF Reserved
 192 10.30.50.10  | LF Reserved
 193 10.30.50.11  | LF Reserved
 194 10.30.50.12  | LF Reserved
 195 10.30.50.13  | LF Reserved
 196 10.30.50.14  | LF Reserved
 197 10.30.50.15  | LF Reserved
 198 10.30.50.16  | t1-tg1
 199 10.30.50.17  | t1-sut1
 200 10.30.50.18  | t1-sut2
 201 10.30.50.20  | t2-tg1
 202 10.30.50.21  | t2-sut1
 203 10.30.50.22  | t2-sut2
 204 10.30.50.24  | t3-tg1
 205 10.30.50.25  | t3-sut1
 206 10.30.50.26  | t3-sut-2
 207 10.30.50.28  | t4-sut1
 208 10.30.50.29  | t4-sut2
 209 10.30.50.30  | t4-sut3
 210 10.30.50.36  | s17-t33-sut1
 211 10.30.50.37  | s18-t33-sut2
 212 10.30.50.41  | s3-t21-sut1
 213 10.30.50.42  | s4-t21-tg1
 214 10.30.50.43  | s11-t31-sut1
 215 10.30.50.44  | s12-t31-sut2
 216 10.30.50.45  | s13-t31-tg1
 217 10.30.50.46  | s19-t33t34-tg1
 218 10.30.50.47  | s1-t11-sut1
 219 10.30.50.48  | s2-t12-sut1
 220 10.30.50.49  | s5-t22-sut1
 221 10.30.50.50  | s6-t22-tg1
 222 10.30.50.51  | s7-t23-sut1
 223 10.30.50.52  | s8-t23-tg1
 224 10.30.50.53  | s9-t24-sut1
 225 10.30.50.54  | s10-t24-tg1
 226 10.30.50.55  | s14-t32-sut1
 227 10.30.50.56  | s15-t32-sut2
 228 10.30.50.57  | s16-t32-tg1
 229 10.30.50.58  | s25-t25-sut1
 230 10.30.50.59  | s26-t25-tg1
 231 10.30.50.69  | s27-t13-sut
 232 10.30.50.255 | Broadcast
 233
 234 ### Management VLAN IP Addresses
 235
 236 Name                      | Comment
 237 ------------------------- | -------
 238 10.30.51.0                | network
 239 10.30.51.1                | Router
 240 10.30.51.2                | LF Reserved
 241 10.30.51.3                | LF Reserved
 242 10.30.51.4                | LF Reserved
 243 10.30.51.5                | LF Reserved
 244 10.30.51.6                | LF Reserved
 245 10.30.51.7                | LF Reserved
 246 10.30.51.8                | LF Reserved
 247 10.30.51.9                | s22-t35-sut1 (netgate-1)
 248 10.30.51.10               | s23-t35-sut2 (netgate-2)
 249 10.30.51.11               | s24-t35-sut3 (netgate-3)
 250 10.30.51.12               | softiron-1
 251 10.30.51.13               | softiron-2
 252 10.30.51.14               | softiron-3
 253 10.30.51.15               | LF Reserved
 254 10.30.51.16               | t1-tg1
 255 10.30.51.17               | t1-sut1
 256 10.30.51.18               | t1-sut2
 257 10.30.51.20               | t2-tg1
 258 10.30.51.21               | t2-sut1
 259 10.30.51.22               | t2-sut2
 260 10.30.51.24               | t3-tg1
 261 10.30.51.25               | t3-sut1
 262 10.30.51.26               | t3-sut-2
 263 10.30.51.28               | t4-sut1
 264 10.30.51.29               | t4-sut2
 265 10.30.51.29               | s22-t35-sut1 screen -r /dev/ttyUSB0, TO BE VERIFIED
 266 10.30.51.30               | t4-sut3
 267 10.30.51.30               | s23-t35-sut2 screen -r /dev/ttyUSB1, TO BE VERIFIED
 268 10.30.51.30               | s24-t35-sut3 screen -r /dev/ttyUSB2, TO BE VERIFIED
 269 10.30.51.36               | s17-t33-sut1
 270 10.30.51.37               | s18-t33-sut2
 271 10.30.51.41               | s20-t34-sut1
 272 10.30.51.42               | s21-t34-sut2
 273 10.30.51.44               | s3-t21-sut1
 274 10.30.51.45               | s4-t21-tg1
 275 10.30.51.46               | s11-t31-sut1
 276 10.30.51.47               | s12-t31-sut2
 277 10.30.51.48               | s13-t31-tg1
 278 10.30.51.49               | s19-t33t34-tg1
 279 10.30.51.50               | s1-t11-sut1
 280 10.30.51.51               | s2-t12-sut1
 281 10.30.51.52               | s5-t22-sut1
 282 10.30.51.53               | s6-t22-tg1
 283 10.30.51.54               | s7-t23-sut1
 284 10.30.51.55               | s8-t23-tg1
 285 10.30.51.56               | s9-t24-sut1
 286 10.30.51.57               | s10-t24-tg1
 287 10.30.51.58               | s14-t32-sut1
 288 10.30.51.59               | s15-t32-sut2
 289 10.30.51.60               | s16-t32-tg1
 290 10.30.51.61               | s25-t25-sut1
 291 10.30.51.62               | s26-t25-tg1
 292 10.30.51.69               | s27-t13-sut1
 293 10.30.51.70-10.30.51.105  | VIRL1 TO BE VERIFIED
 294 10.30.51.106-10.30.51.180 | VIRL2
 295 10.30.51.181-10.30.51.254 | VIRL3
 296 10.30.51.255              | Broadcast
 297
 298 ## Server Type Specification
 299
 300 FD.io CSIT lab contains following server types:
 301 ```
 302 1. Type-A1: Purpose - Haswell Xeon SUT (Systems Under Test) for FD.io performance testing.
 303     - Quantity: 6 servers.
 304     - Physical connectivity:
 305         - CIMC and host management ports.
 306         - NIC ports connected in 3-node topologies.
 307     - Main HW configuration:
 308         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
 309         - Processors: 2* E5-2699v3 2.3 GHz.
 310         - RAM Memory: 16* 32GB DDR4-2133MHz.
 311         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
 312     - NICs configuration:
 313         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes)
 314             - PCIe Slot1: Cisco VIC 1385 2p40GE.
 315             - PCIe Slot2: Intel NIC x520 2p10GE.
 316             - PCIe Slot3: empty.
 317         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes)
 318             - PCIe Slot4: Intel NIC xl710 2p40GE.
 319             - PCIe Slot5: Intel NIC x710 2p10GE.
 320             - PCIe Slot6: Intel QAT 8950 50G (Walnut Hill)
 321         - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
 322 2. Type-A2: Purpose - Haswell Xeon TG (Traffic Generators) for FD.io performance testing.
 323     - Quantity: 3 servers.
 324     - Physical connectivity:
 325         - CIMC and host management ports.
 326         - NIC ports connected in 3-node topologies.
 327     - Main HW configuration:
 328         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
 329         - Processors: 2* E5-2699v3 2.3 GHz.
 330         - RAM Memory: 16* 32GB DDR4-2133MHz.
 331         - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
 332     - NICs configuration:
 333         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
 334             - PCIe Slot1: Intel NIC xl710 2p40GE.
 335             - PCIe Slot2: Intel NIC x710 2p10GE.
 336             - PCIe Slot3: Intel NIC x710 2p10GE.
 337         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
 338             - PCIe Slot4: Intel NIC xl710 2p40GE.
 339             - PCIe Slot5: Intel NIC x710 2p10GE.
 340             - PCIe Slot6: Intel NIC x710 2p10GE.
 341         - MLOM slot: empty.
 342 3. Type-A3: Purpose - Haswell Xeon VIRL hosts for FD.io functional testing.
 343     - Quantity: 3 servers.
 344     - Physical connectivity:
 345         - CIMC and host management ports.
 346         - no NIC ports, standalone setup.
 347     - Main HW configuration:
 348         - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
 349         - Processors: 2* E5-2699v3 2.3 GHz.
 350         - RAM Memory: 16* 32GB DDR4-2133MHz.
 351         - Disks: 2* 480 GB 2.5inch 6G SATA SSD.
 352     - NICs configuration:
 353         - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
 354             - no cards.
 355         - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
 356             - no cards.
 357         - MLOM slot: empty.
 358 4. Type-B1: Purpose - Skylake Xeon SUT for FD.io performance testing.
 359     - Quantity: ---
 360     - Physical connectivity:
 361         - IPMI and host management ports.
 362         - NIC ports connected into 2-node and 3-node topologies.
 363     - Main HW configuration:
 364         - Chassis: SuperMicro SYS-7049GP-TRT.
 365         - Motherboard: SuperMicro X11DPG-QT.
 366         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 367         - RAM Memory: 16* 16GB DDR4-2666MHz.
 368         - Disks: 2* 1.6TB 6G SATA SSD.
 369     - NICs configuration:
 370         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 371             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 372             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
 373             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
 374         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 375             - PCIe Slot6 86:00.xx: empty.
 376             - PCIe Slot8 af:00.xx: empty.
 377             - PCIe Slot10 d8:00.xx: empty.
 378 2. Type-B2: Purpose - Skylake Xeon TG for FD.io performance testing.
 379     - Quantity: ---
 380     - Physical connectivity:
 381         - IPMI and host management ports.
 382         - NIC ports connected into 2-node and 3-node topologies.
 383     - Main HW configuration:
 384         - Chassis: SuperMicro SYS-7049GP-TRT.
 385         - Motherboard: SuperMicro X11DPG-QT.
 386         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 387         - RAM Memory: 16* 16GB DDR4-2666MHz.
 388         - Disks: 2* 1.6TB 6G SATA SSD.
 389     - NICs configuration:
 390         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 391             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 392             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
 393             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
 394         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 395             - PCIe Slot6 86:00.xx: empty.
 396             - PCIe Slot8 af:00.xx: empty.
 397             - PCIe Slot10 d8:00.xx: x710-4p10GE Intel.
 398 3. Type-B3: Purpose - TaiShan Arm Huawei SUT for FD.io performance testing.
 399     - Quantity: 2
 400     - Physical connectivity:
 401         - IPMI(?) and host management ports.
 402         - NIC ports connected into 3-node topology.
 403     - Main HW configuration:
 404         - Chassis: Huawei TaiShan 2280.
 405         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72
 406         - RAM Memory: 8* 16GB DDR4-2400MT/s
 407         - Disks: 1* 4TB SATA HDD
 408     - NICs configuration:
 409         - PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox.
 410         - PCIe Slot6 11:00.xx: x520-2p10GE Intel.
 411 4. Type-B4: Purpose - MACCHIATObin Arm Marvell SUT for FD.io performance testing.
 412     - Quantity: 3
 413     - Physical connectivity:
 414         - Host management ports.
 415         - NIC ports connected into 2-node and 3-node topologies.
 416     - Main HW configuration:
 417         - Chassis: MACCHIATObin.
 418         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72
 419         - RAM Memory: 1* 16GB DDR4
 420         - Disks: 1* 128GB(?) SATA SDD
 421     - NICs configuration:
 422         - pp2-2p10GE Marvell (on-chip Ethernet ports ; marvell plugin in VPP)
 423 5. Type-B5: Purpose - Rangeley Atom SUT for FD.io performance testing.
 424     - Quantity: TBD based on testbed allocation.
 425     - Physical connectivity:
 426         - Management: serial Port (usb) for console
 427         - NIC ports connected into 2-node.
 428     - Main HW configuration:
 429         - Chassis: Netgate XG-2758-1u
 430         - Processors: 1* Rangeley (Atom) C2758 2.4 GHz
 431         - RAM Memory: 16GB ECC
 432         - Disks: 150 GB
 433     - NICs configuration:
 434         - 2x 10Gb Intel 82599ES
 435         - 4x 1GB Intel I354
 436 6. Type-B6: Purpose - Skylake Xeon SUT for FD.io VPP_Device functional tests.
 437     - Quantity: 2.
 438     - Physical connectivity:
 439         - IPMI and host management ports.
 440         - NIC ports connected into 2-node and 3-node topologies.
 441     - Main HW configuration:
 442         - Chassis: SuperMicro SYS-7049GP-TRT.
 443         - Motherboard: SuperMicro X11DPG-QT.
 444         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 445         - RAM Memory: 16* 16GB DDR4-2666MHz.
 446         - Disks: 2* 1.6TB 6G SATA SSD.
 447     - NICs configuration:
 448         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 449             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 450             - PCIe Slot4 3b:00.xx: x710-4p10GE Intel.
 451             - PCIe Slot9 5e:00.xx: empty.
 452         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 453             - PCIe Slot6 86:00.xx: empty.
 454             - PCIe Slot8 af:00.xx: empty.
 455             - PCIe Slot10 d8:00.xx: empty.
 456 7. Type-B7: Purpose - Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests.
 457     - Quantity: 1.
 458     - Physical connectivity:
 459         - Host management interface: 10/100/1000-BaseT.
 460         - 8-port 10GE SFP+ integrated NIC.
 461     - Main HW configuration:
 462         - Chassis: PS10GE4NG.
 463         - Motherboard: SuperMicro X11DPG-QT.
 464         - Processors: Quad-Core, Intel Processor.
 465         - HW accelerators: FPGA offload.
 466         - RAM Memory: 64GB.
 467         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
 468         - Physical Interfaces: 4 * 10GE SFP+.
 469         - Operating System: Native IxOS.
 470     - Interface configuration:
 471         - Port-1: 10GE SFP+.
 472         - Port-2: 10GE SFP+.
 473         - Port-3: 10GE SFP+.
 474         - Port-4: 10GE SFP+.
 475 8. Type-B8: Purpose - Skylake Xeon SUT for TCP/IP host stack tests.
 476     - Quantity: 1.
 477     - Physical connectivity:
 478         - IPMI and host management ports.
 479         - NIC ports.
 480     - Main HW configuration:
 481         - Chassis: SuperMicro SYS-7049GP-TRT.
 482         - Motherboard: SuperMicro X11DPG-QT.
 483         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 484         - RAM Memory: 16* 16GB DDR4-2666MHz.
 485         - Disks: 2* 1.6TB 6G SATA SSD.
 486     - NICs configuration:
 487         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 488             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 489             - PCIe Slot4 3b:00.xx: empty.
 490             - PCIe Slot9 5e:00.xx: empty.
 491         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 492             - PCIe Slot6 86:00.xx: empty.
 493             - PCIe Slot8 af:00.xx: empty.
 494             - PCIe Slot10 d8:00.xx: empty.
 495 9. Type-B9: Purpose - ThunderX2 Arm Marvell SUT for FD.io VPP_Device functional tests.
 496     - Quantity: 1
 497     - Physical connectivity:
 498         - IPMI and host management ports.
 499         - NIC ports connected into 1-node topologies.
 500     - Main HW configuration:
 501         - Chassis: Gigabyte R181-T90 1U
 502         - Motheboard: MT91-FS1
 503         - Processors: 1* ThunderX2 ARMv8 CN9975 2.0 GHz
 504         - RAM Memory: 4* 32GB RDIMM
 505         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
 506     - NICs configuration:
 507         - Numa0:
 508             - PCIe Slot1 05:00.xx: XL710-QDA2.
 509             - PCIe Slot3 08:00.xx: XL710-QDA2.
 510         - Numa1:
 511             - PCIe Slot6 85:00.xx: XL710-QDA2.
 512 10. Type-B10: Purpose - Denverton Atom SUT for FD.io performance testing.
 513     - Quantity: 4
 514     - Physical connectivity:
 515         - IPMI and host management ports.
 516         - NIC ports.
 517     - Main HW configuration:
 518         - Chassis: SuperMicro SYS-E300-9A
 519         - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
 520         - RAM Memory: 32GB ECC
 521         - Disks: 480 GB
 522     - NICs configuration:
 523         - 2x 10Gb Intel x553 fiber ports
 524         - 2x 10Gb Intel x553 copper ports
 525         - 4x 1GB Intel I350 ports
 526 ```
 527
 528 ### Server and Port Naming
 529
 530 Following naming convention is used within this page to specify physical
 531 connectivity and wiring across defined CSIT testbeds:
 532
 533 ```
 534 - testbedname: testbedN.
 535 - hostname:
 536     - traffic-generator: tN-tgW.
 537     - system-under-testX: tN-sutX.
 538 - portnames:
 539     - tN-tgW-cY/pZ.
 540     - tN-sutX-cY/pZ.
 541 - where:
 542     - N - testbed number.
 543     - tgW - server acts as traffic-generator with W index.
 544     - sutX - server acts as system-under-test with X index.
 545     - Y - PCIe slot number denoting a NIC card number within the host.
 546     - Z - port number on the NIC card.
 547 ```
 548
 549 ## Testbeds Configuration
 550
 551 ### Per Testbed Server Allocation and Naming
 552
 553 #### 1-Node-Skylake (1n-skx) PROD
 554
 555 ```
 556 - ServerB1 [Type-B6]:
 557     - testbedname: testbed11.
 558     - hostname: s1-t11-sut1.
 559     - IPMI IP: 10.30.50.47
 560     - Host IP: 10.30.51.50
 561     - portnames:
 562         - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 563         - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 564         - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 565         - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 566         - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
 567         - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
 568         - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
 569         - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
 570 - ServerB2 [Type-B6]:
 571     - testbedname: testbed12.
 572     - hostname: s2-t12-sut1.
 573     - IPMI IP: 10.30.50.48
 574     - Host IP: 10.30.51.51
 575     - portnames:
 576         - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 577         - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 578         - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 579         - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 580         - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
 581         - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
 582         - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
 583         - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
 584 ```
 585
 586 #### 1-Node-Thunderx2 (1n-tx2) WIP
 587
 588 ```
 589 - ServerB17 [Type-B9]:
 590     - testbedname: testbed13.
 591     - hostname: s27-t13-sut1.
 592     - IPMI IP: 10.30.50.69
 593     - Host IP: 10.30.51.69
 594     - portnames:
 595         - s27-t13-sut1-c1/p1 - 40GE-port1 XL710-QDA2-2p40GE.
 596         - s27-t13-sut1-c1/p2 - 40GE-port2 XL710-QDA2-2p40GE.
 597         - s27-t13-sut1-c3/p1 - 40GE-port1 XL710-QDA2-2p40GE.
 598         - s27-t13-sut1-c3/p2 - 40GE-port2 XL710-QDA2-2p40GE.
 599         - s27-t13-sut1-c6/p1 - 40GE-port1 XL710-QDA2-2p40GE.
 600         - s27-t13-sut1-c6/p2 - 40GE-port2 XL710-QDA2-2p40GE.
 601 ```
 602
 603 #### 2-Node-Skylake (2n-skx) PROD
 604
 605 ```
 606 - ServerB3 [Type-B1]:
 607     - testbedname: testbed21.
 608     - hostname: s3-t21-sut1.
 609     - IPMI IP: 10.30.50.41
 610     - Host IP: 10.30.51.44
 611     - portnames:
 612         - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 613         - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 614         - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 615         - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 616         - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 617         - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 618         - s3-t21-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 619         - s3-t21-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 620 - ServerB4 [Type-B2]:
 621     - testbedname: testbed21.
 622     - hostname: s4-t21-tg1.
 623     - IPMI IP: 10.30.50.42
 624     - Host IP: 10.30.51.45
 625     - portnames:
 626         - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 627         - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 628         - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 629         - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 630         - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 631         - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 632         - s4-t21-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 633         - s4-t21-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 634 - ServerB5 [Type-B1]:
 635     - testbedname: testbed22.
 636     - hostname: s5-t22-sut1.
 637     - IPMI IP: 10.30.50.49
 638     - Host IP: 10.30.51.52
 639     - portnames:
 640         - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 641         - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 642         - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 643         - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 644         - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 645         - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 646         - s5-t22-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 647         - s5-t22-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 648 - ServerB6 [Type-B2]:
 649     - testbedname: testbed22.
 650     - hostname: s6-t22-tg1.
 651     - IPMI IP: 10.30.50.50
 652     - Host IP: 10.30.51.53
 653     - portnames:
 654         - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 655         - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 656         - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 657         - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 658         - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 659         - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 660         - s6-t22-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 661         - s6-t22-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 662 - ServerB7 [Type-B1]:
 663     - testbedname: testbed23.
 664     - hostname: s7-t23-sut1.
 665     - IPMI IP: 10.30.50.51
 666     - Host IP: 10.30.51.54
 667     - portnames:
 668         - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 669         - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 670         - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 671         - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 672         - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 673         - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 674         - s7-t23-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 675         - s7-t23-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 676 - ServerB8 [Type-B2]:
 677     - testbedname: testbed23.
 678     - hostname: s8-t23-tg1.
 679     - IPMI IP: 10.30.50.52
 680     - Host IP: 10.30.51.55
 681     - portnames:
 682         - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 683         - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 684         - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 685         - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 686         - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 687         - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 688         - s8-t23-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 689         - s8-t23-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 690 - ServerB9 [Type-B1]:
 691     - testbedname: testbed24.
 692     - hostname: s9-t24-sut1.
 693     - IPMI IP: 10.30.50.53
 694     - Host IP: 10.30.51.56
 695     - portnames:
 696         - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 697         - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 698         - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 699         - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 700         - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 701         - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 702         - s9-t24-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 703         - s9-t24-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 704 - ServerB10 [Type-B2]:
 705     - testbedname: testbed24.
 706     - hostname: s10-t24-tg1.
 707     - IPMI IP: 10.30.50.54
 708     - Host IP: 10.30.51.57
 709     - portnames:
 710         - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 711         - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 712         - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 713         - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 714         - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 715         - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 716         - s10-t24-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 717         - s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 718 ```
 719
 720 #### 2-Node-Denverton (2n-dnv) WIP
 721
 722 Note: ServerB28 (TG) is shared between testbed26 & testbed35
 723
 724 ```
 725 - ServerB28 [Type-B2]:
 726     - testbednames: testbed26 and testbed35.
 727     - hostname: s28-t26t35-tg1.
 728     - IPMI IP: 10.30.55.10
 729     - Host IP: 10.32.8.10
 730     - portnames:
 731         - s28-t26t35-tg1-c2/p1 - 10GE-port1 x710da2-2p10GE.
 732         - s28-t26t35-tg1-c2/p2 - 10GE-port2 x710da2-2p10GE.
 733         - s28-t26t35-tg1-c4/p1 - 10GE-port1 x550t2-2p10GE.
 734         - s28-t26t35-tg1-c4/p2 - 10GE-port2 x550t2-2p10GE.
 735         - s28-t26t35-tg1-c9/p1 - 10GE-port1 x550t2-2p10GE.
 736         - s28-t26t35-tg1-c9/p2 - 10GE-port2 x550t2-2p10GE.
 737         - s28-t26t35-tg1-c6/p1 - 10GE-port1 x710da2-2p10GE.
 738         - s28-t26t35-tg1-c6/p2 - 10GE-port2 x710da2-2p10GE.
 739         - s28-t26t35-tg1-c8/p1 - 10GE-port1 x550t2-2p10GE.
 740         - s28-t26t35-tg1-c8/p2 - 10GE-port2 x550t2-2p10GE.
 741         - s28-t26t35-tg1-c10/p1 - 10GE-port1 x550t2-2p10GE.
 742         - s28-t26t35-tg1-c10/p2 - 10GE-port2 x550t2-2p10GE.
 743 - ServerB29 [Type-B10]:
 744     - testbednames: testbed26.
 745     - hostname: s29-t26-sut1.
 746     - IPMI IP: 10.30.55.11
 747     - Host IP: 10.32.8.11
 748     - portnames:
 749         - s29-t26-sut1-p1 - 10GE-port1 x553 copper port.
 750         - s29-t26-sut1-p2 - 10GE-port2 x553 copper port.
 751         - s29-t26-sut1-p3 - 10GE-port3 x553 fiber port.
 752         - s29-t26-sut1-p4 - 10GE-port4 x553 fiber port.
 753 ```
 754
 755 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
 756
 757 ```
 758 - ServerB25 [Type-B8]:
 759     - testbedname: testbed25.
 760     - hostname: s25-t25-sut1.
 761     - IPMI IP: 10.30.50.58
 762     - Host IP: 10.30.51.61
 763     - portnames:
 764         - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 765         - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 766         - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 767         - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 768 - ServerB26 [Type-B7]:
 769     - testbedname: testbed25.
 770     - hostname: s26-t25-tg1.
 771     - IPMI IP: 10.30.50.59
 772     - Host IP: 10.30.51.62
 773     - portnames:
 774         - s26-t25-tg1-p1 - 10GE-port1.
 775         - s26-t25-tg1-p2 - 10GE-port2.
 776         - s26-t25-tg1-p3 - 10GE-port3.
 777         - s26-t25-tg1-p4 - 10GE-port4.
 778 ```
 779
 780 #### 3-Node-Haswell (3n-hsw) PROD
 781
 782 ```
 783  1. Server1 of Type-1:
 784     - testbedname: testbed1.
 785     - hostname: t1-sut1.
 786     - CIMC IP: 10.30.50.17
 787     - Host IP: 10.30.51.17
 788     - portnames:
 789         - t1-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
 790         - t1-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
 791         - t1-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
 792         - t1-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
 793         - t1-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 794         - t1-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 795         - t1-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 796         - t1-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 797         - t1-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
 798         - t1-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
 799  2. Server2 of Type-1:
 800     - testbedname: testbed1.
 801     - hostname: t1-sut2.
 802     - CIMC IP: 10.30.50.18
 803     - Host IP: 10.30.51.18
 804     - portnames:
 805         - t1-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
 806         - t1-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
 807         - t1-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
 808         - t1-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
 809         - t1-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 810         - t1-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 811         - t1-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 812         - t1-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 813         - t1-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
 814         - t1-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
 815  3. Server3 of Type-2:
 816     - testbedname: testbed1.
 817     - hostname: t1-tg1.
 818     - CIMC IP: 10.30.50.16
 819     - Host IP: 10.30.51.16
 820     - portnames:
 821         - t1-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 822         - t1-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 823         - t1-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 824         - t1-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 825         - t1-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 826         - t1-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 827         - t1-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 828         - t1-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 829         - t1-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 830         - t1-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 831         - t1-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 832         - t1-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 833  4. Server4 of Type-1:
 834     - testbedname: testbed2.
 835     - hostname: t2-sut1.
 836     - CIMC IP: 10.30.50.21
 837     - Host IP: 10.30.51.21
 838     - portnames:
 839         - t2-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
 840         - t2-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
 841         - t2-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
 842         - t2-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
 843         - t2-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 844         - t2-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 845         - t2-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 846         - t2-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 847         - t2-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
 848         - t2-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
 849  5. Server5 of Type-1:
 850     - testbedname: testbed2.
 851     - hostname: t2-sut2.
 852     - CIMC IP: 10.30.50.22
 853     - Host IP: 10.30.51.22
 854     - portnames:
 855         - t2-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
 856         - t2-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
 857         - t2-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
 858         - t2-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
 859         - t2-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 860         - t2-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 861         - t2-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 862         - t2-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 863         - t2-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
 864         - t2-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
 865  6. Server6 of Type-2:
 866     - testbedname: testbed2.
 867     - hostname: t2-tg1.
 868     - CIMC IP: 10.30.50.20
 869     - Host IP: 10.30.51.20
 870     - portnames:
 871         - t2-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 872         - t2-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 873         - t2-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 874         - t2-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 875         - t2-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 876         - t2-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 877         - t2-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 878         - t2-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 879         - t2-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 880         - t2-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 881         - t2-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 882         - t2-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 883  7. Server7 of Type-1:
 884     - testbedname: testbed3.
 885     - hostname: t3-sut1.
 886     - CIMC IP: 10.30.50.25
 887     - Host IP: 10.30.51.25
 888     - portnames:
 889         - t3-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
 890         - t3-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
 891         - t3-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
 892         - t3-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
 893         - t3-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 894         - t3-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 895         - t3-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 896         - t3-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 897         - t3-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
 898         - t3-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
 899  8. Server8 of Type-1:
 900     - testbedname: testbed3.
 901     - hostname: t3-sut2.
 902     - CIMC IP: 10.30.50.26
 903     - Host IP: 10.30.51.26
 904     - portnames:
 905         - t3-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
 906         - t3-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
 907         - t3-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
 908         - t3-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
 909         - t3-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 910         - t3-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 911         - t3-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 912         - t3-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 913         - t3-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
 914         - t3-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
 915  9. Server9 of Type-2:
 916     - testbedname: testbed3.
 917     - hostname: t3-tg1.
 918     - CIMC IP: 10.30.50.24
 919     - Host IP: 10.30.51.24
 920     - portnames:
 921         - t3-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 922         - t3-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 923         - t3-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 924         - t3-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 925         - t3-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 926         - t3-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 927         - t3-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
 928         - t3-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
 929         - t3-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 930         - t3-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 931         - t3-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
 932         - t3-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
 933 ```
 934
 935 #### 3-Node-Skylake (3n-skx) PROD
 936
 937 ```
 938 - ServerB11 [Type-B1]:
 939     - testbedname: testbed31.
 940     - hostname: s11-t31-sut1.
 941     - IPMI IP: 10.30.50.43
 942     - Host IP: 10.30.51.46
 943     - portnames:
 944         - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 945         - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 946         - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 947         - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 948         - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 949         - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 950         - s11-t31-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 951         - s11-t31-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 952 - ServerB12 [Type-B1]:
 953     - testbedname: testbed31.
 954     - hostname: s12-t31-sut2.
 955     - IPMI IP: 10.30.50.44
 956     - Host IP: 10.30.51.47
 957     - portnames:
 958         - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
 959         - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
 960         - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
 961         - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
 962         - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 963         - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 964         - s12-t31-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 965         - s12-t31-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 966 - ServerB13 [Type-B2]:
 967     - testbedname: testbed31.
 968     - hostname: s13-t31-tg1.
 969     - IPMI IP: 10.30.50.45
 970     - Host IP: 10.30.51.48
 971     - portnames:
 972         - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 973         - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 974         - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 975         - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 976         - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 977         - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 978         - s13-t31-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 979         - s13-t31-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 980 - ServerB14 [Type-B1]:
 981     - testbedname: testbed32.
 982     - hostname: s14-t32-sut1.
 983     - IPMI IP: 10.30.50.55
 984     - Host IP: 10.30.51.58
 985     - portnames:
 986         - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 987         - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 988         - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 989         - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 990         - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 991         - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 992         - s14-t32-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 993         - s14-t32-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 994 - ServerB15 [Type-B1]:
 995     - testbedname: testbed32.
 996     - hostname: s15-t32-sut2.
 997     - IPMI IP: 10.30.50.56
 998     - Host IP: 10.30.51.59
 999     - portnames:
1000         - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
1001         - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
1002         - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
1003         - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
1004         - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
1005         - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
1006         - s15-t32-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
1007         - s15-t32-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
1008 - ServerB16 [Type-B2]:
1009     - testbedname: testbed32.
1010     - hostname: s16-t32-tg1.
1011     - IPMI IP: 10.30.50.57
1012     - Host IP: 10.30.51.60
1013     - portnames:
1014         - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
1015         - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
1016         - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
1017         - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
1018         - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
1019         - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
1020         - s16-t32-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
1021         - s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
1022 ```
1023
1024 #### 3-Node-Rangeley (3n-rng) VERIFY
1025
1026 Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
1027
1028 ```
1029 - ServerB22 [Type-B5]:
1030     - testbedname: testbed35.
1031     - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1).
1032     - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0
1033     - Host IP: 10.30.51.9
1034     - portnames:
1035         - s22-t35-sut1-p1 - 10GE-port1 ix0 82599.
1036         - s22-t35-sut1-p2 - 10GE-port2 ix1 82599.
1037     - 1GB ports (tbd)
1038 - ServerB23 [Type-B5]:
1039     - testbedname: testbed35.
1040     - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2).
1041     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1
1042     - Host IP: 10.30.51.10
1043     - portnames:
1044         - s23-t35-sut1-p1 - 10GE-port1 ix0 82599.
1045         - s23-t35-sut1-p2 - 10GE-port2 ix1 82599.
1046     - 1GB ports (tbd)
1047 - ServerB24 [Type-B5]:
1048     - testbedname: testbed35.
1049     - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3).
1050     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2
1051     - Host IP: 10.30.51.11
1052     - portnames:
1053         - s24-t35-sut1-p1 - 10GE-port1 ix0 82599.
1054         - s24-t35-sut1-p2 - 10GE-port2 ix1 82599.
1055     - 1GB ports (tbd)
1056 ```
1057
1058 #### 3-Node-Taishan (3n-tsh) WIP
1059
1060 Note: ServerB19 (TG) is shared between testbed33 & testbed34
1061
1062 ```
1063 - ServerB17 [Type-B3]:
1064     - testbedname: testbed33.
1065     - hostname: s17-t33-sut1.
1066     - IPMI IP: 10.30.50.36
1067     - Host IP: 10.30.51.36
1068     - portnames:
1069         - s17-t33-sut1-c6/p1 - 10GE-port1 x520-2p10GE.
1070         - s17-t33-sut1-c6/p2 - 10GE-port2 x520-2p10GE.
1071         - s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE.
1072         - s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE.
1073 - ServerB18 [Type-B3]:
1074     - testbedname: testbed33.
1075     - hostname: s18-t33-sut2.
1076     - IPMI IP: 10.30.50.37
1077     - Host IP: 10.30.51.37
1078     - portnames:
1079         - s18-t33-sut2-c6/p1 - 10GE-port1 x520-2p10GE.
1080         - s18-t33-sut2-c6/p2 - 10GE-port2 x520-2p10GE.
1081         - s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE.
1082         - s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE.
1083 - ServerB19 [Type-B2]:
1084     - testbednames: testbed33 and testbed34.
1085     - hostname: s19-t33t34-tg1.
1086     - IPMI IP: 10.30.50.46
1087     - Host IP: 10.30.51.49
1088     - portnames:
1089         - s19-t33t34-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
1090         - s19-t33t34-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
1091         - s19-t33t34-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
1092         - s19-t33t34-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
1093         - s19-t33t34-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
1094         - s19-t33t34-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
1095         - s19-t33t34-tg1-c10/p1 - 10GE-port1 x710-4p10GE.
1096         - s19-t33t34-tg1-c10/p2 - 10GE-port2 x710-4p10GE.
1097         - s19-t33t34-tg1-c10/p3 - 10GE-port3 x710-4p10GE.
1098         - s19-t33t34-tg1-c10/p4 - 10GE-port4 x710-4p10GE.
1099 - ServerB20 [Type-B4]:
1100     - testbedname: testbed34.
1101     - hostname: s20-t34-sut1.
1102     - IPMI IP: N/A
1103     - Host IP: 10.30.51.41
1104     - portnames:
1105         - s20-t34-sut1-ca/p1 - 10GE-port1 Marvell.
1106         - s20-t34-sut1-ca/p2 - 10GE-port2 Marvell.
1107 - ServerB21 [Type-B4]:
1108     - testbedname: testbed34.
1109     - hostname: s21-t34-sut2.
1110     - IPMI IP: N/A
1111     - Host IP: 10.30.51.42
1112     - portnames:
1113         - s21-t34-sut2-ca/p1 - 10GE-port1 Marvell.
1114         - s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
1115 ```
1116
1117 #### 3-Node-Denverton (3n-dnv) WIP
1118
1119 ```
1120 - ServerB30 [Type-B10]:
1121     - testbednames: testbed35.
1122     - hostname: s30-t35-sut1.
1123     - IPMI IP: 10.30.55.12
1124     - Host IP: 10.32.8.12
1125     - portnames:
1126         - s30-t35-sut1-p1 - 10GE-port1 x553 copper port.
1127         - s30-t35-sut1-p2 - 10GE-port2 x553 copper port.
1128         - s30-t35-sut1-p3 - 10GE-port3 x553 fiber port.
1129         - s30-t35-sut1-p4 - 10GE-port4 x553 fiber port.
1130 - ServerB31 [Type-B10]:
1131     - testbednames: testbed35.
1132     - hostname: s31-t35-sut2.
1133     - IPMI IP: 10.30.55.13
1134     - Host IP: 10.32.8.13
1135     - portnames:
1136         - s31-t35-sut2-p1 - 10GE-port1 x553 copper port.
1137         - s31-t35-sut2-p2 - 10GE-port2 x553 copper port.
1138         - s31-t35-sut2-p3 - 10GE-port3 x553 fiber port.
1139         - s31-t35-sut2-p4 - 10GE-port4 x553 fiber port.
1140 ```
1141
1142 #### 3-Node-Mcbin (3n-mcb) TODO
1143
1144 ```
1145 To be completed.
1146 ```
1147
1148 ### Per Testbed Wiring
1149
1150 #### 1-Node-Skylake (1n-skx) PROD
1151
1152 ```
1153 - testbed11:
1154     - ring1 10GE-ports x710-4p10GE:
1155         - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1.
1156     - ring2 10GE-ports x710-4p10GE:
1157         - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2.
1158     - ring3 10GE-ports x710-4p10GE:
1159         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1160     - ring4 10GE-ports x710-4p10GE:
1161         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
1162 - testbed12:
1163     - ring1 10GE-ports x710-4p10GE:
1164         - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1.
1165     - ring2 10GE-ports x710-4p10GE:
1166         - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2.
1167     - ring3 10GE-ports x710-4p10GE:
1168         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1169     - ring4 10GE-ports x710-4p10GE:
1170         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
1171 ```
1172
1173 #### 1-Node-Thunderx2 (1n-tx2) WIP
1174
1175 ```
1176 - testbed13:
1177     - ring1 40GE-ports XL710-QDA2-2p40GE on SUTs:
1178         - s27-t13-sut1-c1/p2 - s27-t13-sut1-c3/p1.
1179     - ring2 40GE-ports XL710-QDA2-2p40GE on SUTs:
1180         - s27-t13-sut1-c3/p2 - s27-t13-sut1-c6/p1.
1181     - ring3 40GE-ports XL710-QDA2-2p40GE on SUTs:
1182         - s27-t13-sut1-c6/p2 - s27-t13-sut1-c1/p1.
1183 ```
1184
1185 #### 2-Node-Skylake (2n-skx) PROD
1186
1187 ```
1188 - testbed21:
1189     - ring1 10GE-ports x710-4p10GE on SUT:
1190         - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1.
1191         - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2.
1192     - ring2 10GE-ports x710-4p10GE on SUT:
1193         - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3.
1194         - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4.
1195     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1196         - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1.
1197         - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2.
1198     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1199         - s4-t21-tg1-c9/p1 to s3-t21-sut1-c9/p1.
1200         - s3-t21-sut1-c9/p2 to s4-t21-tg1-c9/p2.
1201     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1202         - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2.
1203         - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4.
1204 - testbed22:
1205     - ring1 10GE-ports x710-4p10GE on SUT:
1206         - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1.
1207         - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2.
1208     - ring2 10GE-ports x710-4p10GE on SUT:
1209         - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3.
1210         - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4.
1211     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1212         - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1.
1213         - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2.
1214     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1215         - t22-tg1-c9/p1 to s5-t22-sut1-c9/p1.
1216         - s5-t22-sut1-c9/p2 to s6-t22-tg1-c9/p2.
1217     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1218         - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2.
1219         - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4.
1220 - testbed23:
1221     - ring1 10GE-ports x710-4p10GE on SUT:
1222         - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1.
1223         - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2.
1224     - ring2 10GE-ports x710-4p10GE on SUT:
1225         - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3.
1226         - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4.
1227     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1228         - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1.
1229         - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2.
1230     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1231         - s8-t23-tg1-c9/p1 to s7-t23-sut1-c9/p1.
1232         - s7-t23-sut1-c9/p2 to s8-t23-tg1-c9/p2.
1233     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1234         - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2.
1235         - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4.
1236 - testbed24:
1237     - ring1 10GE-ports x710-4p10GE on SUT:
1238         - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1.
1239         - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2.
1240     - ring2 10GE-ports x710-4p10GE on SUT:
1241         - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3.
1242         - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4.
1243     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1244         - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1.
1245         - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2.
1246     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1247         - s10-t24-tg1-c9/p1 to s9-t24-sut1-c9/p1.
1248         - s9-t24-sut1-c9/p2 to s10-t24-tg1-c9/p2.
1249     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1250         - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2.
1251         - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
1252 ```
1253
1254 #### 2-Node-Denverton (2n-dnv) WIP
1255
1256 ```
1257 - testbed26:
1258     - ring1 10GE-ports x553 copper port on SUT:
1259         - s28-t26t35-tg1-c4/p1 to s29-t26-sut1-p1.
1260         - s28-t26t35-tg1-c9/p1 to s29-t26-sut1-p2.
1261     - ring2 10GE-ports x553 fiber port on SUT:
1262         - s28-t26t35-tg1-c2/p1 to s29-t26-sut1-p3.
1263         - s28-t26t35-tg1-c2/p2 to s29-t26-sut1-p4.
1264 ```
1265
1266 #### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
1267
1268 ```
1269 - testbed25:
1270     - link1 10GE-port x710-4p10GE on SUT:
1271         - t25-tg1-p1 to t25-sut1-c2/p1.
1272     - link2 10GE-port x710-4p10GE on SUT:
1273         - t25-tg1-p2 to t25-sut1-c2/p2.
1274     - link3 10GE-port x710-4p10GE on SUT:
1275         - t25-tg1-p3 to t25-sut1-c2/p3.
1276     - link4 10GE-port x710-4p10GE on SUT:
1277         - t25-tg1-p4 to t25-sut1-c2/p4.
1278 ```
1279
1280 #### 3-Node-Haswell (3n-hsw) PROD
1281
1282 ```
1283  1. testbed1:
1284     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1285         - t1-tg1-c1/p1 to t1-sut1-c1/p2.
1286         - t1-sut1-c1/p1 to t1-sut2-c1/p2.
1287         - t1-sut2-c1/p1 to t1-tg1-c1/p2.
1288     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1289         - t1-tg1-c2/p1 to t1-sut1-c2/p2.
1290         - t1-sut1-c2/p1 to t1-sut2-c2/p2.
1291         - t1-sut2-c2/p1 to t1-tg1-c2/p2.
1292     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1293         - t1-tg1-c4/p1 to t1-sut1-c4/p2.
1294         - t1-sut1-c4/p1 to t1-sut2-c4/p2.
1295         - t1-sut2-c4/p1 to t1-tg1-c4/p2.
1296     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1297         - t1-tg1-c5/p1 to t1-sut1-c5/p2.
1298         - t1-sut1-c5/p1 to t1-sut2-c5/p2.
1299         - t1-sut2-c5/p1 to t1-tg1-c5/p2.
1300     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1301         - t1-tg1-c2/p1 to t1-sut1-cm/p2.
1302         - t1-sut1-cm/p1 to t1-sut2-cm/p2.
1303         - t1-sut2-cm/p1 to t1-tg1-c2/p2.
1304     - TG loopback ports Intel NIC x710 2p10GE
1305         - t1-tg1-c6/p1 to t1-tg1-c6/p2.
1306
1307  2. testbed2:
1308     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1309         - t2-tg1-c1/p1 to t2-sut1-c1/p2.
1310         - t2-sut1-c1/p1 to t2-sut2-c1/p2.
1311         - t2-sut2-c1/p1 to t2-tg1-c1/p2.
1312     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1313         - t2-tg1-c2/p1 to t2-sut1-c2/p2.
1314         - t2-sut1-c2/p1 to t2-sut2-c2/p2.
1315         - t2-sut2-c2/p1 to t2-tg1-c2/p2.
1316     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1317         - t2-tg1-c4/p1 to t2-sut1-c4/p2.
1318         - t2-sut1-c4/p1 to t2-sut2-c4/p2.
1319         - t2-sut2-c4/p1 to t2-tg1-c4/p2.
1320     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1321         - t2-tg1-c5/p1 to t2-sut1-c5/p2.
1322         - t2-sut1-c5/p1 to t2-sut2-c5/p2.
1323         - t2-sut2-c5/p1 to t2-tg1-c5/p2.
1324     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1325         - t2-tg1-c2/p1 to t2-sut1-cm/p2.
1326         - t2-sut1-cm/p1 to t2-sut2-cm/p2.
1327         - t2-sut2-cm/p1 to t2-tg1-c2/p2.
1328     - TG loopback ports Intel NIC x710 2p10GE
1329         - t2-tg1-c6/p1 to t2-tg1-c6/p2.
1330
1331  3. testbed3:
1332     - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
1333         - t3-tg1-c1/p1 to t3-sut1-c1/p2.
1334         - t3-sut1-c1/p1 to t3-sut2-c1/p2.
1335         - t3-sut2-c1/p1 to t3-tg1-c1/p2.
1336     - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
1337         - t3-tg1-c2/p1 to t3-sut1-c2/p2.
1338         - t3-sut1-c2/p1 to t3-sut2-c2/p2.
1339         - t3-sut2-c2/p1 to t3-tg1-c2/p2.
1340     - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
1341         - t3-tg1-c4/p1 to t3-sut1-c4/p2.
1342         - t3-sut1-c4/p1 to t3-sut2-c4/p2.
1343         - t3-sut2-c4/p1 to t3-tg1-c4/p2.
1344     - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
1345         - t3-tg1-c5/p1 to t3-sut1-c5/p2.
1346         - t3-sut1-c5/p1 to t3-sut2-c5/p2.
1347         - t3-sut2-c5/p1 to t3-tg1-c5/p2.
1348     - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
1349         - t3-tg1-c2/p1 to t3-sut1-cm/p2.
1350         - t3-sut1-cm/p1 to t3-sut2-cm/p2.
1351         - t3-sut2-cm/p1 to t3-tg1-c2/p2.
1352     - TG loopback ports Intel NIC x710 2p10GE
1353         - t3-tg1-c6/p1 to t3-tg1-c6/p2.
1354 ```
1355
1356 #### 3-Node-Skylake (3n-skx) PROD
1357
1358 ```
1359 - testbed31:
1360     - ring1 10GE-ports x710-4p10GE on SUTs:
1361         - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1.
1362         - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2.
1363         - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2.
1364     - ring2 10GE-ports x710-4p10GE on SUT:
1365         - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3.
1366         - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4.
1367         - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4.
1368     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1369         - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1.
1370         - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2.
1371         - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2.
1372     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1373         - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1.
1374         - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2.
1375         - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2.
1376     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1377         - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2.
1378         - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4.
1379 - testbed32:
1380     - ring1 10GE-ports x710-4p10GE on SUTs:
1381         - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1.
1382         - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2.
1383         - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2.
1384     - ring2 10GE-ports x710-4p10GE on SUT:
1385         - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3.
1386         - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4.
1387         - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4.
1388     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
1389         - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1.
1390         - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2.
1391         - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2.
1392     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
1393         - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1.
1394         - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2.
1395         - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2.
1396     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
1397         - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2.
1398         - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4.
1399 ```
1400
1401 #### 3-Node-Rangeley (3n-rng) TODO
1402
1403 ```
1404 To be completed.
1405 ```
1406
1407 #### 3-Node-Taishan (3n-tsh) WIP
1408
1409 ```
1410 - testbed33:
1411     - ring1 10GE-ports x520-2p10GE on SUTs:
1412         - t33t34-tg1-c2/p2 - t33-sut1-c6/p2.
1413         - t33-sut1-c6/p1 - t33-sut2-c6/p2.
1414         - t33-sut2-c6/p1 - t33t34-tg1-c2/p1.
1415     - ring2 25GE-ports cx4-2p25GE on SUTs:
1416         - t33t34-tg1-c4/p2 - t33-sut1-c4/p2.
1417         - t33-sut1-c4/p1 - t33-sut2-c4/p2.
1418         - t33-sut2-c4/p1 - t33t34-tg1-c4/p1.
1419 ```
1420
1421 #### 3-Node-Mcbin (3n-mcb) WIP
1422
1423 ```
1424 - testbed34:
1425     - ring1 10GE-ports Marvell on SUTs:
1426         - t33t34-tg1-c2/p3 - t34-sut1-ca/p1.
1427         - t34-sut1-ca/p2 - t34-sut2-ca/p1.
1428         - t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
1429 ```
1430
1431 #### 3-Node-Denverton (3n-dnv) WIP
1432
1433 ```
1434 - testbed35:
1435     - ring1 10GE-ports x553 copper port on SUTs:
1436         - s28-t26t35-tg1-c8/p1 to s30-t35-sut1-p2.
1437         - s30-t35-sut1-p1 to s31-t35-sut2-p1.
1438         - s28-t26t35-tg1-c10/p1 to s31-t35-sut2-p2.
1439     - ring2 10GE-ports x553 fiber port on SUTs:
1440         - s28-t26t35-tg1-c6/p1 to s30-t35-sut1-p4.
1441         - s30-t35-sut1-p3 to s31-t35-sut2-p3.
1442         - s28-t26t35-tg1-c6/p2 to s31-t35-sut2-p4.
1443 ```
1444
1445 ## Inventory
1446
1447 ### Appliances
1448
1449 ```
1450 1. Ixia PerfectStorm One Appliance
1451     - 1 * PS10GE4NG
1452         - Chassis: PS10GE4NG.
1453         - Motherboard: SuperMicro X11DPG-QT.
1454         - Processors: Quad-Core, Intel Processor.
1455         - HW accelerators: FPGA offload.
1456         - RAM Memory: 64GB.
1457         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
1458         - Physical Interfaces: 4 * 10GE SFP+.
1459         - Operating System: Native IxOS.
1460 ```
1461
1462 ### Arm Servers
1463
1464 ```
1465 1. Arm Cortex A-72 servers
1466     - 1 * ThunderX2
1467         - Chassis: Marvell ThunderX2
1468         - Processors: 2* ThunderX2 CN9975 ~ 112* ThunderX2.
1469         - RAM Memory: 4* 32GB RDIMM
1470         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
1471     - 2 * Huawei TaiShan 2280.
1472         - Chassis: Huawei TaiShan 2280.
1473         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72.
1474         - RAM Memory: 8* 16GB DDR4-2400MT/s.
1475         - Disks: 1* 4TB SATA HDD.
1476     - 3 * MACCHIATObin
1477         - Chassis: MACCHIATObin.
1478         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72.
1479         - RAM Memory: 1* 16GB DDR4.
1480         - Disks: 1* 128GB(?) SATA SDD.
1481 ```
1482
1483 ### Xeon and Atom Servers
1484
1485 ```
1486 1. Intel Xeon servers:
1487     - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors.
1488         - Chassis: SuperMicro SYS-7049GP-TRT.
1489         - Motherboard: SuperMicro X11DPG-QT.
1490         - Processors: 2* Intel Platinum 8180 2.3 GHz.
1491         - RAM Memory: 16* 16GB DDR4-2666MHz.
1492         - Disks: 2* 1.6TB 6G SATA SSD.
1493 2. Intel Atom servers with Rangely processors.
1494     - 3 * Netgate XG-2758-1u
1495         - Chassis: Netgate XG-2758-1u
1496         - Processors: 1* Rangely (Atom) C2758 2.4 GHz
1497         - RAM Memory: 16GB ECC
1498         - Disks: 150 GB
1499 ```
1500
1501 ### Network Interface Cards
1502
1503 ```
1504 1. 10GE NICs
1505     - 14 * Intel® Ethernet Converged Network Adapter X710-DA4
1506     - 6 * Intel® Ethernet Converged Network Adapter X710-DA2
1507     - 6 * Intel® Ethernet Converged Network Adapter X520-DA2
1508 2. 25GE NICs
1509     - 12 * Intel® Ethernet Network Adapter XXV710-DA2
1510 3. 40GE NICs
1511     - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2
1512 4. 100GE NICs
1513     - 4 * mcx556a-edat NICs (not on site yet, in transit)
1514 ```
1515
1516 ### Pluggables and Cables
1517
1518 Pluggables:
1519
1520 ```
1521 1. 10GE SFP+
1522     - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics
1523     - 80 * 10G SR optic (generic, "Intel" compatible branded)
1524 2. 25GE SFP28
1525     - None
1526 3. 40GE QSFP+
1527     - None
1528 4. 100GE
1529     - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit)
1530 ```
1531
1532 Standalone cables:
1533
1534 ```
1535 1. 10GE
1536     - None
1537 2. 25GE
1538     - None
1539 3. 40GE QSFP+
1540     - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable
1541 4. 100GE
1542     - None
1543 ```
1544
1545 ### Other Parts
1546
1547 None.