docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md

   1 ## FD.io CSIT testbeds - Xeon Skylake, Arm, Atom
   2 This is a low-level design implemented as an extensions of FD.io CSIT lab to accommodate the new Intel Xeon Skylake, Arm AArch64 and Atom devices. Content has been copied from [FD.io CSIT testbeds wiki page: Xeon_skx, Arm, Atom](https://wiki.fd.io/view/CSIT/Testbeds:_Xeon_Skx,_Arm,_Atom).
   3
   4 ## Testbeds Overview
   5 ### Testbeds Type Breakdown
   6 ```
   7  #.  CSIT_tb.           Purpose.    SUT.  TG.   #tb.  #SUTs.  #TGs. #skx_node.
   8  1.  1-node Xeon.       func.       skx.  n/a.  2.    2.      0.    2.
   9  2.  2-node Xeon.       perf.       skx.  skx.  4.    4.      4.    8.
  10  3.  3-node Xeon.       perf.       skx.  skx.  2.    4.      2.    6.
  11  4.  tcp-l47.           tcp-stack.  skx.  ps1.  1.    1.      1.    1.
  12  5.  atom-netgate.      perf+func.  net.  skx.  1.    3.      1.    1.
  13  6.  aarch64-d05        perf+func.  arm.  skx.  2.    2.      1.    1.
  14  7.  aarch64-mcbin      perf        arm.  skx.  1.    2.      1.    1.
  15                                                  Total skx_node:   20.
  16 ```
  17
  18 ### 1-Node Xeon Testbeds
  19 One 1-node Xeon testbed for VPP_Device tests is built using one SUT (Type-6 server), with NIC ports connected back-to-back.
  20
  21 ### 2-Node Xeon Testbeds
  22 Four 2-node Xeon testbeds (are expected to be built|are built), with each testbed using one SUTs (Type-1 server) and one TG (Type-2 server) connected back-to-back. NIC cards placement into slots and NIC ports connectivity is following the testbed specification included in next sections.
  23
  24 ### 3-Node Xeon Testbeds
  25 Two 3-node Xeon testbeds (are expected to be built|are built), with each testbed using two SUTs (Type-1 server) and one TG (Type-2 server) connected in full-mesh triangle. NIC cards placement into slots and NIC ports connectivity is following the testbed specification included in next sections.
  26
  27 ### Arm Testbeds
  28 One 3-node Huawei testbeds (are expected to be built|are built), with each testbed using two SUTs (Type-3 server) and one TG (Type-2 server) connected in full-mesh triangle.
  29
  30 One 3-node Marvell testbeds (are expected to be built|are built), with each testbed using two SUTs (Type-4 server) and one TG (Type-2 server) connected in full-mesh triangle.
  31
  32 ### TCP/IP and L47 Testbeds
  33 One 2-node Ixia PS One and Xeon server testbed, for TCP/IP host stack tests.
  34
  35 ### Atom Testbeds
  36 One 3-node Atom (Netgate based) testbed is built consisting of three SUTs (Type-5 Netgate device.) NIC cards placement into slots and NIC ports connectivity is following the testbed specification included in the next section.
  37
  38 ## Inventory
  39 ### Appliances
  40 ```
  41 1. Ixia PerfectStorm One Appliance
  42     - 1 * PS10GE4NG
  43         - Chassis: PS10GE4NG.
  44         - Motherboard: SuperMicro X11DPG-QT.
  45         - Processors: Quad-Core, Intel Processor.
  46         - HW accelerators: FPGA offload.
  47         - RAM Memory: 64GB.
  48         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
  49         - Physical Interfaces: 4 * 10GE SFP+.
  50         - Operating System: Native IxOS.
  51 ```
  52
  53 ### Arm Servers
  54 ```
  55 1. Arm Cortex A-72 servers
  56     - 2 * Huawei TaiShan 2280.
  57         - Chassis: Huawei TaiShan 2280.
  58         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72.
  59         - RAM Memory: 8* 16GB DDR4-2400MT/s.
  60         - Disks: 1* 4TB SATA HDD.
  61     - 3 * MACCHIATObin
  62         - Chassis: MACCHIATObin.
  63         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72.
  64         - RAM Memory: 1* 16GB DDR4.
  65         - Disks: 1* 128GB(?) SATA SDD.
  66 ```
  67
  68 Platform Name and Specification | Role | Status | Hostname | IP | IPMI | Cores | RAM | Ethernet | Distro
  69 ------------------------------- | ---- | ------ | -------- | -- | ---- | ----- | --- | -------- | ------
  70 [SoftIron OverDrive 1000](https://softiron.com/development-tools/overdrive-1000/) | CI build server | Up, Not Running Jobs | softiron-1 | 10.30.51.12 | N/A | 4 | 8GB |  | openSUSE
  71   | CI build server | Up, Not Running Jobs | softiron-2 | 10.30.51.13 | N/A | 4 | 8GB |   | openSUSE
  72   | CI build server | Up, Not Running Jobs | softiron-3 | 10.30.51.14 | N/A | 4 | 8GB |   | openSUSE
  73 [Cavium ThunderX](https://cavium.com/product-thunderx-arm-processors.html) | CI build server | Up, Running VPP CI | nomad3arm | 10.30.51.38 | 10.30.50.38 | 96 | 128GB | 3x40GbE QSFP+ / 4x10GbE SFP+ | Ubuntu 16.04
  74   | CI build server | Up, Running VPP CI | nomad4arm | 10.30.51.39 | 10.30.50.39 | 96 | 128GB | 3x40GbE QSFP+ / 4x10GbE SFP+ | Ubuntu 16.04
  75   | CI build server | Up, Running VPP CI | nomad5arm | 10.30.51.40 | 10.30.50.40 | 96 | 128GB | 3x40GbE QSFP+ / 4x10GbE SFP+ | Ubuntu 16.04
  76   | CI build server | Up, Not Running Jobs, USB_NIC broken, QSFP wiring to be added | fdio-cavium4 | 10.30.51.65 | 10.30.50.65 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 18.04.1
  77   | VPP dev debug | Up | fdio-cavium5 | 10.30.51.66 | 10.30.50.66 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 18.04.1
  78   | CI build server | Up, Not Running Jobs, USB_NIC broken, QSFP wiring to be added | fdio-cavium6 | 10.30.51.67 | 10.30.50.67 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 16.04.1
  79   | VPP dev debug | Up | fdio-cavium7 | 10.30.51.68 | 10.30.50.68 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 16.04.1
  80 Huawei TaiShan 2280 | CSIT Performance | Up, Manual perf experiments | s17-t33-sut1 | 10.30.51.36 | 10.30.50.36 | 64 | 128GB | 2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4 | Ubuntu 17.10
  81   | CSIT Performance | Up, Manual perf experiments | s18-t33-sut2 | 10.30.51.37 | 10.30.50.37 | 64 | 128GB | 2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4 | Ubuntu 17.10
  82 [Marvell MACCHIATObin](http://macchiatobin.net/) | CSIT Performance | Up, Manual experiments, Full Skx TG too much for it - suggest to use LXC/DRC TG(!) | s20-t34-sut1 | 10.30.51.41 | 10.30.51.49, then connect to /dev/ttyUSB0 | 4 | 16GB | 2x10GbE SFP+ | Ubuntu 16.04.4
  83   | CSIT Performance | Up, Manual experiments, Full Skx TG too much for it - suggest to use LXC/DRC TG(!) | s21-t34-sut2 | 10.30.51.42 | 10.30.51.49, then connect to /dev/ttyUSB1 | 4 | 16GB | 2x10GbE SFP+ | Ubuntu 16.04.5
  84   | VPP dev debug | Up, Manual VPP Device experiments, Full Skx TG too much for it - suggest to use LXC/DRC TG(!) | fdio-mcbin3 | 10.30.51.43 | 10.30.51.49, then connect to /dev/ttyUSB2 | 4 | 16GB | 2x10GbE SFP+ | Ubuntu 16.04.5
  85
  86 ### Xeon and Atom Servers
  87 ```
  88 1. Intel Xeon servers:
  89     - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors.
  90         - Chassis: SuperMicro SYS-7049GP-TRT.
  91         - Motherboard: SuperMicro X11DPG-QT.
  92         - Processors: 2* Intel Platinum 8180 2.3 GHz.
  93         - RAM Memory: 16* 16GB DDR4-2666MHz.
  94         - Disks: 2* 1.6TB 6G SATA SSD.
  95 2. Intel Atom servers with Rangely processors.
  96     - 3 * Netgate XG-2758-1u
  97         - Chassis: Netgate XG-2758-1u
  98         - Processors: 1* Rangely (Atom) C2758 2.4 GHz
  99         - RAM Memory: 16GB ECC
 100         - Disks: 150 GB
 101 ```
 102
 103 ### Network Interface Cards
 104 ```
 105 1. 10GE NICs
 106     - 14 * Intel® Ethernet Converged Network Adapter X710-DA4
 107     - 6 * Intel® Ethernet Converged Network Adapter X710-DA2
 108     - 6 * Intel® Ethernet Converged Network Adapter X520-DA2
 109 2. 25GE NICs
 110     - 12 * Intel® Ethernet Network Adapter XXV710-DA2
 111 3. 40GE NICs
 112     - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2
 113 4. 100GE NICs
 114     - 4 * mcx556a-edat NICs (not on site yet, in transit)
 115 ```
 116
 117 ### Pluggables and Cables
 118 Pluggables:
 119 ```
 120 1. 10GE SFP+
 121     - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics
 122     - 80 * 10G SR optic (generic, "Intel" compatible branded)
 123 2. 25GE SFP28
 124     - None
 125 3. 40GE QSFP+
 126     - None
 127 4. 100GE
 128     - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit)
 129 ```
 130
 131 Standalone cables:
 132 ```
 133 1. 10GE
 134     - None
 135 2. 25GE
 136     - None
 137 3. 40GE QSFP+
 138     - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable
 139 4. 100GE
 140     - None
 141 ```
 142
 143 ### Other Network Cards
 144 Any QATs?
 145
 146 ## Installation Status
 147 Lab installation status is tracked by LF IT team in [FD.io Server Status](https://docs.google.com/document/d/16TdvGC73wuNQjkP355MTXRckv7yqnaxJkWwX7G7izEo/edit?ts=5b10411b#heading=h.dprb64shku8u).
 148
 149 ## Server/Device Management and Naming
 150 ### Server Management Requirements
 151 Total of 20 SM SYS-7049GP-TRT servers are made available for FD.IO CSIT testbed.
 152 For management purposes, each server must have following two ports connected to the management network:
 153 ```
 154 - 1GE IPMI port
 155   - IPMI - Intelligent Platform Management Interface.
 156   - Required for access to embedded server management with WebUI, CLI, SNMPv3, IPMIv2.0, for firmware (BIOS) and OS updates.
 157 - 1GE/10GE management port
 158   - hostOS management port for general system management.
 159 ```
 160
 161 ### Server and Port Naming Convention
 162 Following naming convention is used within this page to specify physical connectivity and wiring across defined CSIT testbeds:
 163 ```
 164 - testbedname: testbedN.
 165 - hostname:
 166     - traffic-generator: tN-tgW.
 167     - system-under-testX: tN-sutX.
 168 - portnames:
 169     - tN-tgW-cY/pZ.
 170     - tN-sutX-cY/pZ.
 171 - where:
 172     - N - testbed number.
 173     - tgW - server acts as traffic-generator with W index.
 174     - sutX - server acts as system-under-test with X index.
 175     - Y - PCIe slot number denoting a NIC card number within the host.
 176         - Y=2,4,9 - slots connected to NUMA node 0.
 177         - Y=6,8,10 - slots connected to NUMA node 1.
 178     - Z - port number on the NIC card.
 179 ```
 180
 181 ### Server Management - Addressing
 182 Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management port, which are connected to two different VLANs.
 183 ```
 184 1. LOM (IPMI) VLAN:
 185     - Subnet: 10.30.50.0/24
 186     - Gateway: 10.30.50.1
 187     - Broadcast: 10.30.50.255
 188     - DNS1: 199.204.44.24
 189     - DNS2: 199.204.47.54
 190 2. Management Vlan:
 191     - Subnet: 10.30.51.0/24
 192     - Gateway: 10.30.51.1
 193     - Broadcast: 10.30.51.255
 194     - DNS1: 199.204.44.24
 195     - DNS2: 199.204.47.54
 196 ```
 197 To access these hosts, an VPN connection is required.
 198
 199 ### LOM (IPMI) VLAN IP Addresses
 200 ..
 201
 202 ### Management VLAN IP Addresses
 203 ..
 204
 205 ## Testbeds Specification - Target Build
 206 ### Server/Ports Naming, NIC Placement
 207 #### 1-Node Xeon
 208 Each server in 1-node Xeon topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 209 ```
 210 - Server1 [Type-6]:
 211     - testbedname: testbed11.
 212     - hostname: s1-t11-sut1.
 213     - IPMI IP: 10.30.50.47
 214     - Host IP: 10.30.51.50
 215     - portnames:
 216         - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 217         - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 218         - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 219         - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 220         - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
 221         - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
 222         - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
 223         - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
 224 - Server2 [Type-6]:
 225     - testbedname: testbed12.
 226     - hostname: s2-t12-sut1.
 227     - IPMI IP: 10.30.50.48
 228     - Host IP: 10.30.51.51
 229     - portnames:
 230         - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 231         - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 232         - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 233         - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 234         - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
 235         - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
 236         - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
 237         - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
 238 ```
 239
 240 #### 2-Node Xeon
 241 Each server in 2-node Xeon topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 242 ```
 243 - Server3 [Type-1]:
 244     - testbedname: testbed21.
 245     - hostname: s3-t21-sut1.
 246     - IPMI IP: 10.30.50.41
 247     - Host IP: 10.30.51.44
 248     - portnames:
 249         - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 250         - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 251         - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 252         - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 253         - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 254         - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 255         - s3-t21-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 256         - s3-t21-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 257 - Server4 [Type-2]:
 258     - testbedname: testbed21.
 259     - hostname: s4-t21-tg1.
 260     - IPMI IP: 10.30.50.42
 261     - Host IP: 10.30.51.45
 262     - portnames:
 263         - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 264         - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 265         - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 266         - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 267         - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 268         - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 269         - s4-t21-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 270         - s4-t21-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 271 - Server5 [Type-1]:
 272     - testbedname: testbed22.
 273     - hostname: s5-t22-sut1.
 274     - IPMI IP: 10.30.50.49
 275     - Host IP: 10.30.51.52
 276     - portnames:
 277         - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 278         - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 279         - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 280         - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 281         - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 282         - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 283         - s5-t22-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 284         - s5-t22-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 285 - Server6 [Type-2]:
 286     - testbedname: testbed22.
 287     - hostname: s6-t22-tg1.
 288     - IPMI IP: 10.30.50.50
 289     - Host IP: 10.30.51.53
 290     - portnames:
 291         - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 292         - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 293         - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 294         - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 295         - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 296         - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 297         - s6-t22-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 298         - s6-t22-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 299 - Server7 [Type-1]:
 300     - testbedname: testbed23.
 301     - hostname: s7-t23-sut1.
 302     - IPMI IP: 10.30.50.51
 303     - Host IP: 10.30.51.54
 304     - portnames:
 305         - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 306         - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 307         - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 308         - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 309         - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 310         - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 311         - s7-t23-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 312         - s7-t23-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 313 - Server8 [Type-2]:
 314     - testbedname: testbed23.
 315     - hostname: s8-t23-tg1.
 316     - IPMI IP: 10.30.50.52
 317     - Host IP: 10.30.51.55
 318     - portnames:
 319         - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 320         - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 321         - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 322         - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 323         - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 324         - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 325         - s8-t23-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 326         - s8-t23-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 327 - Server9 [Type-1]:
 328     - testbedname: testbed24.
 329     - hostname: s9-t24-sut1.
 330     - IPMI IP: 10.30.50.53
 331     - Host IP: 10.30.51.56
 332     - portnames:
 333         - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 334         - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 335         - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 336         - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 337         - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 338         - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 339         - s9-t24-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 340         - s9-t24-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 341 - Server10 [Type-2]:
 342     - testbedname: testbed24.
 343     - hostname: s10-t24-tg1.
 344     - IPMI IP: 10.30.50.54
 345     - Host IP: 10.30.51.57
 346     - portnames:
 347         - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 348         - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 349         - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 350         - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 351         - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 352         - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 353         - s10-t24-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 354         - s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 355 ```
 356
 357 #### 3-Node Xeon
 358 Each server in 3-node Xeon topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 359 ```
 360 - Server11 [Type-1]:
 361     - testbedname: testbed31.
 362     - hostname: s11-t31-sut1.
 363     - IPMI IP: 10.30.50.43
 364     - Host IP: 10.30.51.46
 365     - portnames:
 366         - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 367         - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 368         - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 369         - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 370         - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 371         - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 372         - s11-t31-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 373         - s11-t31-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 374 - Server12 [Type-1]:
 375     - testbedname: testbed31.
 376     - hostname: s12-t31-sut2.
 377     - IPMI IP: 10.30.50.44
 378     - Host IP: 10.30.51.47
 379     - portnames:
 380         - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
 381         - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
 382         - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
 383         - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
 384         - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 385         - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 386         - s12-t31-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 387         - s12-t31-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 388 - Server13 [Type-2]:
 389     - testbedname: testbed31.
 390     - hostname: s13-t31-tg1.
 391     - IPMI IP: 10.30.50.45
 392     - Host IP: 10.30.51.48
 393     - portnames:
 394         - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 395         - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 396         - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 397         - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 398         - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 399         - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 400         - s13-t31-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 401         - s13-t31-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 402 - Server14 [Type-1]:
 403     - testbedname: testbed32.
 404     - hostname: s14-t32-sut1.
 405     - IPMI IP: 10.30.50.55
 406     - Host IP: 10.30.51.58
 407     - portnames:
 408         - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 409         - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 410         - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 411         - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 412         - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 413         - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 414         - s14-t32-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 415         - s14-t32-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 416 - Server15 [Type-1]:
 417     - testbedname: testbed32.
 418     - hostname: s15-t32-sut2.
 419     - IPMI IP: 10.30.50.56
 420     - Host IP: 10.30.51.59
 421     - portnames:
 422         - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
 423         - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
 424         - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
 425         - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
 426         - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 427         - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 428         - s15-t32-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 429         - s15-t32-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 430 - Server16 [Type-2]:
 431     - testbedname: testbed32.
 432     - hostname: s16-t32-tg1.
 433     - IPMI IP: 10.30.50.57
 434     - Host IP: 10.30.51.60
 435     - portnames:
 436         - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 437         - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 438         - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 439         - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 440         - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 441         - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 442         - s16-t32-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 443         - s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 444 ```
 445
 446 #### 3-Node Arm
 447 Note: Server19 (TG) is shared between testbed33 & testbed34
 448 ```
 449 - Server17 [Type-3]:
 450     - testbedname: testbed33.
 451     - hostname: s17-t33-sut1.
 452     - IPMI IP: 10.30.50.36
 453     - Host IP: 10.30.51.36
 454     - portnames:
 455         - s17-t33-sut1-c6/p1 - 10GE-port1 82599-2p10GE.
 456         - s17-t33-sut1-c6/p2 - 10GE-port2 82599-2p10GE.
 457         - s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE.
 458         - s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE.
 459 - Server18 [Type-3]:
 460     - testbedname: testbed33.
 461     - hostname: s18-t33-sut2.
 462     - IPMI IP: 10.30.50.37
 463     - Host IP: 10.30.51.37
 464     - portnames:
 465         - s18-t33-sut2-c6/p1 - 10GE-port1 82599-2p10GE.
 466         - s18-t33-sut2-c6/p2 - 10GE-port2 82599-2p10GE.
 467         - s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE.
 468         - s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE.
 469 - Server19 [Type-2]:
 470     - testbednames: testbed33 and testbed34.
 471     - hostname: s19-t33t34-tg1.
 472     - IPMI IP: 10.30.50.46
 473     - Host IP: 10.30.51.49
 474     - portnames:
 475         - s19-t33t34-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 476         - s19-t33t34-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 477         - s19-t33t34-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 478         - s19-t33t34-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 479         - s19-t33t34-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 480         - s19-t33t34-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 481         - s19-t33t34-tg1-c10/p1 - 10GE-port1 x710-4p10GE.
 482         - s19-t33t34-tg1-c10/p2 - 10GE-port2 x710-4p10GE.
 483         - s19-t33t34-tg1-c10/p3 - 10GE-port3 x710-4p10GE.
 484         - s19-t33t34-tg1-c10/p4 - 10GE-port4 x710-4p10GE.
 485 - Server20 [Type-4]:
 486     - testbedname: testbed34.
 487     - hostname: s20-t34-sut1.
 488     - IPMI IP: N/A
 489     - Host IP: 10.30.51.41
 490     - portnames:
 491         - s20-t34-sut1-ca/p1 - 10GE-port1 Marvell.
 492         - s20-t34-sut1-ca/p2 - 10GE-port2 Marvell.
 493 - Server21 [Type-4]:
 494     - testbedname: testbed34.
 495     - hostname: s21-t34-sut2.
 496     - IPMI IP: N/A
 497     - Host IP: 10.30.51.42
 498     - portnames:
 499         - s21-t34-sut2-ca/p1 - 10GE-port1 Marvell.
 500         - s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
 501 ```
 502
 503 #### TCP/IP and L47
 504 Each server (appliance) in 2-node TCP/IP topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 505 ```
 506 - Server25 [Type-8]:
 507     - testbedname: testbed25.
 508     - hostname: s25-t25-sut1.
 509     - IPMI IP: 10.30.50.58
 510     - Host IP: 10.30.51.61
 511     - portnames:
 512         - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 513         - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 514         - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 515         - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 516 - Server26 [Type-7]:
 517     - testbedname: testbed25.
 518     - hostname: s26-t25-tg1.
 519     - IPMI IP: 10.30.50.59
 520     - Host IP: 10.30.51.62
 521     - portnames:
 522         - s26-t25-tg1-p1 - 10GE-port1.
 523         - s26-t25-tg1-p2 - 10GE-port2.
 524         - s26-t25-tg1-p3 - 10GE-port3.
 525         - s26-t25-tg1-p4 - 10GE-port4.
 526 ```
 527
 528 #### 3-Node Atom
 529 Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
 530 ```
 531 - Server22 [Type-5]:
 532     - testbedname: testbed35.
 533     - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1).
 534     - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0
 535     - Host IP: 10.30.51.9
 536     - portnames:
 537         - s22-t35-sut1-p1 - 10GE-port1 ix0 82599.
 538         - s22-t35-sut1-p2 - 10GE-port2 ix1 82599.
 539     - 1GB ports (tbd)
 540 - Server23 [Type-5]:
 541     - testbedname: testbed35.
 542     - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2).
 543     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1
 544     - Host IP: 10.30.51.10
 545     - portnames:
 546         - s23-t35-sut1-p1 - 10GE-port1 ix0 82599.
 547         - s23-t35-sut1-p2 - 10GE-port2 ix1 82599.
 548     - 1GB ports (tbd)
 549 - Server24 [Type-5]:
 550     - testbedname: testbed35.
 551     - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3).
 552     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2
 553     - Host IP: 10.30.51.11
 554     - portnames:
 555         - s24-t35-sut1-p1 - 10GE-port1 ix0 82599.
 556         - s24-t35-sut1-p2 - 10GE-port2 ix1 82599.
 557     - 1GB ports (tbd)
 558 ```
 559
 560 ### Physical Connectivity within Testbeds
 561 #### 1-Node Xeon
 562 Two 1-Node testbeds are constructed by connecting 2 Xeon servers using below specification:
 563 ```
 564 - testbed11:
 565     - ring1 10GE-ports x710-4p10GE:
 566         - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1.
 567     - ring2 10GE-ports x710-4p10GE:
 568         - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2.
 569     - ring3 10GE-ports x710-4p10GE:
 570         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
 571     - ring4 10GE-ports x710-4p10GE:
 572         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
 573 - testbed12:
 574     - ring1 10GE-ports x710-4p10GE:
 575         - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1.
 576     - ring2 10GE-ports x710-4p10GE:
 577         - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2.
 578     - ring3 10GE-ports x710-4p10GE:
 579         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
 580     - ring4 10GE-ports x710-4p10GE:
 581         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
 582 ```
 583
 584 #### 2-Node Xeon
 585 Four 2-Node testbeds are constructed by connecting 8 Xeon servers using below specification:
 586 ```
 587 - testbed21:
 588     - ring1 10GE-ports x710-4p10GE on SUT:
 589         - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1.
 590         - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2.
 591     - ring2 10GE-ports x710-4p10GE on SUT:
 592         - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3.
 593         - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4.
 594     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 595         - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1.
 596         - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2.
 597     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 598         - s4-t21-tg1-c9/p1 to s3-t21-sut1-c9/p1.
 599         - s3-t21-sut1-c9/p2 to s4-t21-tg1-c9/p2.
 600     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 601         - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2.
 602         - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4.
 603 - testbed22:
 604     - ring1 10GE-ports x710-4p10GE on SUT:
 605         - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1.
 606         - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2.
 607     - ring2 10GE-ports x710-4p10GE on SUT:
 608         - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3.
 609         - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4.
 610     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 611         - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1.
 612         - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2.
 613     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 614         - t22-tg1-c9/p1 to s5-t22-sut1-c9/p1.
 615         - s5-t22-sut1-c9/p2 to s6-t22-tg1-c9/p2.
 616     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 617         - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2.
 618         - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4.
 619 - testbed23:
 620     - ring1 10GE-ports x710-4p10GE on SUT:
 621         - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1.
 622         - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2.
 623     - ring2 10GE-ports x710-4p10GE on SUT:
 624         - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3.
 625         - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4.
 626     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 627         - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1.
 628         - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2.
 629     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 630         - s8-t23-tg1-c9/p1 to s7-t23-sut1-c9/p1.
 631         - s7-t23-sut1-c9/p2 to s8-t23-tg1-c9/p2.
 632     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 633         - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2.
 634         - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4.
 635 - testbed24:
 636     - ring1 10GE-ports x710-4p10GE on SUT:
 637         - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1.
 638         - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2.
 639     - ring2 10GE-ports x710-4p10GE on SUT:
 640         - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3.
 641         - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4.
 642     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 643         - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1.
 644         - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2.
 645     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 646         - s10-t24-tg1-c9/p1 to s9-t24-sut1-c9/p1.
 647         - s9-t24-sut1-c9/p2 to s10-t24-tg1-c9/p2.
 648     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 649         - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2.
 650         - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
 651 ```
 652
 653 #### 3-Node Xeon
 654 Two 3-Node testbeds are constructed by connecting 6 Xeon servers using below specification:
 655 ```
 656 - testbed31:
 657     - ring1 10GE-ports x710-4p10GE on SUTs:
 658         - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1.
 659         - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2.
 660         - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2.
 661     - ring2 10GE-ports x710-4p10GE on SUT:
 662         - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3.
 663         - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4.
 664         - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4.
 665     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 666         - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1.
 667         - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2.
 668         - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2.
 669     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 670         - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1.
 671         - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2.
 672         - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2.
 673     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 674         - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2.
 675         - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4.
 676 - testbed32:
 677     - ring1 10GE-ports x710-4p10GE on SUTs:
 678         - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1.
 679         - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2.
 680         - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2.
 681     - ring2 10GE-ports x710-4p10GE on SUT:
 682         - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3.
 683         - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4.
 684         - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4.
 685     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 686         - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1.
 687         - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2.
 688         - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2.
 689     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 690         - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1.
 691         - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2.
 692         - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2.
 693     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 694         - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2.
 695         - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4.
 696 ```
 697
 698 #### 3-Node Arm
 699 One 3-Node testbed is constructed by connecting 2 TaiShan servers and one Xeon server using below specification:
 700 ```
 701 - testbed33:
 702     - ring1 10GE-ports 82599-2p10GE on SUTs:
 703         - t33t34-tg1-c2/p2 - t33-sut1-c6/p2.
 704         - t33-sut1-c6/p1 - t33-sut2-c6/p2.
 705         - t33-sut2-c6/p1 - t33t34-tg1-c2/p1.
 706     - ring2 25GE-ports cx4-2p25GE on SUTs:
 707         - t33t34-tg1-c4/p2 - t33-sut1-c4/p2.
 708         - t33-sut1-c4/p1 - t33-sut2-c4/p2.
 709         - t33-sut2-c4/p1 - t33t34-tg1-c4/p1.
 710 ```
 711 One 3-Node testbed is constructed by connecting 2 MACCHIATObin servers and one Xeon server using below specification:
 712 ```
 713 - testbed34:
 714     - ring1 10GE-ports Marvell on SUTs:
 715         - t33t34-tg1-c2/p3 - t34-sut1-ca/p1.
 716         - t34-sut1-ca/p2 - t34-sut2-ca/p1.
 717         - t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
 718 ```
 719
 720 #### TCP/IP and L47
 721 One 2-Node TCP/IP testbed is constructed by connecting Ixia PSOne and 1 Xeon server using below specification:
 722 ```
 723 - testbed25:
 724     - link1 10GE-port x710-4p10GE on SUT:
 725         - t25-tg1-p1 to t25-sut1-c2/p1.
 726     - link2 10GE-port x710-4p10GE on SUT:
 727         - t25-tg1-p2 to t25-sut1-c2/p2.
 728     - link3 10GE-port x710-4p10GE on SUT:
 729         - t25-tg1-p3 to t25-sut1-c2/p3.
 730     - link4 10GE-port x710-4p10GE on SUT:
 731         - t25-tg1-p4 to t25-sut1-c2/p4.
 732 ```
 733
 734 #### 3-Node Atom
 735 ..
 736
 737 ## Server Specification
 738 ### Hardware Configuration
 739 The new FD.io CSIT-CPL lab (is expected to contain|contains) following hardware server configurations:
 740 ```
 741 1. Type-1: Purpose - (Intel Xeon Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 742     - Quantity: TBD based on testbed allocation.
 743     - Physical connectivity:
 744         - IPMI and host management ports.
 745         - NIC ports connected into 2-node and 3-node topologies.
 746     - Main HW configuration:
 747         - Chassis: SuperMicro SYS-7049GP-TRT.
 748         - Motherboard: SuperMicro X11DPG-QT.
 749         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 750         - RAM Memory: 16* 16GB DDR4-2666MHz.
 751         - Disks: 2* 1.6TB 6G SATA SSD.
 752     - NICs configuration:
 753         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 754             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 755             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
 756             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
 757         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 758             - PCIe Slot6 86:00.xx: empty.
 759             - PCIe Slot8 af:00.xx: empty.
 760             - PCIe Slot10 d8:00.xx: empty.
 761 2. Type-2: Purpose - (Intel Xeon Processor) TG for T-Rex.
 762     - Quantity: TBD based on testbed allocation.
 763     - Physical connectivity:
 764         - IPMI and host management ports.
 765         - NIC ports connected into 2-node and 3-node topologies.
 766     - Main HW configuration:
 767         - Chassis: SuperMicro SYS-7049GP-TRT.
 768         - Motherboard: SuperMicro X11DPG-QT.
 769         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 770         - RAM Memory: 16* 16GB DDR4-2666MHz.
 771         - Disks: 2* 1.6TB 6G SATA SSD.
 772     - NICs configuration:
 773         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 774             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 775             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
 776             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
 777         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 778             - PCIe Slot6 86:00.xx: empty.
 779             - PCIe Slot8 af:00.xx: empty.
 780             - PCIe Slot10 d8:00.xx: x710-4p10GE Intel.
 781 3. Type-3: Purpose - (Arm hip07-d05 Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 782     - Quantity: 2
 783     - Physical connectivity:
 784         - IPMI(?) and host management ports.
 785         - NIC ports connected into 3-node topology.
 786     - Main HW configuration:
 787         - Chassis: Huawei TaiShan 2280.
 788         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72
 789         - RAM Memory: 8* 16GB DDR4-2400MT/s
 790         - Disks: 1* 4TB SATA HDD
 791     - NICs configuration:
 792         - PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox.
 793         - PCIe Slot6 11:00.xx: 82599-2p10GE Intel.
 794 4. Type-4: Purpose - (Arm Armada 8040 Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 795     - Quantity: 3
 796     - Physical connectivity:
 797         - Host management ports.
 798         - NIC ports connected into 2-node and 3-node topologies.
 799     - Main HW configuration:
 800         - Chassis: MACCHIATObin.
 801         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72
 802         - RAM Memory: 1* 16GB DDR4
 803         - Disks: 1* 128GB(?) SATA SDD
 804     - NICs configuration:
 805         - pp2-2p10GE Marvell (on-chip Ethernet ports ; marvell plugin in VPP)
 806 5. Type-5: Purpose - (Intel Atom Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 807     - Quantity: TBD based on testbed allocation.
 808     - Physical connectivity:
 809         - Management: serial Port (usb) for console
 810         - NIC ports connected into 2-node.
 811     - Main HW configuration:
 812         - Chassis: Netgate XG-2758-1u
 813         - Processors: 1* Rangeley (Atom) C2758 2.4 GHz
 814         - RAM Memory: 16GB ECC
 815         - Disks: 150 GB
 816     - NICs configuration:
 817         - 2x 10Gb Intel 82599ES
 818         - 4x 1GB Intel I354
 819 6. Type-6: Purpose - (Intel Xeon Processor) SUT for VPP_Device functional tests.
 820     - Quantity: 1.
 821     - Physical connectivity:
 822         - IPMI and host management ports.
 823         - NIC ports connected into 2-node and 3-node topologies.
 824     - Main HW configuration:
 825         - Chassis: SuperMicro SYS-7049GP-TRT.
 826         - Motherboard: SuperMicro X11DPG-QT.
 827         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 828         - RAM Memory: 16* 16GB DDR4-2666MHz.
 829         - Disks: 2* 1.6TB 6G SATA SSD.
 830     - NICs configuration:
 831         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 832             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 833             - PCIe Slot4 3b:00.xx: x710-4p10GE Intel.
 834             - PCIe Slot9 5e:00.xx: empty.
 835         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 836             - PCIe Slot6 86:00.xx: empty.
 837             - PCIe Slot8 af:00.xx: empty.
 838             - PCIe Slot10 d8:00.xx: empty.
 839 7. Type-7: Purpose - Ixia PerfectStorm One Appliance TG for TCP/IP performance tests.
 840     - Quantity: 1.
 841     - Physical connectivity:
 842         - Host management interface: 10/100/1000-BaseT.
 843         - 8-port 10GE SFP+ integrated NIC.
 844     - Main HW configuration:
 845         - Chassis: PS10GE4NG.
 846         - Motherboard: SuperMicro X11DPG-QT.
 847         - Processors: Quad-Core, Intel Processor.
 848         - HW accelerators: FPGA offload.
 849         - RAM Memory: 64GB.
 850         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
 851         - Physical Interfaces: 4 * 10GE SFP+.
 852         - Operating System: Native IxOS.
 853     - Interface configuration:
 854         - Port-1: 10GE SFP+.
 855         - Port-2: 10GE SFP+.
 856         - Port-3: 10GE SFP+.
 857         - Port-4: 10GE SFP+.
 858 8. Type-8: Purpose - (Intel Xeon Processor) SUT for TCP/IP host stack tests.
 859     - Quantity: 1.
 860     - Physical connectivity:
 861         - IPMI and host management ports.
 862         - NIC ports.
 863     - Main HW configuration:
 864         - Chassis: SuperMicro SYS-7049GP-TRT.
 865         - Motherboard: SuperMicro X11DPG-QT.
 866         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 867         - RAM Memory: 16* 16GB DDR4-2666MHz.
 868         - Disks: 2* 1.6TB 6G SATA SSD.
 869     - NICs configuration:
 870         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 871             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 872             - PCIe Slot4 3b:00.xx: empty.
 873             - PCIe Slot9 5e:00.xx: empty.
 874         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 875             - PCIe Slot6 86:00.xx: empty.
 876             - PCIe Slot8 af:00.xx: empty.
 877             - PCIe Slot10 d8:00.xx: empty.
 878 9. Type-9: Purpose - (Cavium ThunderX2 Processor) SUT for VPP_Device functional tests.
 879     - Quantity: 1
 880     - Physical connectivity:
 881         - IPMI and host management ports.
 882         - NIC ports connected into 1-node topologies.
 883     - Main HW configuration:
 884         - Chassis: Gigabyte R181-T90 1U
 885         - Motheboard: MT91-FS1
 886         - Processors: 1* ThunderX2 ARMv8 CN9975 2.0 GHz
 887         - RAM Memory: 4* 32GB RDIMM
 888         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
 889     - NICs configuration:
 890         - PCIe Slotx <TBD>: XL710-QDA2.
 891         - PCIe Sloty <TBD>: XL710-QDA2.
 892   - PCIe Slotz <TBD>: XL710-QDA2.
 893 10. Type-10: Purpose - (Intel Atom C3000 Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 894     - Quantity: 4
 895     - Physical connectivity:
 896         - IPMI and host management ports.
 897         - NIC ports.
 898     - Main HW configuration:
 899         - Chassis: SuperMicro SYS-E300-9A
 900         - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
 901         - RAM Memory: 32GB ECC
 902         - Disks: 480 GB
 903     - NICs configuration:
 904         - 2x 10Gb Intel x553 fiber ports
 905         - 2x 10Gb Intel x553 copper ports
 906         - 4x 1GB Intel I350 ports
 907 ```
 908
 909 ### Xeon Skx Server BIOS Configuration
 910 #### Boot Feature
 911 ```
 912   |  Quiet Boot                                [Enabled]               |Boot option                  |
 913   |                                                                    |                             |
 914   |  Option ROM Messages                       [Force BIOS]            |                             |
 915   |  Bootup NumLock State                      [On]                    |                             |
 916   |  Wait For "F1" If Error                    [Enabled]               |                             |
 917   |  INT19 Trap Response                       [Immediate]             |                             |
 918   |  Re-try Boot                               [Disabled]              |                             |
 919   |  Install Windows 7 USB support             [Disabled]              |                             |
 920   |  Port 61h Bit-4 Emulation                  [Disabled]              |                             |
 921   |                                                                    |                             |
 922   |  Power Configuration                                               |                             |
 923   |  Watch Dog Function                        [Disabled]              |                             |
 924   |  Restore on AC Power Loss                  [Last State]            |                             |
 925   |  Power Button Function                     [Instant Off]           |                             |
 926   |  Throttle on Power Fail                    [Disabled]              |                             |
 927 ```
 928
 929 #### CPU Configuration
 930 ```
 931   |  Processor Configuration                                           |Enables Hyper Threading      |
 932   |  --------------------------------------------------                |(Software Method to          |
 933   |  Processor BSP Revision                    50654 - SKX H0          |Enable/Disable Logical       |
 934   |  Processor Socket                          CPU1      |  CPU2       |Processor threads.           |
 935   |  Processor ID                              00050654* |  000506...  |                             |
 936   |  Processor Frequency                       2.500GHz  |  2.500GHz   |                             |
 937   |  Processor Max Ratio                            19H  |  19H        |                             |
 938   |  Processor Min Ratio                            0AH  |  0AH        |                             |
 939   |  Microcode Revision                        02000030                |                             |
 940   |  L1 Cache RAM                                  64KB  |      64KB   |                             |
 941   |  L2 Cache RAM                                1024KB  |    1024KB   |                             |
 942   |  L3 Cache RAM                               39424KB  |   39424KB   |                             |
 943   |  Processor 0 Version                                               |                             |
 944   |  Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz                      |                             |
 945   |  Processor 1 Version                                               |                             |
 946   |  Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz                      |                             |
 947   |                                                                    |                             |
 948   |  Hyper-Threading [ALL]                     [Enable]                |                             |
 949   |  Core Disable Bitmap(Hex)                  0                       |                             |
 950   |  Execute Disable Bit                       [Enable]                |                             |
 951   |  Intel Virtualization Technology           [Enable]                |                             |
 952   |  PPIN Control                              [Unlock/Enable]         |                             |
 953   |  Hardware Prefetcher                       [Enable]                |                             |
 954   |  Adjacent Cache Prefetch                   [Enable]                |                             |
 955   |  DCU Streamer Prefetcher                   [Enable]                |                             |
 956   |  DCU IP Prefetcher                         [Enable]                |                             |
 957   |  LLC Prefetch                              [Disable]               |                             |
 958   |  Extended APIC                             [Disable]               |                             |
 959   |  AES-NI                                    [Enable]                |                             |
 960   |> Advanced Power Management Configuration                           |                             |
 961 ```
 962
 963 ##### Advanced Power Management Configuration
 964 ```
 965   |  Advanced Power Management Configuration                           |Switch CPU Power Management  |
 966   |  --------------------------------------------------                |profile                      |
 967   |  Power Technology                          [Custom]                |                             |
 968   |  Power Performance Tuning                  [BIOS Controls EPB]     |                             |
 969   |  ENERGY_PERF_BIAS_CFG mode                 [Maximum Performance]   |                             |
 970   |> CPU P State Control                                               |                             |
 971   |> Hardware PM State Control                                         |                             |
 972   |> CPU C State Control                                               |                             |
 973   |> Package C State Control                                           |                             |
 974   |> CPU T State Control                                               |                             |
 975 ```
 976
 977 ###### CPU P State Control
 978 ```
 979   |  CPU P State Control                                               |Enable/Disable EIST          |
 980   |                                                                    |(P-States)                   |
 981   |  SpeedStep (Pstates)                       [Disable]               |                             |
 982   |  EIST PSD Function                         [HW_ALL]                |                             |
 983 ```
 984
 985 ###### Hardware PM State Control
 986 ```
 987   |  Hardware PM State Control                                         |Disable: Hardware chooses a  |
 988   |                                                                    |P-state based on OS Request  |
 989   |  Hardware P-States                         [Disable]               |(Legacy P-States)            |
 990   |                                                                    |Native Mode:Hardware         |
 991   |                                                                    |chooses a P-state based on   |
 992   |                                                                    |OS guidance                  |
 993   |                                                                    |Out of Band Mode:Hardware    |
 994   |                                                                    |autonomously chooses a       |
 995   |                                                                    |P-state (no OS guidance)     |
 996 ```
 997
 998 ###### CPU C State Control
 999 ```
1000   |  CPU C State Control                                               |Autonomous Core C-State      |
1001   |                                                                    |Control                      |
1002   |  Autonomous Core C-State                   [Disable]               |                             |
1003   |  CPU C6 report                             [Disable]               |                             |
1004   |  Enhanced Halt State (C1E)                 [Disable]               |                             |
1005 ```
1006
1007 ###### Package C State Control
1008 ```
1009   |  Package C State Control                                           |Package C State limit        |
1010   |                                                                    |                             |
1011   |  Package C State                           [C0/C1 state]           |                             |
1012 ```
1013
1014 ###### CPU T State Control
1015 ```
1016   |  CPU T State Control                                               |Enable/Disable Software      |
1017   |                                                                    |Controlled T-States          |
1018   |  Software Controlled T-States              [Disable]               |                             |
1019 ```
1020
1021 ##### Chipset Configuration
1022 ```
1023   |  WARNING: Setting wrong values in below sections may cause         |North Bridge Parameters      |
1024   |           system to malfunction.                                   |                             |
1025   |> North Bridge                                                      |                             |
1026   |> South Bridge                                                      |                             |
1027 ```
1028
1029 ###### North Bridge
1030 ```
1031   |> UPI Configuration                                                 |Displays and provides        |
1032   |> Memory Configuration                                              |option to change the UPI     |
1033   |> IIO Configuration                                                 |Settings                     |
1034 ```
1035
1036 ###### UPI Configuration
1037 ```
1038   |  UPI Configuration                                                 |Choose Topology Precedence   |
1039   |  --------------------------------------------------                |to degrade features if       |
1040   |  Number of CPU                             2                       |system options are in        |
1041   |  Number of Active UPI Link                 3                       |conflict or choose Feature   |
1042   |  Current UPI Link Speed                    Fast                    |Precedence to degrade        |
1043   |  Current UPI Link Frequency                10.4 GT/s               |topology if system options   |
1044   |  UPI Global MMIO Low Base / Limit          90000000 / FBFFFFFF     |are in conflict.             |
1045   |  UPI Global MMIO High Base / Limit         0000000000000000 / ...  |                             |
1046   |  UPI Pci-e Configuration Base / Size       80000000 / 10000000     |                             |
1047   |  Degrade Precedence                        [Topology Precedence]   |                             |
1048   |  Link L0p Enable                           [Disable]               |                             |
1049   |  Link L1 Enable                            [Disable]               |                             |
1050   |  IO Directory Cache (IODC)                 [Auto]                  |                             |
1051   |  SNC                                       [Disable]               |                             |
1052   |  XPT Prefetch                              [Disable]               |                             |
1053   |  KTI Prefetch                              [Enable]                |                             |
1054   |  Local/Remote Threshold                    [Auto]                  |                             |
1055   |  Stale AtoS                                [Disable]               |                             |
1056   |  LLC dead line alloc                       [Enable]                |                             |
1057   |  Isoc Mode                                 [Auto]                  |                             |
1058 ```
1059
1060 ###### Memory Configuration
1061 ```
1062   |                                                                    |POR - Enforces Plan Of       |
1063   |  --------------------------------------------------                |Record restrictions for      |
1064   |  Integrated Memory Controller (iMC)                                |DDR4 frequency and voltage   |
1065   |  --------------------------------------------------                |programming. Disable -       |
1066   |                                                                    |Disables this feature.       |
1067   |  Enforce POR                               [Disable]               |                             |
1068   |  Memory Frequency                          [2666]                  |                             |
1069   |  Data Scrambling for NVMDIMM               [Auto]                  |                             |
1070   |  Data Scrambling for DDR4                  [Auto]                  |                             |
1071   |  tCCD_L Relaxation                         [Auto]                  |                             |
1072   |  Memory tRWSR Relaxation                   [Enable]                |                             |
1073   |  2X REFRESH                                [Auto]                  |                             |
1074   |  Page Policy                               [Auto]                  |                             |
1075   |  IMC Interleaving                          [2-way Interleave]      |                             |
1076   |> Memory Topology                                                   |                             |
1077   |> Memory RAS Configuration                                          |                             |
1078 ```
1079
1080 ###### IIO Configuration
1081 ```
1082   |  IIO Configuration                                                 |Expose IIO DFX devices and   |
1083   |  --------------------------------------------------                |other CPU devices like PMON  |
1084   |                                                                    |                             |
1085   |  EV DFX Features                           [Disable]               |                             |
1086   |> CPU1 Configuration                                                |                             |
1087   |> CPU2 Configuration                                                |                             |
1088   |> IOAT Configuration                                                |                             |
1089   |> Intel. VT for Directed I/O (VT-d)                                 |                             |
1090   |> Intel. VMD technology                                             |                             |
1091   |                                                                    |                             |
1092   |   IIO-PCIE Express Global Options                                  |                             |
1093   |  ========================================                          |                             |
1094   |  PCI-E Completion Timeout Disable          [No]                    |                             |
1095 ```
1096
1097 ###### CPU1 Configuration
1098 ```
1099   |  IOU0 (IIO PCIe Br1)                       [Auto]                  |Selects PCIe port            |
1100   |  IOU1 (IIO PCIe Br2)                       [Auto]                  |Bifurcation for selected     |
1101   |  IOU2 (IIO PCIe Br3)                       [Auto]                  |slot(s)                      |
1102   |> CPU1 SLOT2 PCI-E 3.0 X16                                          |                             |
1103   |> CPU1 SLOT4 PCI-E 3.0 X16                                          |                             |
1104   |> CPU1 SLOT9 PCI-E 3.0 X16                                          |                             |
1105 ```
1106
1107 ###### CPU2 Configuration
1108 ```
1109   |  IOU0 (IIO PCIe Br1)                       [Auto]                  |Selects PCIe port            |
1110   |  IOU1 (IIO PCIe Br2)                       [Auto]                  |Bifurcation for selected     |
1111   |  IOU2 (IIO PCIe Br3)                       [Auto]                  |slot(s)                      |
1112   |> CPU2 SLOT6 PCI-E 3.0 X16                                          |                             |
1113   |> CPU2 SLOT8 PCI-E 3.0 X16                                          |                             |
1114   |> CPU2 SLOT10 PCI-E 3.0 X16                                         |                             |
1115 ```
1116
1117 ##### South Bridge
1118 ```
1119   |                                                                    |Enables Legacy USB support.  |
1120   |  USB Module Version                        17                      |AUTO option disables legacy  |
1121   |                                                                    |support if no USB devices    |
1122   |  USB Devices:                                                      |are connected. DISABLE       |
1123   |        1 Keyboard, 1 Mouse, 1 Hub                                  |option will keep USB         |
1124   |                                                                    |devices available only for   |
1125   |  Legacy USB Support                        [Enabled]               |EFI applications.            |
1126   |  XHCI Hand-off                             [Disabled]              |                             |
1127   |  Port 60/64 Emulation                      [Enabled]               |                             |
1128   |  PCIe PLL SSC                              [Disable]               |                             |
1129   |  Real USB Wake Up                          [Enabled]               |                             |
1130   |  Front USB Wake Up                         [Enabled]               |                             |
1131   |                                                                    |                             |
1132   |  Azalia                                    [Auto]                  |                             |
1133   |    Azalia PME Enable                       [Disabled]              |                             |
1134 ```
1135
1136 #### PCIe/PCI/PnP Configuration
1137 ```
1138   |  PCI Bus Driver Version                    A5.01.12                |Enables or Disables 64bit    |
1139   |                                                                    |capable Devices to be        |
1140   |  PCI Devices Common Settings:                                      |Decoded in Above 4G Address  |
1141   |  Above 4G Decoding                         [Enabled]               |Space (Only if System        |
1142   |  SR-IOV Support                            [Enabled]               |Supports 64 bit PCI          |
1143   |  MMIO High Base                            [56T]                   |Decoding).                   |
1144   |  MMIO High Granularity Size                [256G]                  |                             |
1145   |  Maximum Read Request                      [Auto]                  |                             |
1146   |  MMCFG Base                                [2G]                    |                             |
1147   |  NVMe Firmware Source                      [Vendor Defined Fi...]  |                             |
1148   |  VGA Priority                              [Onboard]               |                             |
1149   |  CPU1 SLOT2 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1150   |  CPU1 SLOT4 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1151   |  CPU2 SLOT6 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1152   |  CPU2 SLOT8 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1153   |  CPU1 SLOT9 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1154   |  CPU2 SLOT10 PCI-E 3.0 X16 OPROM           [Legacy]                |                             |
1155   |  CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM     [Legacy]                |                             |
1156   |  M.2 CONNECTOR OPROM                       [Legacy]                |                             |
1157   |  Onboard LAN1 Option ROM                   [Legacy]                |                             |
1158   |  Onboard LAN2 Option ROM                   [Disabled]              |                             |
1159   |  Onboard Video Option ROM                  [Legacy]                |                             |
1160   |> Network Stack Configuration                                       |                             |
1161 ```
1162
1163 #### ACPI Settings
1164 ```
1165   |  ACPI Settings                                                     |Enable or Disable Non        |
1166   |                                                                    |uniform Memory Access        |
1167   |  NUMA                                      [Enabled]               |(NUMA).                      |
1168   |  WHEA Support                              [Enabled]               |                             |
1169   |  High Precision Event Timer                [Enabled]               |                             |
1170   |  ACPI Sleep State                          [S3 (Suspend to RAM)]   |                             |
1171 ```
1172
1173 #### DMIDECODE
1174 ```
1175   # dmidecode 3.1
1176   Getting SMBIOS data from sysfs.
1177   SMBIOS 3.1.1 present.
1178   Table at 0x000E89C0.
1179
1180   Handle 0x0000, DMI type 0, 26 bytes
1181   BIOS Information
1182         Vendor: American Megatrends Inc.
1183         Version: 2.0
1184         Release Date: 11/29/2017
1185         Address: 0xF0000
1186         Runtime Size: 64 kB
1187         ROM Size: 64 MB
1188         Characteristics:
1189                 PCI is supported
1190                 BIOS is upgradeable
1191                 BIOS shadowing is allowed
1192                 Boot from CD is supported
1193                 Selectable boot is supported
1194                 BIOS ROM is socketed
1195                 EDD is supported
1196                 5.25"/1.2 MB floppy services are supported (int 13h)
1197                 3.5"/720 kB floppy services are supported (int 13h)
1198                 3.5"/2.88 MB floppy services are supported (int 13h)
1199                 Print screen service is supported (int 5h)
1200                 Serial services are supported (int 14h)
1201                 Printer services are supported (int 17h)
1202                 ACPI is supported
1203                 USB legacy is supported
1204                 BIOS boot specification is supported
1205                 Targeted content distribution is supported
1206                 UEFI is supported
1207         BIOS Revision: 5.12
1208
1209   Handle 0x0001, DMI type 1, 27 bytes
1210   System Information
1211         Manufacturer: Supermicro
1212         Product Name: SYS-7049GP-TRT
1213         Version: 0123456789
1214         Serial Number: S291427X8332242
1215         UUID: 00000000-0000-0000-0000-AC1F6B8A8DB6
1216         Wake-up Type: Power Switch
1217         SKU Number: To be filled by O.E.M.
1218         Family: To be filled by O.E.M.
1219
1220   Handle 0x0002, DMI type 2, 15 bytes
1221   Base Board Information
1222         Manufacturer: Supermicro
1223         Product Name: X11DPG-QT
1224         Version: 1.02
1225         Serial Number: VM183S014930
1226         Asset Tag: To be filled by O.E.M.
1227         Features:
1228                 Board is a hosting board
1229                 Board is replaceable
1230         Location In Chassis: To be filled by O.E.M.
1231         Chassis Handle: 0x0003
1232         Type: Motherboard
1233         Contained Object Handles: 0
1234
1235   Handle 0x0003, DMI type 3, 22 bytes
1236   Chassis Information
1237         Manufacturer: Supermicro
1238         Type: Other
1239         Lock: Not Present
1240         Version: 0123456789
1241         Serial Number: C7470KH06A20167
1242         Asset Tag: To be filled by O.E.M.
1243         Boot-up State: Safe
1244         Power Supply State: Safe
1245         Thermal State: Safe
1246         Security Status: None
1247         OEM Information: 0x00000000
1248
1249   Handle 0x0050, DMI type 4, 48 bytes
1250   Processor Information
1251         Socket Designation: CPU1
1252         Type: Central Processor
1253         Family: Xeon
1254         Manufacturer: Intel(R) Corporation
1255         ID: 54 06 05 00 FF FB EB BF
1256         Signature: Type 0, Family 6, Model 85, Stepping 4
1257         Flags:
1258                 FPU (Floating-point unit on-chip)
1259                 VME (Virtual mode extension)
1260                 DE (Debugging extension)
1261                 PSE (Page size extension)
1262                 TSC (Time stamp counter)
1263                 MSR (Model specific registers)
1264                 PAE (Physical address extension)
1265                 MCE (Machine check exception)
1266                 CX8 (CMPXCHG8 instruction supported)
1267                 APIC (On-chip APIC hardware supported)
1268                 SEP (Fast system call)
1269                 MTRR (Memory type range registers)
1270                 PGE (Page global enable)
1271                 MCA (Machine check architecture)
1272                 CMOV (Conditional move instruction supported)
1273                 PAT (Page attribute table)
1274                 PSE-36 (36-bit page size extension)
1275                 CLFSH (CLFLUSH instruction supported)
1276                 DS (Debug store)
1277                 ACPI (ACPI supported)
1278                 MMX (MMX technology supported)
1279                 FXSR (FXSAVE and FXSTOR instructions supported)
1280                 SSE (Streaming SIMD extensions)
1281                 SSE2 (Streaming SIMD extensions 2)
1282                 SS (Self-snoop)
1283                 HTT (Multi-threading)
1284                 TM (Thermal monitor supported)
1285                 PBE (Pending break enabled)
1286         Version: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz
1287         Voltage: 1.6 V
1288         External Clock: 100 MHz
1289         Max Speed: 4000 MHz
1290         Current Speed: 2500 MHz
1291         Status: Populated, Enabled
1292         Upgrade: Other
1293         L1 Cache Handle: 0x004D
1294         L2 Cache Handle: 0x004E
1295         L3 Cache Handle: 0x004F
1296         Serial Number: Not Specified
1297         Asset Tag: UNKNOWN
1298         Part Number: Not Specified
1299         Core Count: 28
1300         Core Enabled: 28
1301         Thread Count: 56
1302         Characteristics:
1303                 64-bit capable
1304                 Multi-Core
1305                 Hardware Thread
1306                 Execute Protection
1307                 Enhanced Virtualization
1308                 Power/Performance Control
1309
1310
1311   Handle 0x0054, DMI type 4, 48 bytes
1312   Processor Information
1313         Socket Designation: CPU2
1314         Type: Central Processor
1315         Family: Xeon
1316         Manufacturer: Intel(R) Corporation
1317         ID: 54 06 05 00 FF FB EB BF
1318         Signature: Type 0, Family 6, Model 85, Stepping 4
1319         Flags:
1320                 FPU (Floating-point unit on-chip)
1321                 VME (Virtual mode extension)
1322                 DE (Debugging extension)
1323                 PSE (Page size extension)
1324                 TSC (Time stamp counter)
1325                 MSR (Model specific registers)
1326                 PAE (Physical address extension)
1327                 MCE (Machine check exception)
1328                 CX8 (CMPXCHG8 instruction supported)
1329                 APIC (On-chip APIC hardware supported)
1330                 SEP (Fast system call)
1331                 MTRR (Memory type range registers)
1332                 PGE (Page global enable)
1333                 MCA (Machine check architecture)
1334                 CMOV (Conditional move instruction supported)
1335                 PAT (Page attribute table)
1336                 PSE-36 (36-bit page size extension)
1337                 CLFSH (CLFLUSH instruction supported)
1338                 DS (Debug store)
1339                 ACPI (ACPI supported)
1340                 MMX (MMX technology supported)
1341                 FXSR (FXSAVE and FXSTOR instructions supported)
1342                 SSE (Streaming SIMD extensions)
1343                 SSE2 (Streaming SIMD extensions 2)
1344                 SS (Self-snoop)
1345                 HTT (Multi-threading)
1346                 TM (Thermal monitor supported)
1347                 PBE (Pending break enabled)
1348         Version: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz
1349         Voltage: 1.6 V
1350         External Clock: 100 MHz
1351         Max Speed: 4000 MHz
1352         Current Speed: 2500 MHz
1353         Status: Populated, Enabled
1354         Upgrade: Other
1355         L1 Cache Handle: 0x0051
1356         L2 Cache Handle: 0x0052
1357         L3 Cache Handle: 0x0053
1358         Serial Number: Not Specified
1359         Asset Tag: UNKNOWN
1360         Part Number: Not Specified
1361         Core Count: 28
1362         Core Enabled: 28
1363         Thread Count: 56
1364         Characteristics:
1365                 64-bit capable
1366                 Multi-Core
1367                 Hardware Thread
1368                 Execute Protection
1369                 Enhanced Virtualization
1370                 Power/Performance Control
1371 ```
1372
1373 ### Xeon Skx Server Firmware Inventory
1374 ```
1375 Host.           IPMI IP.      BIOS. CPLD.     Aptio SU.   CPU Microcode.  PCI Bus.   ME Operation FW.    X710 Firmware.            XXV710 Firmware.          i40e.
1376 s1-t11-sut1.    10.30.50.47.  2.1.  03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1377 s2-t12-sut1.    10.30.50.48.  2.1.  03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1378 s3-t21-sut1.    10.30.50.41.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1379 s4-t21-tg1.     10.30.50.42.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1380 s5-t22-sut1.    10.30.50.49.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1381 s6-t22-tg1.     10.30.50.50.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1382 s7-t23-sut1.    10.30.50.51.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1383 s8-t23-tg1.     10.30.50.52.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1384 s9-t24-sut1.    10.30.50.53.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1385 s10-t24-tg1.    10.30.50.54.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1386 s11-t31-sut1.   10.30.50.43.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1387 s12-t31-sut2.   10.30.50.44.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1388 s13-t31-tg1.    10.30.50.45.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1389 s14-t32-sut1.   10.30.50.55.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1390 s15-t32-sut2.   10.30.50.56.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1391 s16-t32-tg1.    10.30.50.57.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1392 s19-t33t34-tg1. 10.30.50.46.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1393 ```