docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md

   1 ## FD.io CSIT testbeds - Xeon Skylake, Arm, Atom
   2 This is a low-level design implemented as an extensions of FD.io CSIT lab to accommodate the new Intel Xeon Skylake, Arm AArch64 and Atom devices. Content has been copied from [FD.io CSIT testbeds wiki page: Xeon_skx, Arm, Atom](https://wiki.fd.io/view/CSIT/Testbeds:_Xeon_Skx,_Arm,_Atom).
   3
   4 ## Testbeds Overview
   5 ### Testbeds Type Breakdown
   6 ```
   7  #.  CSIT_tb.           Purpose.    SUT.  TG.   #tb.  #SUTs.  #TGs. #skx_node.
   8  1.  1-node Xeon.       func.       skx.  n/a.  2.    2.      0.    2.
   9  2.  2-node Xeon.       perf.       skx.  skx.  4.    4.      4.    8.
  10  3.  3-node Xeon.       perf.       skx.  skx.  2.    4.      2.    6.
  11  4.  tcp-l47.           tcp-stack.  skx.  ps1.  1.    1.      1.    1.
  12  5.  atom-netgate.      perf+func.  net.  skx.  1.    3.      1.    1.
  13  6.  aarch64-d05        perf+func.  arm.  skx.  2.    2.      1.    1.
  14  7.  aarch64-mcbin      perf        arm.  skx.  1.    2.      1.    1.
  15                                                  Total skx_node:   20.
  16 ```
  17
  18 ### 1-Node Xeon Testbeds
  19 One 1-node Xeon testbed for VPP_Device tests is built using one SUT (Type-6 server), with NIC ports connected back-to-back.
  20
  21 ### 2-Node Xeon Testbeds
  22 Four 2-node Xeon testbeds (are expected to be built|are built), with each testbed using one SUTs (Type-1 server) and one TG (Type-2 server) connected back-to-back. NIC cards placement into slots and NIC ports connectivity is following the testbed specification included in next sections.
  23
  24 ### 3-Node Xeon Testbeds
  25 Two 3-node Xeon testbeds (are expected to be built|are built), with each testbed using two SUTs (Type-1 server) and one TG (Type-2 server) connected in full-mesh triangle. NIC cards placement into slots and NIC ports connectivity is following the testbed specification included in next sections.
  26
  27 ### Arm Testbeds
  28 One 3-node Huawei testbeds (are expected to be built|are built), with each testbed using two SUTs (Type-3 server) and one TG (Type-2 server) connected in full-mesh triangle.
  29
  30 One 3-node Marvell testbeds (are expected to be built|are built), with each testbed using two SUTs (Type-4 server) and one TG (Type-2 server) connected in full-mesh triangle.
  31
  32 ### TCP/IP and L47 Testbeds
  33 One 2-node Ixia PS One and Xeon server testbed, for TCP/IP host stack tests.
  34
  35 ### Atom Testbeds
  36 One 3-node Atom (Netgate based) testbed is built consisting of three SUTs (Type-5 Netgate device.) NIC cards placement into slots and NIC ports connectivity is following the testbed specification included in the next section.
  37
  38 ## Inventory
  39 ### Appliances
  40 ```
  41 1. Ixia PerfectStorm One Appliance
  42     - 1 * PS10GE4NG
  43         - Chassis: PS10GE4NG.
  44         - Motherboard: SuperMicro X11DPG-QT.
  45         - Processors: Quad-Core, Intel Processor.
  46         - HW accelerators: FPGA offload.
  47         - RAM Memory: 64GB.
  48         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
  49         - Physical Interfaces: 4 * 10GE SFP+.
  50         - Operating System: Native IxOS.
  51 ```
  52
  53 ### Arm Servers
  54 ```
  55 1. Arm Cortex A-72 servers
  56     - 2 * Huawei TaiShan 2280.
  57         - Chassis: Huawei TaiShan 2280.
  58         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72.
  59         - RAM Memory: 8* 16GB DDR4-2400MT/s.
  60         - Disks: 1* 4TB SATA HDD.
  61     - 3 * MACCHIATObin
  62         - Chassis: MACCHIATObin.
  63         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72.
  64         - RAM Memory: 1* 16GB DDR4.
  65         - Disks: 1* 128GB(?) SATA SDD.
  66 ```
  67
  68 Platform Name and Specification | Role | Status | Hostname | IP | IPMI | Cores | RAM | Ethernet | Distro
  69 ------------------------------- | ---- | ------ | -------- | -- | ---- | ----- | --- | -------- | ------
  70 [SoftIron OverDrive 1000](https://softiron.com/development-tools/overdrive-1000/) | CI build server | Up, Not Running Jobs | softiron-1 | 10.30.51.12 | N/A | 4 | 8GB |  | openSUSE
  71   | CI build server | Up, Not Running Jobs | softiron-2 | 10.30.51.13 | N/A | 4 | 8GB |   | openSUSE
  72   | CI build server | Up, Not Running Jobs | softiron-3 | 10.30.51.14 | N/A | 4 | 8GB |   | openSUSE
  73 [Cavium ThunderX](https://cavium.com/product-thunderx-arm-processors.html) | CI build server | Up, Running VPP CI | nomad3arm | 10.30.51.38 | 10.30.50.38 | 96 | 128GB | 3x40GbE QSFP+ / 4x10GbE SFP+ | Ubuntu 16.04
  74   | CI build server | Up, Running VPP CI | nomad4arm | 10.30.51.39 | 10.30.50.39 | 96 | 128GB | 3x40GbE QSFP+ / 4x10GbE SFP+ | Ubuntu 16.04
  75   | CI build server | Up, Running VPP CI | nomad5arm | 10.30.51.40 | 10.30.50.40 | 96 | 128GB | 3x40GbE QSFP+ / 4x10GbE SFP+ | Ubuntu 16.04
  76   | CI build server | Up, Not Running Jobs, USB_NIC broken, QSFP wiring to be added | fdio-cavium4 | 10.30.51.65 | 10.30.50.65 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 18.04.1
  77   | VPP dev debug | Up | fdio-cavium5 | 10.30.51.66 | 10.30.50.66 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 18.04.1
  78   | CI build server | Up, Not Running Jobs, USB_NIC broken, QSFP wiring to be added | fdio-cavium6 | 10.30.51.67 | 10.30.50.67 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 16.04.1
  79   | VPP dev debug | Up | fdio-cavium7 | 10.30.51.68 | 10.30.50.68 | 96 | 256GB | 2xQSFP+ / USB Ethernet | Ubuntu 16.04.1
  80 Huawei TaiShan 2280 | CSIT Performance | Up, Manual perf experiments | s15-t33-sut1 | 10.30.51.36 | 10.30.50.36 | 64 | 128GB | 2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4 | Ubuntu 17.10
  81   | CSIT Performance | Up, Manual perf experiments | s16-t33-sut2 | 10.30.51.37 | 10.30.50.37 | 64 | 128GB | 2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4 | Ubuntu 17.10
  82 [Marvell MACCHIATObin](http://macchiatobin.net/) | CSIT Performance | Up, Manual experiments, Full Skx TG too much for it - suggest to use LXC/DRC TG(!) | s20-t34-sut1 | 10.30.51.41 | 10.30.51.49, then connect to /dev/ttyUSB0 | 4 | 16GB | 2x10GbE SFP+ | Ubuntu 16.04.4
  83   | CSIT Performance | Up, Manual experiments, Full Skx TG too much for it - suggest to use LXC/DRC TG(!) | s21-t34-sut2 | 10.30.51.42 | 10.30.51.49, then connect to /dev/ttyUSB1 | 4 | 16GB | 2x10GbE SFP+ | Ubuntu 16.04.5
  84   | VPP dev debug | Up, Manual VPP Device experiments, Full Skx TG too much for it - suggest to use LXC/DRC TG(!) | fdio-mcbin3 | 10.30.51.43 | 10.30.51.49, then connect to /dev/ttyUSB2 | 4 | 16GB | 2x10GbE SFP+ | Ubuntu 16.04.5
  85
  86 ### Xeon and Atom Servers
  87 ```
  88 1. Intel Xeon servers:
  89     - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors.
  90         - Chassis: SuperMicro SYS-7049GP-TRT.
  91         - Motherboard: SuperMicro X11DPG-QT.
  92         - Processors: 2* Intel Platinum 8180 2.3 GHz.
  93         - RAM Memory: 16* 16GB DDR4-2666MHz.
  94         - Disks: 2* 1.6TB 6G SATA SSD.
  95 2. Intel Atom servers with Rangely processors.
  96     - 3 * Netgate XG-2758-1u
  97         - Chassis: Netgate XG-2758-1u
  98         - Processors: 1* Rangely (Atom) C2758 2.4 GHz
  99         - RAM Memory: 16GB ECC
 100         - Disks: 150 GB
 101 ```
 102
 103 ### Network Interface Cards
 104 ```
 105 1. 10GE NICs
 106     - 14 * Intel® Ethernet Converged Network Adapter X710-DA4
 107     - 6 * Intel® Ethernet Converged Network Adapter X710-DA2
 108     - 6 * Intel® Ethernet Converged Network Adapter X520-DA2
 109 2. 25GE NICs
 110     - 12 * Intel® Ethernet Network Adapter XXV710-DA2
 111 3. 40GE NICs
 112     - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2
 113 4. 100GE NICs
 114     - 4 * mcx556a-edat NICs (not on site yet, in transit)
 115 ```
 116
 117 ### Pluggables and Cables
 118 Pluggables:
 119 ```
 120 1. 10GE SFP+
 121     - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics
 122     - 80 * 10G SR optic (generic, "Intel" compatible branded)
 123 2. 25GE SFP28
 124     - None
 125 3. 40GE QSFP+
 126     - None
 127 4. 100GE
 128     - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit)
 129 ```
 130
 131 Standalone cables:
 132 ```
 133 1. 10GE
 134     - None
 135 2. 25GE
 136     - None
 137 3. 40GE QSFP+
 138     - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable
 139 4. 100GE
 140     - None
 141 ```
 142
 143 ### Other Network Cards
 144 Any QATs?
 145
 146 ## Installation Status
 147 Lab installation status is tracked by LF IT team in [FD.io Server Status](https://docs.google.com/document/d/16TdvGC73wuNQjkP355MTXRckv7yqnaxJkWwX7G7izEo/edit?ts=5b10411b#heading=h.dprb64shku8u).
 148
 149 ## Server/Device Management and Naming
 150 ### Server Management Requirements
 151 Total of 20 SM SYS-7049GP-TRT servers are made available for FD.IO CSIT testbed.
 152 For management purposes, each server must have following two ports connected to the management network:
 153 ```
 154 - 1GE IPMI port
 155   - IPMI - Intelligent Platform Management Interface.
 156   - Required for access to embedded server management with WebUI, CLI, SNMPv3, IPMIv2.0, for firmware (BIOS) and OS updates.
 157 - 1GE/10GE management port
 158   - hostOS management port for general system management.
 159 ```
 160
 161 ### Server and Port Naming Convention
 162 Following naming convention is used within this page to specify physical connectivity and wiring across defined CSIT testbeds:
 163 ```
 164 - testbedname: testbedN.
 165 - hostname:
 166     - traffic-generator: tN-tgW.
 167     - system-under-testX: tN-sutX.
 168 - portnames:
 169     - tN-tgW-cY/pZ.
 170     - tN-sutX-cY/pZ.
 171 - where:
 172     - N - testbed number.
 173     - tgW - server acts as traffic-generator with W index.
 174     - sutX - server acts as system-under-test with X index.
 175     - Y - PCIe slot number denoting a NIC card number within the host.
 176         - Y=2,4,9 - slots connected to NUMA node 0.
 177         - Y=6,8,10 - slots connected to NUMA node 1.
 178     - Z - port number on the NIC card.
 179 ```
 180
 181 ### Server Management - Addressing
 182 Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management port, which are connected to two different VLANs.
 183 ```
 184 1. LOM (IPMI) VLAN:
 185     - Subnet: 10.30.50.0/24
 186     - Gateway: 10.30.50.1
 187     - Broadcast: 10.30.50.255
 188     - DNS1: 199.204.44.24
 189     - DNS2: 199.204.47.54
 190 2. Management Vlan:
 191     - Subnet: 10.30.51.0/24
 192     - Gateway: 10.30.51.1
 193     - Broadcast: 10.30.51.255
 194     - DNS1: 199.204.44.24
 195     - DNS2: 199.204.47.54
 196 ```
 197 To access these hosts, an VPN connection is required.
 198
 199 ### LOM (IPMI) VLAN IP Addresses
 200 ..
 201
 202 ### Management VLAN IP Addresses
 203 ..
 204
 205 ## Testbeds Specification - Target Build
 206 ### Server/Ports Naming, NIC Placement
 207 #### 1-Node Xeon
 208 Each server in 1-node Xeon topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 209 ```
 210 - Server1 [Type-6]:
 211     - testbedname: testbed11.
 212     - hostname: s1-t11-sut1.
 213     - IPMI IP: 10.30.50.47
 214     - Host IP: 10.30.51.50
 215     - portnames:
 216         - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 217         - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 218         - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 219         - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 220         - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
 221         - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
 222         - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
 223         - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
 224 - Server2 [Type-6]:
 225     - testbedname: testbed12.
 226     - hostname: s2-t12-sut1.
 227     - IPMI IP: 10.30.50.48
 228     - Host IP: 10.30.51.51
 229     - portnames:
 230         - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 231         - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 232         - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 233         - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 234         - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE.
 235         - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE.
 236         - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE.
 237         - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE.
 238 ```
 239
 240 #### 2-Node Xeon
 241 Each server in 2-node Xeon topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 242 ```
 243 - Server3 [Type-1]:
 244     - testbedname: testbed21.
 245     - hostname: s3-t21-sut1.
 246     - IPMI IP: 10.30.50.41
 247     - Host IP: 10.30.51.44
 248     - portnames:
 249         - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 250         - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 251         - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 252         - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 253         - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 254         - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 255         - s3-t21-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 256         - s3-t21-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 257 - Server4 [Type-2]:
 258     - testbedname: testbed21.
 259     - hostname: s4-t21-tg1.
 260     - IPMI IP: 10.30.50.42
 261     - Host IP: 10.30.51.45
 262     - portnames:
 263         - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 264         - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 265         - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 266         - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 267         - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 268         - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 269         - s4-t21-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 270         - s4-t21-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 271 - Server5 [Type-1]:
 272     - testbedname: testbed22.
 273     - hostname: s5-t22-sut1.
 274     - IPMI IP: 10.30.50.49
 275     - Host IP: 10.30.51.52
 276     - portnames:
 277         - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 278         - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 279         - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 280         - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 281         - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 282         - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 283         - s5-t22-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 284         - s5-t22-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 285 - Server6 [Type-2]:
 286     - testbedname: testbed22.
 287     - hostname: s6-t22-tg1.
 288     - IPMI IP: 10.30.50.50
 289     - Host IP: 10.30.51.53
 290     - portnames:
 291         - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 292         - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 293         - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 294         - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 295         - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 296         - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 297         - s6-t22-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 298         - s6-t22-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 299 - Server7 [Type-1]:
 300     - testbedname: testbed23.
 301     - hostname: s7-t23-sut1.
 302     - IPMI IP: 10.30.50.51
 303     - Host IP: 10.30.51.54
 304     - portnames:
 305         - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 306         - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 307         - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 308         - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 309         - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 310         - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 311         - s7-t23-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 312         - s7-t23-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 313 - Server8 [Type-2]:
 314     - testbedname: testbed23.
 315     - hostname: s8-t23-tg1.
 316     - IPMI IP: 10.30.50.52
 317     - Host IP: 10.30.51.55
 318     - portnames:
 319         - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 320         - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 321         - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 322         - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 323         - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 324         - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 325         - s8-t23-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 326         - s8-t23-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 327 - Server9 [Type-1]:
 328     - testbedname: testbed24.
 329     - hostname: s9-t24-sut1.
 330     - IPMI IP: 10.30.50.53
 331     - Host IP: 10.30.51.56
 332     - portnames:
 333         - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 334         - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 335         - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 336         - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 337         - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 338         - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 339         - s9-t24-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 340         - s9-t24-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 341 - Server10 [Type-2]:
 342     - testbedname: testbed24.
 343     - hostname: s10-t24-tg1.
 344     - IPMI IP: 10.30.50.54
 345     - Host IP: 10.30.51.57
 346     - portnames:
 347         - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 348         - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 349         - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 350         - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 351         - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 352         - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 353         - s10-t24-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 354         - s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 355 ```
 356
 357 #### 3-Node Xeon
 358 Each server in 3-node Xeon topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 359 ```
 360 - Server11 [Type-1]:
 361     - testbedname: testbed31.
 362     - hostname: s11-t31-sut1.
 363     - IPMI IP: 10.30.50.43
 364     - Host IP: 10.30.51.46
 365     - portnames:
 366         - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 367         - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 368         - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 369         - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 370         - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 371         - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 372         - s11-t31-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 373         - s11-t31-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 374 - Server12 [Type-1]:
 375     - testbedname: testbed31.
 376     - hostname: s12-t31-sut2.
 377     - IPMI IP: 10.30.50.44
 378     - Host IP: 10.30.51.47
 379     - portnames:
 380         - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
 381         - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
 382         - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
 383         - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
 384         - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 385         - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 386         - s12-t31-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 387         - s12-t31-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 388 - Server13 [Type-2]:
 389     - testbedname: testbed31.
 390     - hostname: s13-t31-tg1.
 391     - IPMI IP: 10.30.50.45
 392     - Host IP: 10.30.51.48
 393     - portnames:
 394         - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 395         - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 396         - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 397         - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 398         - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 399         - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 400         - s13-t31-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 401         - s13-t31-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 402 - Server14 [Type-1]:
 403     - testbedname: testbed32.
 404     - hostname: s14-t32-sut1.
 405     - IPMI IP: 10.30.50.55
 406     - Host IP: 10.30.51.58
 407     - portnames:
 408         - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 409         - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 410         - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 411         - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 412         - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 413         - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 414         - s14-t32-sut1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 415         - s14-t32-sut1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 416 - Server15 [Type-1]:
 417     - testbedname: testbed32.
 418     - hostname: s15-t32-sut2.
 419     - IPMI IP: 10.30.50.56
 420     - Host IP: 10.30.51.59
 421     - portnames:
 422         - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE.
 423         - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE.
 424         - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE.
 425         - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE.
 426         - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 427         - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 428         - s15-t32-sut2-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 429         - s15-t32-sut2-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 430 - Server16 [Type-2]:
 431     - testbedname: testbed32.
 432     - hostname: s16-t32-tg1.
 433     - IPMI IP: 10.30.50.57
 434     - Host IP: 10.30.51.60
 435     - portnames:
 436         - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 437         - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 438         - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 439         - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 440         - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 441         - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 442         - s16-t32-tg1-c9/p1 - FUTURE 100GE-port1 ConnectX5-2p100GE.
 443         - s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
 444 ```
 445
 446 #### 3-Node Arm
 447 Note: Server19 (TG) is shared between testbed33 & testbed34
 448 ```
 449 - Server17 [Type-3]:
 450     - testbedname: testbed33.
 451     - hostname: s17-t33-sut1.
 452     - IPMI IP: 10.30.50.36
 453     - Host IP: 10.30.51.36
 454     - portnames:
 455         - s17-t33-sut1-ca/p1 - 10GE-port1 82599-2p10GE.
 456         - s17-t33-sut1-ca/p2 - 10GE-port2 82599-2p10GE.
 457         - s17-t33-sut1-c2/p1 - 25GE-port1 cx4-2p25GE.
 458         - s17-t33-sut1-c2/p2 - 25GE-port2 cx4-2p25GE.
 459 - Server18 [Type-3]:
 460     - testbedname: testbed33.
 461     - hostname: s18-t33-sut2.
 462     - IPMI IP: 10.30.50.37
 463     - Host IP: 10.30.51.37
 464     - portnames:
 465         - s18-t33-sut2-ca/p1 - 10GE-port1 82599-2p10GE.
 466         - s18-t33-sut2-ca/p2 - 10GE-port2 82599-2p10GE.
 467         - s18-t33-sut2-c2/p1 - 25GE-port1 cx4-2p25GE.
 468         - s18-t33-sut2-c2/p2 - 25GE-port2 cx4-2p25GE.
 469 - Server19 [Type-2]:
 470     - testbedname: testbed33.
 471     - hostname: s19-t33t34-tg1.
 472     - IPMI IP: 10.30.50.46
 473     - Host IP: 10.30.51.49
 474     - portnames:
 475         - s19-t33t34-tg1-c2/p1 - 10GE-port1 x710-4p10GE.
 476         - s19-t33t34-tg1-c2/p2 - 10GE-port2 x710-4p10GE.
 477         - s19-t33t34-tg1-c2/p3 - 10GE-port3 x710-4p10GE.
 478         - s19-t33t34-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
 479         - s19-t33t34-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
 480         - s19-t33t34-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
 481 - Server20 [Type-4]:
 482     - testbedname: testbed34.
 483     - hostname: s20-t34-sut1.
 484     - IPMI IP: N/A
 485     - Host IP: 10.30.51.41
 486     - portnames:
 487         - s20-t34-sut1-ca/p1 - 10GE-port1 Marvell.
 488         - s20-t34-sut1-ca/p2 - 10GE-port2 Marvell.
 489 - Server21 [Type-4]:
 490     - testbedname: testbed34.
 491     - hostname: s21-t34-sut2.
 492     - IPMI IP: N/A
 493     - Host IP: 10.30.51.42
 494     - portnames:
 495         - s21-t34-sut2-ca/p1 - 10GE-port1 Marvell.
 496         - s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
 497 ```
 498
 499 #### TCP/IP and L47
 500 Each server (appliance) in 2-node TCP/IP topology has its NIC cards placed, and NIC cards and ports indexed per following specification:
 501 ```
 502 - Server25 [Type-8]:
 503     - testbedname: testbed25.
 504     - hostname: s25-t25-sut1.
 505     - IPMI IP: 10.30.50.58
 506     - Host IP: 10.30.51.61
 507     - portnames:
 508         - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE.
 509         - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE.
 510         - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE.
 511         - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE.
 512 - Server26 [Type-7]:
 513     - testbedname: testbed25.
 514     - hostname: s26-t25-tg1.
 515     - IPMI IP: 10.30.50.59
 516     - Host IP: 10.30.51.62
 517     - portnames:
 518         - s26-t25-tg1-p1 - 10GE-port1.
 519         - s26-t25-tg1-p2 - 10GE-port2.
 520         - s26-t25-tg1-p3 - 10GE-port3.
 521         - s26-t25-tg1-p4 - 10GE-port4.
 522 ```
 523
 524 #### 3-Node Atom
 525 Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
 526 ```
 527 - Server22 [Type-5]:
 528     - testbedname: testbed35.
 529     - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1).
 530     - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0
 531     - Host IP: 10.30.51.9
 532     - portnames:
 533         - s22-t35-sut1-p1 - 10GE-port1 ix0 82599.
 534         - s22-t35-sut1-p2 - 10GE-port2 ix1 82599.
 535     - 1GB ports (tbd)
 536 - Server23 [Type-5]:
 537     - testbedname: testbed35.
 538     - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2).
 539     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1
 540     - Host IP: 10.30.51.10
 541     - portnames:
 542         - s23-t35-sut1-p1 - 10GE-port1 ix0 82599.
 543         - s23-t35-sut1-p2 - 10GE-port2 ix1 82599.
 544     - 1GB ports (tbd)
 545 - Server24 [Type-5]:
 546     - testbedname: testbed35.
 547     - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3).
 548     - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2
 549     - Host IP: 10.30.51.11
 550     - portnames:
 551         - s24-t35-sut1-p1 - 10GE-port1 ix0 82599.
 552         - s24-t35-sut1-p2 - 10GE-port2 ix1 82599.
 553     - 1GB ports (tbd)
 554 ```
 555
 556 ### Physical Connectivity within Testbeds
 557 #### 1-Node Xeon
 558 Two 1-Node testbeds are constructed by connecting 2 Xeon servers using below specification:
 559 ```
 560 - testbed11:
 561     - ring1 10GE-ports x710-4p10GE:
 562         - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1.
 563     - ring2 10GE-ports x710-4p10GE:
 564         - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2.
 565     - ring3 10GE-ports x710-4p10GE:
 566         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
 567     - ring4 10GE-ports x710-4p10GE:
 568         - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3.
 569 - testbed12:
 570     - ring1 10GE-ports x710-4p10GE:
 571         - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1.
 572     - ring2 10GE-ports x710-4p10GE:
 573         - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2.
 574     - ring3 10GE-ports x710-4p10GE:
 575         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
 576     - ring4 10GE-ports x710-4p10GE:
 577         - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3.
 578 ```
 579
 580 #### 2-Node Xeon
 581 Four 2-Node testbeds are constructed by connecting 8 Xeon servers using below specification:
 582 ```
 583 - testbed21:
 584     - ring1 10GE-ports x710-4p10GE on SUT:
 585         - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1.
 586         - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2.
 587     - ring2 10GE-ports x710-4p10GE on SUT:
 588         - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3.
 589         - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4.
 590     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 591         - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1.
 592         - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2.
 593     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 594         - s4-t21-tg1-c9/p1 to s3-t21-sut1-c9/p1.
 595         - s3-t21-sut1-c9/p2 to s4-t21-tg1-c9/p2.
 596     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 597         - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2.
 598         - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4.
 599 - testbed22:
 600     - ring1 10GE-ports x710-4p10GE on SUT:
 601         - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1.
 602         - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2.
 603     - ring2 10GE-ports x710-4p10GE on SUT:
 604         - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3.
 605         - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4.
 606     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 607         - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1.
 608         - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2.
 609     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 610         - t22-tg1-c9/p1 to s5-t22-sut1-c9/p1.
 611         - s5-t22-sut1-c9/p2 to s6-t22-tg1-c9/p2.
 612     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 613         - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2.
 614         - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4.
 615 - testbed23:
 616     - ring1 10GE-ports x710-4p10GE on SUT:
 617         - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1.
 618         - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2.
 619     - ring2 10GE-ports x710-4p10GE on SUT:
 620         - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3.
 621         - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4.
 622     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 623         - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1.
 624         - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2.
 625     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 626         - s8-t23-tg1-c9/p1 to s7-t23-sut1-c9/p1.
 627         - s7-t23-sut1-c9/p2 to s8-t23-tg1-c9/p2.
 628     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 629         - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2.
 630         - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4.
 631 - testbed24:
 632     - ring1 10GE-ports x710-4p10GE on SUT:
 633         - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1.
 634         - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2.
 635     - ring2 10GE-ports x710-4p10GE on SUT:
 636         - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3.
 637         - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4.
 638     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 639         - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1.
 640         - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2.
 641     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 642         - s10-t24-tg1-c9/p1 to s9-t24-sut1-c9/p1.
 643         - s9-t24-sut1-c9/p2 to s10-t24-tg1-c9/p2.
 644     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 645         - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2.
 646         - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
 647 ```
 648
 649 #### 3-Node Xeon
 650 Two 3-Node testbeds are constructed by connecting 6 Xeon servers using below specification:
 651 ```
 652 - testbed31:
 653     - ring1 10GE-ports x710-4p10GE on SUTs:
 654         - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1.
 655         - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2.
 656         - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2.
 657     - ring2 10GE-ports x710-4p10GE on SUT:
 658         - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3.
 659         - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4.
 660         - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4.
 661     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 662         - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1.
 663         - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2.
 664         - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2.
 665     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 666         - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1.
 667         - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2.
 668         - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2.
 669     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 670         - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2.
 671         - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4.
 672 - testbed32:
 673     - ring1 10GE-ports x710-4p10GE on SUTs:
 674         - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1.
 675         - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2.
 676         - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2.
 677     - ring2 10GE-ports x710-4p10GE on SUT:
 678         - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3.
 679         - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4.
 680         - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4.
 681     - ring3 25GE-ports xxv710-DA2-2p25GE on SUT
 682         - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1.
 683         - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2.
 684         - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2.
 685     - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT:
 686         - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1.
 687         - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2.
 688         - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2.
 689     - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests:
 690         - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2.
 691         - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4.
 692 ```
 693
 694 #### 3-Node Arm
 695 One 3-Node testbed is constructed by connecting 3 Arm servers using below specification:
 696 ```
 697 - testbed33:
 698     - ring1 10GE-ports 82599-2p10GE on SUTs:
 699         - t33t34-tg1-c2/p1 - t33-sut1-ca/p1.
 700         - t33-sut1-ca/p2 - t33-sut2-ca/p1.
 701         - t33-sut2-ca/p2 - t33t34-tg1-c2/p2.
 702     - ring2 25GE-ports cx4-2p25GE on SUTs:
 703         - t33t34-tg1-c4/p1 - t33-sut1-c2/p1.
 704         - t33-sut1-c2/p2 - t33-sut2-c2/p1.
 705         - t33-sut2-c2/p2 - t33t34-tg1-c4/p2.
 706 - testbed34:
 707     - ring1 10GE-ports Marvell on SUTs:
 708         - t33t34-tg1-c2/p3 - t34-sut1-ca/p1.
 709         - t34-sut1-ca/p2 - t34-sut2-ca/p1.
 710         - t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
 711 ```
 712
 713 #### TCP/IP and L47
 714 One 2-Node TCP/IP testbed is constructed by connecting Ixia PSOne and 1 Xeon server using below specification:
 715 ```
 716 - testbed25:
 717     - link1 10GE-port x710-4p10GE on SUT:
 718         - t25-tg1-p1 to t25-sut1-c2/p1.
 719     - link2 10GE-port x710-4p10GE on SUT:
 720         - t25-tg1-p2 to t25-sut1-c2/p2.
 721     - link3 10GE-port x710-4p10GE on SUT:
 722         - t25-tg1-p3 to t25-sut1-c2/p3.
 723     - link4 10GE-port x710-4p10GE on SUT:
 724         - t25-tg1-p4 to t25-sut1-c2/p4.
 725 ```
 726
 727 #### 3-Node Atom
 728 ..
 729
 730 ## Server Specification
 731 ### Hardware Configuration
 732 The new FD.io CSIT-CPL lab (is expected to contain|contains) following hardware server configurations:
 733 ```
 734 1. Type-1: Purpose - (Intel Xeon Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 735     - Quantity: TBD based on testbed allocation.
 736     - Physical connectivity:
 737         - IPMI and host management ports.
 738         - NIC ports connected into 2-node and 3-node topologies.
 739     - Main HW configuration:
 740         - Chassis: SuperMicro SYS-7049GP-TRT.
 741         - Motherboard: SuperMicro X11DPG-QT.
 742         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 743         - RAM Memory: 16* 16GB DDR4-2666MHz.
 744         - Disks: 2* 1.6TB 6G SATA SSD.
 745     - NICs configuration:
 746         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 747             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 748             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
 749             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
 750         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 751             - PCIe Slot6 86:00.xx: empty.
 752             - PCIe Slot8 af:00.xx: empty.
 753             - PCIe Slot10 d8:00.xx: empty.
 754 2. Type-2: Purpose - (Intel Xeon Processor) TG for T-Rex.
 755     - Quantity: TBD based on testbed allocation.
 756     - Physical connectivity:
 757         - IPMI and host management ports.
 758         - NIC ports connected into 2-node and 3-node topologies.
 759     - Main HW configuration:
 760         - Chassis: SuperMicro SYS-7049GP-TRT.
 761         - Motherboard: SuperMicro X11DPG-QT.
 762         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 763         - RAM Memory: 16* 16GB DDR4-2666MHz.
 764         - Disks: 2* 1.6TB 6G SATA SSD.
 765     - NICs configuration:
 766         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 767             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 768             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
 769             - PCIe Slot9 5e:00.xx: FUTURE ConnectX5-2p100GE Mellanox.
 770         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 771             - PCIe Slot6 86:00.xx: empty.
 772             - PCIe Slot8 af:00.xx: empty.
 773             - PCIe Slot10 d8:00.xx: x710-4p10GE Intel.
 774 3. Type-3: Purpose - (Arm hip07-d05 Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 775     - Quantity: 2
 776     - Physical connectivity:
 777         - IPMI(?) and host management ports.
 778         - NIC ports connected into 3-node topology.
 779     - Main HW configuration:
 780         - Chassis: Huawei TaiShan 2280.
 781         - Processors: 1* hip07-d05 ~ 64* Arm Cortex-A72
 782         - RAM Memory: 8* 16GB DDR4-2400MT/s
 783         - Disks: 1* 4TB SATA HDD
 784     - NICs configuration:
 785         - PCIe Slot2 e9:00.xx: connectx4-2p25GE Mellanox.
 786         - PCIe Slota 11:00.xx: 82599-2p10GE Intel.
 787 4. Type-4: Purpose - (Arm Armada 8040 Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 788     - Quantity: 3
 789     - Physical connectivity:
 790         - Host management ports.
 791         - NIC ports connected into 2-node and 3-node topologies.
 792     - Main HW configuration:
 793         - Chassis: MACCHIATObin.
 794         - Processors: 1* Armada 8040 ~ 4* Arm Cortex-A72
 795         - RAM Memory: 1* 16GB DDR4
 796         - Disks: 1* 128GB(?) SATA SDD
 797     - NICs configuration:
 798         - pp2-2p10GE Marvell (on-chip Ethernet ports ; marvell plugin in VPP)
 799 5. Type-5: Purpose - (Intel Atom Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 800     - Quantity: TBD based on testbed allocation.
 801     - Physical connectivity:
 802         - Management: serial Port (usb) for console
 803         - NIC ports connected into 2-node.
 804     - Main HW configuration:
 805         - Chassis: Netgate XG-2758-1u
 806         - Processors: 1* Rangeley (Atom) C2758 2.4 GHz
 807         - RAM Memory: 16GB ECC
 808         - Disks: 150 GB
 809     - NICs configuration:
 810         - 2x 10Gb Intel 82599ES
 811         - 4x 1GB Intel I354
 812 6. Type-6: Purpose - (Intel Xeon Processor) SUT for VPP_Device functional tests.
 813     - Quantity: 1.
 814     - Physical connectivity:
 815         - IPMI and host management ports.
 816         - NIC ports connected into 2-node and 3-node topologies.
 817     - Main HW configuration:
 818         - Chassis: SuperMicro SYS-7049GP-TRT.
 819         - Motherboard: SuperMicro X11DPG-QT.
 820         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 821         - RAM Memory: 16* 16GB DDR4-2666MHz.
 822         - Disks: 2* 1.6TB 6G SATA SSD.
 823     - NICs configuration:
 824         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 825             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 826             - PCIe Slot4 3b:00.xx: x710-4p10GE Intel.
 827             - PCIe Slot9 5e:00.xx: empty.
 828         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 829             - PCIe Slot6 86:00.xx: empty.
 830             - PCIe Slot8 af:00.xx: empty.
 831             - PCIe Slot10 d8:00.xx: empty.
 832 7. Type-7: Purpose - Ixia PerfectStorm One Appliance TG for TCP/IP performance tests.
 833     - Quantity: 1.
 834     - Physical connectivity:
 835         - Host management interface: 10/100/1000-BaseT.
 836         - 8-port 10GE SFP+ integrated NIC.
 837     - Main HW configuration:
 838         - Chassis: PS10GE4NG.
 839         - Motherboard: SuperMicro X11DPG-QT.
 840         - Processors: Quad-Core, Intel Processor.
 841         - HW accelerators: FPGA offload.
 842         - RAM Memory: 64GB.
 843         - Disks: 1 * 1 TB, Enterprise Class, High MTBF.
 844         - Physical Interfaces: 4 * 10GE SFP+.
 845         - Operating System: Native IxOS.
 846     - Interface configuration:
 847         - Port-1: 10GE SFP+.
 848         - Port-2: 10GE SFP+.
 849         - Port-3: 10GE SFP+.
 850         - Port-4: 10GE SFP+.
 851 8. Type-8: Purpose - (Intel Xeon Processor) SUT for TCP/IP host stack tests.
 852     - Quantity: 1.
 853     - Physical connectivity:
 854         - IPMI and host management ports.
 855         - NIC ports.
 856     - Main HW configuration:
 857         - Chassis: SuperMicro SYS-7049GP-TRT.
 858         - Motherboard: SuperMicro X11DPG-QT.
 859         - Processors: 2* Intel Platinum 8180 2.3 GHz.
 860         - RAM Memory: 16* 16GB DDR4-2666MHz.
 861         - Disks: 2* 1.6TB 6G SATA SSD.
 862     - NICs configuration:
 863         - Numa0: (x16, x16, x16 PCIe3.0 lanes)
 864             - PCIe Slot2 18:00.xx: x710-4p10GE Intel.
 865             - PCIe Slot4 3b:00.xx: empty.
 866             - PCIe Slot9 5e:00.xx: empty.
 867         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
 868             - PCIe Slot6 86:00.xx: empty.
 869             - PCIe Slot8 af:00.xx: empty.
 870             - PCIe Slot10 d8:00.xx: empty.
 871 9. Type-9: Purpose - (Cavium ThunderX2 Processor) SUT for VPP_Device functional tests.
 872     - Quantity: 1
 873     - Physical connectivity:
 874         - IPMI and host management ports.
 875         - NIC ports connected into 1-node topologies.
 876     - Main HW configuration:
 877         - Chassis: Gigabyte R181-T90 1U
 878         - Motheboard: MT91-FS1
 879         - Processors: 1* ThunderX2 ARMv8 CN9975 2.0 GHz
 880         - RAM Memory: 4* 32GB RDIMM
 881         - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25
 882     - NICs configuration:
 883         - PCIe Slotx <TBD>: XL710-QDA2.
 884         - PCIe Sloty <TBD>: XL710-QDA2.
 885   - PCIe Slotz <TBD>: XL710-QDA2.
 886 10. Type-10: Purpose - (Intel Atom C3000 Processor) SUT for SW Data Plane Workload i.e. VPP, testpmd.
 887     - Quantity: 4
 888     - Physical connectivity:
 889         - IPMI and host management ports.
 890         - NIC ports.
 891     - Main HW configuration:
 892         - Chassis: SuperMicro SYS-E300-9A
 893         - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
 894         - RAM Memory: 32GB ECC
 895         - Disks: 480 GB
 896     - NICs configuration:
 897         - 2x 10Gb Intel x553 fiber ports
 898         - 2x 10Gb Intel x553 copper ports
 899         - 4x 1GB Intel I350 ports
 900 ```
 901
 902 ### Xeon Skx Server BIOS Configuration
 903 #### Boot Feature
 904 ```
 905   |  Quiet Boot                                [Enabled]               |Boot option                  |
 906   |                                                                    |                             |
 907   |  Option ROM Messages                       [Force BIOS]            |                             |
 908   |  Bootup NumLock State                      [On]                    |                             |
 909   |  Wait For "F1" If Error                    [Enabled]               |                             |
 910   |  INT19 Trap Response                       [Immediate]             |                             |
 911   |  Re-try Boot                               [Disabled]              |                             |
 912   |  Install Windows 7 USB support             [Disabled]              |                             |
 913   |  Port 61h Bit-4 Emulation                  [Disabled]              |                             |
 914   |                                                                    |                             |
 915   |  Power Configuration                                               |                             |
 916   |  Watch Dog Function                        [Disabled]              |                             |
 917   |  Restore on AC Power Loss                  [Last State]            |                             |
 918   |  Power Button Function                     [Instant Off]           |                             |
 919   |  Throttle on Power Fail                    [Disabled]              |                             |
 920 ```
 921
 922 #### CPU Configuration
 923 ```
 924   |  Processor Configuration                                           |Enables Hyper Threading      |
 925   |  --------------------------------------------------                |(Software Method to          |
 926   |  Processor BSP Revision                    50654 - SKX H0          |Enable/Disable Logical       |
 927   |  Processor Socket                          CPU1      |  CPU2       |Processor threads.           |
 928   |  Processor ID                              00050654* |  000506...  |                             |
 929   |  Processor Frequency                       2.500GHz  |  2.500GHz   |                             |
 930   |  Processor Max Ratio                            19H  |  19H        |                             |
 931   |  Processor Min Ratio                            0AH  |  0AH        |                             |
 932   |  Microcode Revision                        02000030                |                             |
 933   |  L1 Cache RAM                                  64KB  |      64KB   |                             |
 934   |  L2 Cache RAM                                1024KB  |    1024KB   |                             |
 935   |  L3 Cache RAM                               39424KB  |   39424KB   |                             |
 936   |  Processor 0 Version                                               |                             |
 937   |  Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz                      |                             |
 938   |  Processor 1 Version                                               |                             |
 939   |  Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz                      |                             |
 940   |                                                                    |                             |
 941   |  Hyper-Threading [ALL]                     [Enable]                |                             |
 942   |  Core Disable Bitmap(Hex)                  0                       |                             |
 943   |  Execute Disable Bit                       [Enable]                |                             |
 944   |  Intel Virtualization Technology           [Enable]                |                             |
 945   |  PPIN Control                              [Unlock/Enable]         |                             |
 946   |  Hardware Prefetcher                       [Enable]                |                             |
 947   |  Adjacent Cache Prefetch                   [Enable]                |                             |
 948   |  DCU Streamer Prefetcher                   [Enable]                |                             |
 949   |  DCU IP Prefetcher                         [Enable]                |                             |
 950   |  LLC Prefetch                              [Disable]               |                             |
 951   |  Extended APIC                             [Disable]               |                             |
 952   |  AES-NI                                    [Enable]                |                             |
 953   |> Advanced Power Management Configuration                           |                             |
 954 ```
 955
 956 ##### Advanced Power Management Configuration
 957 ```
 958   |  Advanced Power Management Configuration                           |Switch CPU Power Management  |
 959   |  --------------------------------------------------                |profile                      |
 960   |  Power Technology                          [Custom]                |                             |
 961   |  Power Performance Tuning                  [BIOS Controls EPB]     |                             |
 962   |  ENERGY_PERF_BIAS_CFG mode                 [Maximum Performance]   |                             |
 963   |> CPU P State Control                                               |                             |
 964   |> Hardware PM State Control                                         |                             |
 965   |> CPU C State Control                                               |                             |
 966   |> Package C State Control                                           |                             |
 967   |> CPU T State Control                                               |                             |
 968 ```
 969
 970 ###### CPU P State Control
 971 ```
 972   |  CPU P State Control                                               |Enable/Disable EIST          |
 973   |                                                                    |(P-States)                   |
 974   |  SpeedStep (Pstates)                       [Disable]               |                             |
 975   |  EIST PSD Function                         [HW_ALL]                |                             |
 976 ```
 977
 978 ###### Hardware PM State Control
 979 ```
 980   |  Hardware PM State Control                                         |Disable: Hardware chooses a  |
 981   |                                                                    |P-state based on OS Request  |
 982   |  Hardware P-States                         [Disable]               |(Legacy P-States)            |
 983   |                                                                    |Native Mode:Hardware         |
 984   |                                                                    |chooses a P-state based on   |
 985   |                                                                    |OS guidance                  |
 986   |                                                                    |Out of Band Mode:Hardware    |
 987   |                                                                    |autonomously chooses a       |
 988   |                                                                    |P-state (no OS guidance)     |
 989 ```
 990
 991 ###### CPU C State Control
 992 ```
 993   |  CPU C State Control                                               |Autonomous Core C-State      |
 994   |                                                                    |Control                      |
 995   |  Autonomous Core C-State                   [Disable]               |                             |
 996   |  CPU C6 report                             [Disable]               |                             |
 997   |  Enhanced Halt State (C1E)                 [Disable]               |                             |
 998 ```
 999
1000 ###### Package C State Control
1001 ```
1002   |  Package C State Control                                           |Package C State limit        |
1003   |                                                                    |                             |
1004   |  Package C State                           [C0/C1 state]           |                             |
1005 ```
1006
1007 ###### CPU T State Control
1008 ```
1009   |  CPU T State Control                                               |Enable/Disable Software      |
1010   |                                                                    |Controlled T-States          |
1011   |  Software Controlled T-States              [Disable]               |                             |
1012 ```
1013
1014 ##### Chipset Configuration
1015 ```
1016   |  WARNING: Setting wrong values in below sections may cause         |North Bridge Parameters      |
1017   |           system to malfunction.                                   |                             |
1018   |> North Bridge                                                      |                             |
1019   |> South Bridge                                                      |                             |
1020 ```
1021
1022 ###### North Bridge
1023 ```
1024   |> UPI Configuration                                                 |Displays and provides        |
1025   |> Memory Configuration                                              |option to change the UPI     |
1026   |> IIO Configuration                                                 |Settings                     |
1027 ```
1028
1029 ###### UPI Configuration
1030 ```
1031   |  UPI Configuration                                                 |Choose Topology Precedence   |
1032   |  --------------------------------------------------                |to degrade features if       |
1033   |  Number of CPU                             2                       |system options are in        |
1034   |  Number of Active UPI Link                 3                       |conflict or choose Feature   |
1035   |  Current UPI Link Speed                    Fast                    |Precedence to degrade        |
1036   |  Current UPI Link Frequency                10.4 GT/s               |topology if system options   |
1037   |  UPI Global MMIO Low Base / Limit          90000000 / FBFFFFFF     |are in conflict.             |
1038   |  UPI Global MMIO High Base / Limit         0000000000000000 / ...  |                             |
1039   |  UPI Pci-e Configuration Base / Size       80000000 / 10000000     |                             |
1040   |  Degrade Precedence                        [Topology Precedence]   |                             |
1041   |  Link L0p Enable                           [Disable]               |                             |
1042   |  Link L1 Enable                            [Disable]               |                             |
1043   |  IO Directory Cache (IODC)                 [Auto]                  |                             |
1044   |  SNC                                       [Disable]               |                             |
1045   |  XPT Prefetch                              [Disable]               |                             |
1046   |  KTI Prefetch                              [Enable]                |                             |
1047   |  Local/Remote Threshold                    [Auto]                  |                             |
1048   |  Stale AtoS                                [Disable]               |                             |
1049   |  LLC dead line alloc                       [Enable]                |                             |
1050   |  Isoc Mode                                 [Auto]                  |                             |
1051 ```
1052
1053 ###### Memory Configuration
1054 ```
1055   |                                                                    |POR - Enforces Plan Of       |
1056   |  --------------------------------------------------                |Record restrictions for      |
1057   |  Integrated Memory Controller (iMC)                                |DDR4 frequency and voltage   |
1058   |  --------------------------------------------------                |programming. Disable -       |
1059   |                                                                    |Disables this feature.       |
1060   |  Enforce POR                               [Disable]               |                             |
1061   |  Memory Frequency                          [2666]                  |                             |
1062   |  Data Scrambling for NVMDIMM               [Auto]                  |                             |
1063   |  Data Scrambling for DDR4                  [Auto]                  |                             |
1064   |  tCCD_L Relaxation                         [Auto]                  |                             |
1065   |  Memory tRWSR Relaxation                   [Enable]                |                             |
1066   |  2X REFRESH                                [Auto]                  |                             |
1067   |  Page Policy                               [Auto]                  |                             |
1068   |  IMC Interleaving                          [2-way Interleave]      |                             |
1069   |> Memory Topology                                                   |                             |
1070   |> Memory RAS Configuration                                          |                             |
1071 ```
1072
1073 ###### IIO Configuration
1074 ```
1075   |  IIO Configuration                                                 |Expose IIO DFX devices and   |
1076   |  --------------------------------------------------                |other CPU devices like PMON  |
1077   |                                                                    |                             |
1078   |  EV DFX Features                           [Disable]               |                             |
1079   |> CPU1 Configuration                                                |                             |
1080   |> CPU2 Configuration                                                |                             |
1081   |> IOAT Configuration                                                |                             |
1082   |> Intel. VT for Directed I/O (VT-d)                                 |                             |
1083   |> Intel. VMD technology                                             |                             |
1084   |                                                                    |                             |
1085   |   IIO-PCIE Express Global Options                                  |                             |
1086   |  ========================================                          |                             |
1087   |  PCI-E Completion Timeout Disable          [No]                    |                             |
1088 ```
1089
1090 ###### CPU1 Configuration
1091 ```
1092   |  IOU0 (IIO PCIe Br1)                       [Auto]                  |Selects PCIe port            |
1093   |  IOU1 (IIO PCIe Br2)                       [Auto]                  |Bifurcation for selected     |
1094   |  IOU2 (IIO PCIe Br3)                       [Auto]                  |slot(s)                      |
1095   |> CPU1 SLOT2 PCI-E 3.0 X16                                          |                             |
1096   |> CPU1 SLOT4 PCI-E 3.0 X16                                          |                             |
1097   |> CPU1 SLOT9 PCI-E 3.0 X16                                          |                             |
1098 ```
1099
1100 ###### CPU2 Configuration
1101 ```
1102   |  IOU0 (IIO PCIe Br1)                       [Auto]                  |Selects PCIe port            |
1103   |  IOU1 (IIO PCIe Br2)                       [Auto]                  |Bifurcation for selected     |
1104   |  IOU2 (IIO PCIe Br3)                       [Auto]                  |slot(s)                      |
1105   |> CPU2 SLOT6 PCI-E 3.0 X16                                          |                             |
1106   |> CPU2 SLOT8 PCI-E 3.0 X16                                          |                             |
1107   |> CPU2 SLOT10 PCI-E 3.0 X16                                         |                             |
1108 ```
1109
1110 ##### South Bridge
1111 ```
1112   |                                                                    |Enables Legacy USB support.  |
1113   |  USB Module Version                        17                      |AUTO option disables legacy  |
1114   |                                                                    |support if no USB devices    |
1115   |  USB Devices:                                                      |are connected. DISABLE       |
1116   |        1 Keyboard, 1 Mouse, 1 Hub                                  |option will keep USB         |
1117   |                                                                    |devices available only for   |
1118   |  Legacy USB Support                        [Enabled]               |EFI applications.            |
1119   |  XHCI Hand-off                             [Disabled]              |                             |
1120   |  Port 60/64 Emulation                      [Enabled]               |                             |
1121   |  PCIe PLL SSC                              [Disable]               |                             |
1122   |  Real USB Wake Up                          [Enabled]               |                             |
1123   |  Front USB Wake Up                         [Enabled]               |                             |
1124   |                                                                    |                             |
1125   |  Azalia                                    [Auto]                  |                             |
1126   |    Azalia PME Enable                       [Disabled]              |                             |
1127 ```
1128
1129 #### PCIe/PCI/PnP Configuration
1130 ```
1131   |  PCI Bus Driver Version                    A5.01.12                |Enables or Disables 64bit    |
1132   |                                                                    |capable Devices to be        |
1133   |  PCI Devices Common Settings:                                      |Decoded in Above 4G Address  |
1134   |  Above 4G Decoding                         [Enabled]               |Space (Only if System        |
1135   |  SR-IOV Support                            [Enabled]               |Supports 64 bit PCI          |
1136   |  MMIO High Base                            [56T]                   |Decoding).                   |
1137   |  MMIO High Granularity Size                [256G]                  |                             |
1138   |  Maximum Read Request                      [Auto]                  |                             |
1139   |  MMCFG Base                                [2G]                    |                             |
1140   |  NVMe Firmware Source                      [Vendor Defined Fi...]  |                             |
1141   |  VGA Priority                              [Onboard]               |                             |
1142   |  CPU1 SLOT2 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1143   |  CPU1 SLOT4 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1144   |  CPU2 SLOT6 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1145   |  CPU2 SLOT8 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1146   |  CPU1 SLOT9 PCI-E 3.0 X16 OPROM            [Legacy]                |                             |
1147   |  CPU2 SLOT10 PCI-E 3.0 X16 OPROM           [Legacy]                |                             |
1148   |  CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM     [Legacy]                |                             |
1149   |  M.2 CONNECTOR OPROM                       [Legacy]                |                             |
1150   |  Onboard LAN1 Option ROM                   [Legacy]                |                             |
1151   |  Onboard LAN2 Option ROM                   [Disabled]              |                             |
1152   |  Onboard Video Option ROM                  [Legacy]                |                             |
1153   |> Network Stack Configuration                                       |                             |
1154 ```
1155
1156 #### ACPI Settings
1157 ```
1158   |  ACPI Settings                                                     |Enable or Disable Non        |
1159   |                                                                    |uniform Memory Access        |
1160   |  NUMA                                      [Enabled]               |(NUMA).                      |
1161   |  WHEA Support                              [Enabled]               |                             |
1162   |  High Precision Event Timer                [Enabled]               |                             |
1163   |  ACPI Sleep State                          [S3 (Suspend to RAM)]   |                             |
1164 ```
1165
1166 #### DMIDECODE
1167 ```
1168   # dmidecode 3.1
1169   Getting SMBIOS data from sysfs.
1170   SMBIOS 3.1.1 present.
1171   Table at 0x000E89C0.
1172
1173   Handle 0x0000, DMI type 0, 26 bytes
1174   BIOS Information
1175         Vendor: American Megatrends Inc.
1176         Version: 2.0
1177         Release Date: 11/29/2017
1178         Address: 0xF0000
1179         Runtime Size: 64 kB
1180         ROM Size: 64 MB
1181         Characteristics:
1182                 PCI is supported
1183                 BIOS is upgradeable
1184                 BIOS shadowing is allowed
1185                 Boot from CD is supported
1186                 Selectable boot is supported
1187                 BIOS ROM is socketed
1188                 EDD is supported
1189                 5.25"/1.2 MB floppy services are supported (int 13h)
1190                 3.5"/720 kB floppy services are supported (int 13h)
1191                 3.5"/2.88 MB floppy services are supported (int 13h)
1192                 Print screen service is supported (int 5h)
1193                 Serial services are supported (int 14h)
1194                 Printer services are supported (int 17h)
1195                 ACPI is supported
1196                 USB legacy is supported
1197                 BIOS boot specification is supported
1198                 Targeted content distribution is supported
1199                 UEFI is supported
1200         BIOS Revision: 5.12
1201
1202   Handle 0x0001, DMI type 1, 27 bytes
1203   System Information
1204         Manufacturer: Supermicro
1205         Product Name: SYS-7049GP-TRT
1206         Version: 0123456789
1207         Serial Number: S291427X8332242
1208         UUID: 00000000-0000-0000-0000-AC1F6B8A8DB6
1209         Wake-up Type: Power Switch
1210         SKU Number: To be filled by O.E.M.
1211         Family: To be filled by O.E.M.
1212
1213   Handle 0x0002, DMI type 2, 15 bytes
1214   Base Board Information
1215         Manufacturer: Supermicro
1216         Product Name: X11DPG-QT
1217         Version: 1.02
1218         Serial Number: VM183S014930
1219         Asset Tag: To be filled by O.E.M.
1220         Features:
1221                 Board is a hosting board
1222                 Board is replaceable
1223         Location In Chassis: To be filled by O.E.M.
1224         Chassis Handle: 0x0003
1225         Type: Motherboard
1226         Contained Object Handles: 0
1227
1228   Handle 0x0003, DMI type 3, 22 bytes
1229   Chassis Information
1230         Manufacturer: Supermicro
1231         Type: Other
1232         Lock: Not Present
1233         Version: 0123456789
1234         Serial Number: C7470KH06A20167
1235         Asset Tag: To be filled by O.E.M.
1236         Boot-up State: Safe
1237         Power Supply State: Safe
1238         Thermal State: Safe
1239         Security Status: None
1240         OEM Information: 0x00000000
1241
1242   Handle 0x0050, DMI type 4, 48 bytes
1243   Processor Information
1244         Socket Designation: CPU1
1245         Type: Central Processor
1246         Family: Xeon
1247         Manufacturer: Intel(R) Corporation
1248         ID: 54 06 05 00 FF FB EB BF
1249         Signature: Type 0, Family 6, Model 85, Stepping 4
1250         Flags:
1251                 FPU (Floating-point unit on-chip)
1252                 VME (Virtual mode extension)
1253                 DE (Debugging extension)
1254                 PSE (Page size extension)
1255                 TSC (Time stamp counter)
1256                 MSR (Model specific registers)
1257                 PAE (Physical address extension)
1258                 MCE (Machine check exception)
1259                 CX8 (CMPXCHG8 instruction supported)
1260                 APIC (On-chip APIC hardware supported)
1261                 SEP (Fast system call)
1262                 MTRR (Memory type range registers)
1263                 PGE (Page global enable)
1264                 MCA (Machine check architecture)
1265                 CMOV (Conditional move instruction supported)
1266                 PAT (Page attribute table)
1267                 PSE-36 (36-bit page size extension)
1268                 CLFSH (CLFLUSH instruction supported)
1269                 DS (Debug store)
1270                 ACPI (ACPI supported)
1271                 MMX (MMX technology supported)
1272                 FXSR (FXSAVE and FXSTOR instructions supported)
1273                 SSE (Streaming SIMD extensions)
1274                 SSE2 (Streaming SIMD extensions 2)
1275                 SS (Self-snoop)
1276                 HTT (Multi-threading)
1277                 TM (Thermal monitor supported)
1278                 PBE (Pending break enabled)
1279         Version: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz
1280         Voltage: 1.6 V
1281         External Clock: 100 MHz
1282         Max Speed: 4000 MHz
1283         Current Speed: 2500 MHz
1284         Status: Populated, Enabled
1285         Upgrade: Other
1286         L1 Cache Handle: 0x004D
1287         L2 Cache Handle: 0x004E
1288         L3 Cache Handle: 0x004F
1289         Serial Number: Not Specified
1290         Asset Tag: UNKNOWN
1291         Part Number: Not Specified
1292         Core Count: 28
1293         Core Enabled: 28
1294         Thread Count: 56
1295         Characteristics:
1296                 64-bit capable
1297                 Multi-Core
1298                 Hardware Thread
1299                 Execute Protection
1300                 Enhanced Virtualization
1301                 Power/Performance Control
1302
1303
1304   Handle 0x0054, DMI type 4, 48 bytes
1305   Processor Information
1306         Socket Designation: CPU2
1307         Type: Central Processor
1308         Family: Xeon
1309         Manufacturer: Intel(R) Corporation
1310         ID: 54 06 05 00 FF FB EB BF
1311         Signature: Type 0, Family 6, Model 85, Stepping 4
1312         Flags:
1313                 FPU (Floating-point unit on-chip)
1314                 VME (Virtual mode extension)
1315                 DE (Debugging extension)
1316                 PSE (Page size extension)
1317                 TSC (Time stamp counter)
1318                 MSR (Model specific registers)
1319                 PAE (Physical address extension)
1320                 MCE (Machine check exception)
1321                 CX8 (CMPXCHG8 instruction supported)
1322                 APIC (On-chip APIC hardware supported)
1323                 SEP (Fast system call)
1324                 MTRR (Memory type range registers)
1325                 PGE (Page global enable)
1326                 MCA (Machine check architecture)
1327                 CMOV (Conditional move instruction supported)
1328                 PAT (Page attribute table)
1329                 PSE-36 (36-bit page size extension)
1330                 CLFSH (CLFLUSH instruction supported)
1331                 DS (Debug store)
1332                 ACPI (ACPI supported)
1333                 MMX (MMX technology supported)
1334                 FXSR (FXSAVE and FXSTOR instructions supported)
1335                 SSE (Streaming SIMD extensions)
1336                 SSE2 (Streaming SIMD extensions 2)
1337                 SS (Self-snoop)
1338                 HTT (Multi-threading)
1339                 TM (Thermal monitor supported)
1340                 PBE (Pending break enabled)
1341         Version: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz
1342         Voltage: 1.6 V
1343         External Clock: 100 MHz
1344         Max Speed: 4000 MHz
1345         Current Speed: 2500 MHz
1346         Status: Populated, Enabled
1347         Upgrade: Other
1348         L1 Cache Handle: 0x0051
1349         L2 Cache Handle: 0x0052
1350         L3 Cache Handle: 0x0053
1351         Serial Number: Not Specified
1352         Asset Tag: UNKNOWN
1353         Part Number: Not Specified
1354         Core Count: 28
1355         Core Enabled: 28
1356         Thread Count: 56
1357         Characteristics:
1358                 64-bit capable
1359                 Multi-Core
1360                 Hardware Thread
1361                 Execute Protection
1362                 Enhanced Virtualization
1363                 Power/Performance Control
1364 ```
1365
1366 ### Xeon Skx Server Firmware Inventory
1367 ```
1368 Host.           IPMI IP.      BIOS. CPLD.     Aptio SU.   CPU Microcode.  PCI Bus.   ME Operation FW.    X710 Firmware.            XXV710 Firmware.          i40e.
1369 s1-t11-sut1.    10.30.50.47.  2.1.  03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1370 s2-t12-sut1.    10.30.50.48.  2.1.  03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1371 s3-t21-sut1.    10.30.50.41.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1372 s4-t21-tg1.     10.30.50.42.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1373 s5-t22-sut1.    10.30.50.49.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1374 s6-t22-tg1.     10.30.50.50.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1375 s7-t23-sut1.    10.30.50.51.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1376 s8-t23-tg1.     10.30.50.52.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1377 s9-t24-sut1.    10.30.50.53.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1378 s10-t24-tg1.    10.30.50.54.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1379 s11-t31-sut1.   10.30.50.43.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1380 s12-t31-sut2.   10.30.50.44.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1381 s13-t31-tg1.    10.30.50.45.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1382 s14-t32-sut1.   10.30.50.55.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1383 s15-t32-sut2.   10.30.50.56.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1384 s16-t32-tg1.    10.30.50.57.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1385 s19-t33t34-tg1. 10.30.50.46.  2.0b. 03.B1.03. 2.19.1268.  02000043.       A5.01.12.  4.0.4.294.          6.01 0x80003554 1.1747.0. 6.01 0x80003554 1.1747.0. 2.1.14-k.
1386 ```