Trending: Partially remove 3n-hsw
[csit.git] / docs / lab / testbeds_sm_dnv_hw_bios_cfg.md
1 # SuperMicro Denverton Servers - HW and BIOS Configuration
2
3 1. [Linux lscpu](#linux-lscpu)
4 1. [Linux dmidecode](#dmidecode)
5 1. [Atom Dnv Server BIOS Configuration](#atom-dnv-server-bios-configuration)
6    1. [Boot Feature](#boot-feature)
7    1. [CPU Configuration](#cpu-configuration)
8    1. [Chipset Configuration](#chipset-configuration)
9       1. [North Bridge Configuration](#north-bridge-configuration)
10       1. [South Bridge Configuration](#south-bridge-configuration)
11    1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration)
12    1. [ACPI Settings](#acpi-settings)
13 1. [Atom Dnv Server Firmware Inventory](#atom-dnv-server-firmware-inventory)
14
15 ## Linux lscpu
16
17 ```
18 $ lscpu
19 Architecture:        x86_64
20 CPU op-mode(s):      32-bit, 64-bit
21 Byte Order:          Little Endian
22 CPU(s):              12
23 On-line CPU(s) list: 0-11
24 Thread(s) per core:  1
25 Core(s) per socket:  12
26 Socket(s):           1
27 NUMA node(s):        1
28 Vendor ID:           GenuineIntel
29 CPU family:          6
30 Model:               95
31 Model name:          Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
32 Stepping:            1
33 CPU MHz:             2000.000
34 CPU max MHz:         2000.0000
35 CPU min MHz:         800.0000
36 BogoMIPS:            4000.00
37 Virtualization:      VT-x
38 L1d cache:           24K
39 L1i cache:           32K
40 L2 cache:            2048K
41 NUMA node0 CPU(s):   0-11
42 Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca
43 cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx
44 pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology
45 nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl
46 vmx est tm2 ssse3 sdbg cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt
47 tsc_deadline_timer aes xsave rdrand lahf_lm 3dnowprefetch cpuid_fault epb cat_l2
48 ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase
49 tsc_adjust smep erms mpx rdt_a rdseed smap clflushopt intel_pt sha_ni xsaveopt
50 xsavec xgetbv1 xsaves dtherm arat pln pts md_clear arch_capabilities
51
52 ```
53
54 ### Linux dmidecode
55
56 ```
57   # dmidecode 3.1
58   Getting SMBIOS data from sysfs.
59   SMBIOS 3.0.0 present.
60   Table at 0x7F0C8000.
61
62   Handle 0x0000, DMI type 0, 24 bytes
63   BIOS Information
64           Vendor: American Megatrends Inc.
65           Version: 1.0b
66           Release Date: 12/12/2017
67           Address: 0xF0000
68           Runtime Size: 64 kB
69           ROM Size: 16 MB
70           Characteristics:
71                   PCI is supported
72                   BIOS is upgradeable
73                   BIOS shadowing is allowed
74                   Boot from CD is supported
75                   Selectable boot is supported
76                   BIOS ROM is socketed
77                   EDD is supported
78                   5.25"/1.2 MB floppy services are supported (int 13h)
79                   3.5"/720 kB floppy services are supported (int 13h)
80                   3.5"/2.88 MB floppy services are supported (int 13h)
81                   Print screen service is supported (int 5h)
82                   Serial services are supported (int 14h)
83                   Printer services are supported (int 17h)
84                   ACPI is supported
85                   USB legacy is supported
86                   BIOS boot specification is supported
87                   Targeted content distribution is supported
88                   UEFI is supported
89           BIOS Revision: 5.13
90
91   Handle 0x0001, DMI type 1, 27 bytes
92   System Information
93           Manufacturer: Supermicro
94           Product Name: SYS-E300-9A
95           Version: 0123456789
96           Serial Number: S292431X8616427
97           UUID: 03000200-0400-0500-0006-0CC47AFCCA92
98           Wake-up Type: Power Switch
99           SKU Number: To be filled by O.E.M.
100           Family: To be filled by O.E.M.
101
102   Handle 0x0002, DMI type 2, 15 bytes
103   Base Board Information
104           Manufacturer: Supermicro
105           Product Name: A2SDi-TP8F
106           Version: 1.10
107           Serial Number: OM184S023953
108           Asset Tag: To be filled by O.E.M.
109           Features:
110                   Board is a hosting board
111                   Board is replaceable
112           Location In Chassis: To be filled by O.E.M.
113           Chassis Handle: 0x0003
114           Type: Motherboard
115           Contained Object Handles: 0
116
117   Handle 0x0003, DMI type 3, 22 bytes
118   Chassis Information
119           Manufacturer: Supermicro
120           Type: Other
121           Lock: Not Present
122           Version: 0123456789
123           Serial Number: CE300AG39040925
124           Asset Tag: To be filled by O.E.M.
125           Boot-up State: Safe
126           Power Supply State: Safe
127           Thermal State: Safe
128           Security Status: None
129           OEM Information: 0x00000000
130           Height: Unspecified
131           Number Of Power Cords: 1
132           Contained Elements: 0
133           SKU Number: To be filled by O.E.M.
134
135   Handle 0x0028, DMI type 4, 48 bytes
136   Processor Information
137           Socket Designation: CPU
138           Type: Central Processor
139           Family: Atom
140           Manufacturer: Intel(R) Corporation
141           ID: F1 06 05 00 FF FB EB BF
142           Signature: Type 0, Family 6, Model 95, Stepping 1
143           Flags:
144                   FPU (Floating-point unit on-chip)
145                   VME (Virtual mode extension)
146                   DE (Debugging extension)
147                   PSE (Page size extension)
148                   TSC (Time stamp counter)
149                   MSR (Model specific registers)
150                   PAE (Physical address extension)
151                   MCE (Machine check exception)
152                   CX8 (CMPXCHG8 instruction supported)
153                   APIC (On-chip APIC hardware supported)
154                   SEP (Fast system call)
155                   MTRR (Memory type range registers)
156                   PGE (Page global enable)
157                   MCA (Machine check architecture)
158                   CMOV (Conditional move instruction supported)
159                   PAT (Page attribute table)
160                   PSE-36 (36-bit page size extension)
161                   CLFSH (CLFLUSH instruction supported)
162                   DS (Debug store)
163                   ACPI (ACPI supported)
164                   MMX (MMX technology supported)
165                   FXSR (FXSAVE and FXSTOR instructions supported)
166                   SSE (Streaming SIMD extensions)
167                   SSE2 (Streaming SIMD extensions 2)
168                   SS (Self-snoop)
169                   HTT (Multi-threading)
170                   TM (Thermal monitor supported)
171                   PBE (Pending break enabled)
172           Version: Intel(R) Atom(TM) CPU C3858 @ 2.00GHz
173           Voltage: 1.6 V
174           External Clock: 100 MHz
175           Max Speed: 3800 MHz
176           Current Speed: 2000 MHz
177           Status: Populated, Enabled
178           Upgrade: Other
179           L1 Cache Handle: 0x0026
180           L2 Cache Handle: 0x0027
181           L3 Cache Handle: Not Provided
182           Serial Number: Not Specified
183           Asset Tag: UNKNOWN
184           Part Number: Not Specified
185           Core Count: 12
186           Core Enabled: 12
187           Thread Count: 12
188           Characteristics:
189                   64-bit capable
190                   Multi-Core
191                   Hardware Thread
192                   Execute Protection
193                   Enhanced Virtualization
194                   Power/Performance Control
195 ```
196
197 ## Atom Dnv Server BIOS Configuration
198
199 ### Boot Feature
200
201 ```
202   |  Quiet Boot                                [Enabled]               |Enable or disable to         |
203   |                                                                    |display graphic logo during  |
204   |  Bootup NumLock State                      [On]                    |POST                         |
205   |  Wait For "F1" If Error                    [Enabled]               |                             |
206   |                                                                    |                             |
207   |  Power Configuration                                               |                             |
208   |  Watch Dog Function                        [Disabled]              |                             |
209   |  Power Button Function                     [Instant Off]           |                             |
210   |  Restore on AC Power Loss                  [Power On]              |                             |
211 ```
212
213 ### CPU Configuration
214
215 ```
216   |  CPU Configuration                                                 |Enable/Disable EIST. GV3     |
217   |                                                                    |and TM1 must be enabled for  |
218   |  Intel(R) Atom(TM) CPU C3858 @ 2.00GHz                             |TM2 to be available. GV3     |
219   |  Processor ID                              000506F1                |must be enabled for Turbo.   |
220   |  Microcode Revision                        00000020                |Auto - Enable for B0 CPU     |
221   |  Processor Frequency                       2.000GHz                |stepping, all others         |
222   |  CPU BCLK Frequency                          100MHZ                |disabled, change setting to  |
223   |  L1 Cache RAM                                  56KB                |override.                    |
224   |  L2 Cache RAM                               12288KB                |                             |
225   |                                                                    |                             |
226   |  EIST (GV3)                                [Enable]                |                             |
227   |  BIOS Request Frequency                    [Enable]                |                             |
228   |  TM1                                       [Enable]                |                             |
229   |  TM2 Mode                                  [Adaptive Throttling]   |                             |
230   |  Dynamic Self Refresh                      [Disable]               |                             |
231   |  CPU C State                               [Disable]               |                             |
232   |  Package C State Limit                     [No Limit]              |                             |
233   |  Max Core C-State                          [C6]                    |                             |
234   |  Enhanced Hait State (C1E)                 [Enable]                |                             |
235   |  Monitor/Mwait                             [Enable]                |                             |
236   |  L1 Prefetcher                             [Enable]                |                             |
237   |  L1 Prefetcher                             [Enable]                |                             |
238   |  ACPI 3.0 T-States                         [Disable]               |                             |
239   |  Max CPUID Value Limit                     [Disable]               |                             |
240   |  Execute Disable Bit                       [Enable]                |                             |
241   |  Virtualization Technology                 [Enable]                |                             |
242   |  Extended APIC                             [Enable]                |                             |
243   |  AES-NI                                    [Enable]                |                             |
244   |  Lock PACKAGE_RAPL_LIMIT                   [Disable]               |                             |
245   |  PL1 Time Window                           45                      |                             |
246   |  PL1 Power Level                           25                      |                             |
247   |  PL2 Power Level                           29                      |                             |
248   |  Active Processor Cores                    0                       |                             |
249 ```
250
251 ### Chipset Configuration
252
253 ```
254   |  WARNING: Setting wrong values in below sections may cause         |North Bridge Parameters      |
255   |           system to malfunction.                                   |                             |
256   |> North Bridge Configuration                                        |                             |
257   |> South Bridge Configuration                                        |                             |
258 ```
259
260 #### North Bridge Configuration
261
262 ```
263   |  North Bridge Configuration                                        |COption to Ebable / Disable  |
264   |                                                                    |VT-d                         |
265   |  Memory Information                                                |                             |
266   |  MRC Version                               0.149.4.43              |                             |
267   |  Total Memory                              32768 MB                |                             |
268   |  Memory Frequency                          DDR4 - 2400 MHZ         |                             |
269   |                                                                    |                             |
270   |  VT-d                                      [Enabled]               |                             |
271   |  VT-d Interrupt remapping                  [Enabled]               |                             |
272   |                                                                    |                             |
273   |  Fast Boot                                 [Enabled]               |                             |
274   |  Command Address Parity                    [Disabled]              |                             |
275   |  Memory Frequency                          [DDR-2400]              |                             |
276   |  MMIO Size / BMBOUND Base                  [Auto]                  |                             |
277   |  TCL performance                           [Enabled]               |                             |
278   |  Memory Preservation                       [Disabled]              |                             |
279   |  Patrol scrub Enable                       [Enabled]               |                             |
280   |  Patrol scrub Period                       [24 hours]              |                             |
281   |  Demand Scrub Enable                       [Enabled]               |                             |
282   |  Write Data Early Enble                    [Disabled]              |                             |
283   |  Select Refresh Rate                       [1x/2x]                 |                             |
284   |  CKE Power Down                            [Disabled]              |                             |
285   |  Memory Thermal Throttling                 [Disabled]              |                             |
286   |  Scrambler                                 [Enabled]               |                             |
287   |  Slow Power Down Exit                      [Enabled]               |                             |
288 ```
289
290 #### South Bridge Configuration
291
292 ```
293   |  South Bridge Configuration                                        |Enables Legacy USB support.  |
294   |                                                                    |AUTO option disables legacy  |
295   |  USB Module Version                        19                      |support if no USB devices    |
296   |  USB Controllers:                                                  |are connected. DISABLE       |
297   |        1 XHCI                                                      |option will keep USB         |
298   |  USB Devices:                                                      |devices available only for   |
299   |        2 Keyboards, 1 Mouse, 3 Hubs                                |EFI applications.            |
300   |                                                                    |                             |
301   |  Legacy USB Support                        [Enabled]               |                             |
302   |  XHCI Hand-off                             [Enabled]               |                             |
303   |  Port 60/64 Emulation                      [Enabled]               |                             |
304
305 ```
306
307 ### PCIe/PCI/PnP Configuration
308
309 ```
310   |  PCI Bus Driver Version                    A5.01.12                |Enables or Disables 64bit    |
311   |                                                                    |capable Devices to be        |
312   |  PCI Devices Common Settings:                                      |Decoded in Above 4G Address  |
313   |  Above 4G Decoding                         [Enabled]               |Space (Only if System        |
314   |  SR-IOV Support                            [Enabled]               |Supports 64 bit PCI          |
315   |  Maximum Payload                           [Auto]                  |Decoding).                   |
316   |  Maximum Read Request                      [Auto]                  |                             |
317   |  ASPM Support                              [Disabled]              |                             |
318   |  ARI Forwarding                            [Disabled]              |                             |
319   |                                                                    |                             |
320   |  RSC-RR1U-E8 OPROM                         [EFI]                   |                             |
321   |  M.2 PCI-E 3.0 X4 OPROM                    [EFI]                   |                             |
322   |  Mini PCI-E OPROM                          [EFI]                   |                             |
323   |                                                                    |                             |
324   |  Onboard LAN OPROM Type                    [EFI]                   |                             |
325   |                                                                    |                             |
326   |  Onboard Video OPROM                       [EFI]                   |                             |
327   |  VGA Priority                              [Onboard]               |                             |
328   |                                                                    |                             |
329   |  Network Stack                             [Enabled]               |                             |
330   |  IPv4 PXE Support                          [Enabled]               |                             |
331   |  IPv6 PXE Support                          [Disabled]              |                             |
332   |  PXE boot wait time                        0                       |                             |
333   |  Media detect count                        1                       |                             |
334 ```
335
336 ### ACPI Settings
337
338 ```
339   |  ACPI Settings                                                     |Enable/Disable WHEA ACPI     |
340   |                                                                    |support                      |
341   |  WHEA Support                              [Enabled]               |                             |
342 ```
343
344 ## Atom Dnv Server Firmware Inventory
345
346 ```
347 Host.           IPMI IP.      BMC.   BIOS.  CPU Microcode.  PCI Bus.   ME Operation FW.  X553 Firmware.  ixgbe.
348 s29-t26-sut1.   10.30.55.11.  3.60.  1.0b.  0x2e.           A5.01.12.  4.0.4.139.        0x8000083f      5.1.0-k
349 s30-t35-sut1.   10.30.55.12.  3.60.  1.0b.  0x2e.           A5.01.12.  4.0.4.139.        0x8000083f      5.1.0-k
350 s31-t35-sut2.   10.30.55.13.  3.60.  1.0b.  0x2e.           A5.01.12.  4.0.4.139.        0x8000083f      5.1.0-k
351 ```