1 # SuperMicro Cascadelake Servers - HW and BIOS Configuration
3 1. [Linux lscpu](#linux-lscpu)
4 1. [Linux dmidecode](#dmidecode)
5 1. [Linux dmidecode pci](#linux-dmidecode-pci)
6 1. [Linux dmidecode memory](#linux-dmidecode-memory)
7 1. [EPYC zn2 Server BIOS Configuration](#epyc-zn2-server-bios-configuration)
8 1. [Boot Feature](#boot-feature)
9 1. [CPU Configuration](#cpu-configuration)
10 1. [Advanced Power Management Configuration](#advanced-power-management-configuration)
11 1. [CPU P State Control](#cpu-p-state-control)
12 1. [Hardware PM State Control](#hardware-pm-state-control)
13 1. [CPU C State Control](#cpu-c-state-control)
14 1. [Package C State Control](#package-c-state-control)
15 1. [CPU T State Control](#cpu-t-state-control)
16 1. [Chipset Configuration](#chipset-configuration)
17 1. [North Bridge](#north-bridge)
18 1. [UPI Configuration](#upi-configuration)
19 1. [Memory Configuration](#memory-configuration)
20 1. [IIO Configuration](#iio-configuration)
21 1. [CPU1 Configuration](#cpu1-configuration)
22 1. [CPU2 Configuration](#cpu2-configuration)
23 1. [South Bridge](#south-bridge)
24 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration)
25 1. [ACPI Settings](#acpi-settings)
26 1. [EPYC zn2 Server Firmware Inventory](#epyc-zn2-server-firmware-inventory)
33 CPU op-mode(s): 32-bit, 64-bit
34 Byte Order: Little Endian
36 On-line CPU(s) list: 0-63
38 Core(s) per socket: 32
41 Vendor ID: AuthenticAMD
44 Model name: AMD EPYC 7532 32-Core Processor
47 CPU max MHz: 2400.0000
48 CPU min MHz: 1500.0000
55 NUMA node0 CPU(s): 0-15,32-47
56 NUMA node1 CPU(s): 16-31,48-63
57 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate sme ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid overflow_recov succor smca
63 CPU op-mode(s): 32-bit, 64-bit
64 Byte Order: Little Endian
66 On-line CPU(s) list: 0-63
68 Core(s) per socket: 32
71 Vendor ID: AuthenticAMD
74 Model name: AMD EPYC 7532 32-Core Processor
77 CPU max MHz: 2400.0000
78 CPU min MHz: 1500.0000
85 NUMA node0 CPU(s): 0-63
86 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate sme ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid overflow_recov succor smca
93 Handle 0x0026, DMI type 7, 27 bytes
95 Socket Designation: L1 Cache
96 Configuration: Enabled, Not Socketed, Level 1
97 Operational Mode: Write Back
99 Installed Size: 2048 kB
100 Maximum Size: 2048 kB
101 Supported SRAM Types:
103 Installed SRAM Type: Pipeline Burst
105 Error Correction Type: Multi-bit ECC
107 Associativity: 8-way Set-associative
109 Handle 0x0027, DMI type 7, 27 bytes
111 Socket Designation: L2 Cache
112 Configuration: Enabled, Not Socketed, Level 2
113 Operational Mode: Write Back
115 Installed Size: 16384 kB
116 Maximum Size: 16384 kB
117 Supported SRAM Types:
119 Installed SRAM Type: Pipeline Burst
121 Error Correction Type: Multi-bit ECC
123 Associativity: 8-way Set-associative
125 Handle 0x0028, DMI type 7, 27 bytes
127 Socket Designation: L3 Cache
128 Configuration: Enabled, Not Socketed, Level 3
129 Operational Mode: Write Back
131 Installed Size: 262144 kB
132 Maximum Size: 262144 kB
133 Supported SRAM Types:
135 Installed SRAM Type: Pipeline Burst
137 Error Correction Type: Multi-bit ECC
139 Associativity: 16-way Set-associative
141 Handle 0x0029, DMI type 4, 48 bytes
142 Processor Information
143 Socket Designation: CPU
144 Type: Central Processor
146 Manufacturer: Advanced Micro Devices, Inc.
147 ID: 10 0F 83 00 FF FB 8B 17
148 Signature: Family 23, Model 49, Stepping 0
150 FPU (Floating-point unit on-chip)
151 VME (Virtual mode extension)
152 DE (Debugging extension)
153 PSE (Page size extension)
154 TSC (Time stamp counter)
155 MSR (Model specific registers)
156 PAE (Physical address extension)
157 MCE (Machine check exception)
158 CX8 (CMPXCHG8 instruction supported)
159 APIC (On-chip APIC hardware supported)
160 SEP (Fast system call)
161 MTRR (Memory type range registers)
162 PGE (Page global enable)
163 MCA (Machine check architecture)
164 CMOV (Conditional move instruction supported)
165 PAT (Page attribute table)
166 PSE-36 (36-bit page size extension)
167 CLFSH (CLFLUSH instruction supported)
168 MMX (MMX technology supported)
169 FXSR (FXSAVE and FXSTOR instructions supported)
170 SSE (Streaming SIMD extensions)
171 SSE2 (Streaming SIMD extensions 2)
172 HTT (Multi-threading)
173 Version: AMD EPYC 7532 32-Core Processor
175 External Clock: 100 MHz
177 Current Speed: 2400 MHz
178 Status: Populated, Enabled
180 L1 Cache Handle: 0x0026
181 L2 Cache Handle: 0x0027
182 L3 Cache Handle: 0x0028
183 Serial Number: Unknown
194 Enhanced Virtualization
195 Power/Performance Control
198 ## Linux dmidecode pci
202 Getting SMBIOS data from sysfs.
203 SMBIOS 3.2.0 present.
204 # SMBIOS implementations newer than version 3.1.1 are not
205 # fully supported by this version of dmidecode.
207 Handle 0x000A, DMI type 9, 17 bytes
208 System Slot Information
209 Designation: M.2-HC1 CPU PCI-E 4.0 X4/X2
210 Type: x4 PCI Express 3 x4
211 Current Usage: Available
217 PME signal is supported
218 Bus Address: 0000:ff:00.0
220 Handle 0x000B, DMI type 9, 17 bytes
221 System Slot Information
222 Designation: M.2-HC2 CPU PCI-E 4.0 X2
223 Type: x2 PCI Express 3 x2
224 Current Usage: Available
230 PME signal is supported
231 Bus Address: 0000:ff:00.0
233 Handle 0x0042, DMI type 9, 17 bytes
234 System Slot Information
235 Designation: RSC-W-66G4 SLOT1 PCI-E 4.0 X16
236 Type: x16 PCI Express 3 x16
237 Current Usage: In Use
242 PME signal is supported
243 Bus Address: 0000:41:00.0
245 Handle 0x0043, DMI type 9, 17 bytes
246 System Slot Information
247 Designation: RSC-W-66G4 SLOT2 PCI-E 4.0 X16
248 Type: x16 PCI Express 3 x16
249 Current Usage: In Use
254 PME signal is supported
255 Bus Address: 0000:81:00.0
257 Handle 0x0045, DMI type 9, 17 bytes
258 System Slot Information
259 Designation: RSC-WR-6 SLOT1 PCI-E 4.0 X16
260 Type: x16 PCI Express 3 x16
261 Current Usage: In Use
266 PME signal is supported
267 Bus Address: 0000:01:00.0
271 ## Linux dmidecode memory
274 $ dmidecode -t memory
276 Getting SMBIOS data from sysfs.
277 SMBIOS 3.2.0 present.
278 # SMBIOS implementations newer than version 3.1.1 are not
279 # fully supported by this version of dmidecode.
281 Handle 0x0023, DMI type 16, 23 bytes
282 Physical Memory Array
283 Location: System Board Or Motherboard
285 Error Correction Type: Multi-bit ECC
286 Maximum Capacity: 2 TB
287 Error Information Handle: 0x0022
290 Handle 0x002B, DMI type 17, 84 bytes
293 Error Information Handle: 0x002A
300 Bank Locator: P0_Node0_Channel0_Dimm0
302 Type Detail: Synchronous Registered (Buffered)
304 Manufacturer: SK Hynix
305 Serial Number: 431E9216
306 Asset Tag: P1-DIMMA1_AssetTag (date:19/00)
307 Part Number: HMA84GR7CJR4N-XN
309 Configured Clock Speed: 3200 MT/s
310 Minimum Voltage: 1.2 V
311 Maximum Voltage: 1.2 V
312 Configured Voltage: 1.2 V
314 Handle 0x002E, DMI type 17, 84 bytes
317 Error Information Handle: 0x002D
324 Bank Locator: P0_Node0_Channel1_Dimm0
326 Type Detail: Synchronous Registered (Buffered)
328 Manufacturer: SK Hynix
329 Serial Number: 431E91D2
330 Asset Tag: P1-DIMMB1_AssetTag (date:19/00)
331 Part Number: HMA84GR7CJR4N-XN
333 Configured Clock Speed: 3200 MT/s
334 Minimum Voltage: 1.2 V
335 Maximum Voltage: 1.2 V
336 Configured Voltage: 1.2 V
338 Handle 0x0031, DMI type 17, 84 bytes
341 Error Information Handle: 0x0030
348 Bank Locator: P0_Node0_Channel2_Dimm0
350 Type Detail: Synchronous Registered (Buffered)
352 Manufacturer: SK Hynix
353 Serial Number: 431E918A
354 Asset Tag: P1-DIMMC1_AssetTag (date:19/00)
355 Part Number: HMA84GR7CJR4N-XN
357 Configured Clock Speed: 3200 MT/s
358 Minimum Voltage: 1.2 V
359 Maximum Voltage: 1.2 V
360 Configured Voltage: 1.2 V
362 Handle 0x0034, DMI type 17, 84 bytes
365 Error Information Handle: 0x0033
372 Bank Locator: P0_Node0_Channel3_Dimm0
374 Type Detail: Synchronous Registered (Buffered)
376 Manufacturer: SK Hynix
377 Serial Number: 431E9187
378 Asset Tag: P1-DIMMD1_AssetTag (date:19/00)
379 Part Number: HMA84GR7CJR4N-XN
381 Configured Clock Speed: 3200 MT/s
382 Minimum Voltage: 1.2 V
383 Maximum Voltage: 1.2 V
384 Configured Voltage: 1.2 V
386 Handle 0x0037, DMI type 17, 84 bytes
389 Error Information Handle: 0x0036
396 Bank Locator: P0_Node0_Channel4_Dimm0
398 Type Detail: Synchronous Registered (Buffered)
400 Manufacturer: SK Hynix
401 Serial Number: 431E9178
402 Asset Tag: P1-DIMME1_AssetTag (date:19/00)
403 Part Number: HMA84GR7CJR4N-XN
405 Configured Clock Speed: 3200 MT/s
406 Minimum Voltage: 1.2 V
407 Maximum Voltage: 1.2 V
408 Configured Voltage: 1.2 V
410 Handle 0x003A, DMI type 17, 84 bytes
413 Error Information Handle: 0x0039
420 Bank Locator: P0_Node0_Channel5_Dimm0
422 Type Detail: Synchronous Registered (Buffered)
424 Manufacturer: SK Hynix
425 Serial Number: 431E9206
426 Asset Tag: P1-DIMMF1_AssetTag (date:19/00)
427 Part Number: HMA84GR7CJR4N-XN
429 Configured Clock Speed: 3200 MT/s
430 Minimum Voltage: 1.2 V
431 Maximum Voltage: 1.2 V
432 Configured Voltage: 1.2 V
434 Handle 0x003D, DMI type 17, 84 bytes
437 Error Information Handle: 0x003C
444 Bank Locator: P0_Node0_Channel6_Dimm0
446 Type Detail: Synchronous Registered (Buffered)
448 Manufacturer: SK Hynix
449 Serial Number: 431E9207
450 Asset Tag: P1-DIMMG1_AssetTag (date:19/00)
451 Part Number: HMA84GR7CJR4N-XN
453 Configured Clock Speed: 3200 MT/s
454 Minimum Voltage: 1.2 V
455 Maximum Voltage: 1.2 V
456 Configured Voltage: 1.2 V
458 Handle 0x0040, DMI type 17, 84 bytes
461 Error Information Handle: 0x003F
468 Bank Locator: P0_Node0_Channel7_Dimm0
470 Type Detail: Synchronous Registered (Buffered)
472 Manufacturer: SK Hynix
473 Serial Number: 431E9209
474 Asset Tag: P1-DIMMH1_AssetTag (date:19/00)
475 Part Number: HMA84GR7CJR4N-XN
477 Configured Clock Speed: 3200 MT/s
478 Minimum Voltage: 1.2 V
479 Maximum Voltage: 1.2 V
480 Configured Voltage: 1.2 V
483 ## EPYC zn2 Server BIOS Configuration - TG
488 | Quiet Boot [Enabled] |Boot option |
490 | Option ROM Messages [Force BIOS] | |
491 | Bootup NumLock State [On] | |
492 | Wait For "F1" If Error [Enabled] | |
493 | INT19 Trap Response [Immediate] | |
494 | Re-try Boot [Disabled] | |
496 | Power Configuration | |
497 | Watch Dog Function [Disabled] | |
498 | Restore on AC Power Loss [Last State] | |
499 | Power Button Function [Instant Off] | |
502 ### CPU Configuration
506 | -------------------------------------------------- *| |
507 | PCI AER Support [Disabled] *| |
508 | High Precision Event Timer [Disabled] *| |
509 | NUMA Nodes Per Socket [NPS2] *| |
510 | ACPI SRAT L3 Cache As NUMA Domain [Auto] *| |
512 | CPU Configuration ^| |
513 | -------------------------------------------------- *| |
514 | SMT Control [Auto] *| |
515 | Core Performance Boost [Auto] *| |
516 | Global C-state control [Disabled] *| |
517 | Local APIC Mode [Auto] *| |
518 | CCD Control [Auto] *| |
519 | Core Control [Auto] *| |
520 | Core Control [Auto] *| |
521 | L1 Stream HW Prefetcher [Enabled] *| |
522 | L2 Stream HW Prefetcher [Enabled] *| |
523 | SVM Mode [Enabled] *| |
524 | SMEE [Disabled] *| |
526 |> CPU1 Information *| |
528 | NB Configuration ^| |
529 | -------------------------------------------------- *| |
530 | Determinism Control [Manual] *| |
531 | Determinism Slider [Performance] *| |
532 | cTDP Control [Disabled] *| |
533 | IOMMU [Disabled] *| |
534 | ACS Enable [Auto] *| |
535 | Package Power Limit Control [Auto] *| |
537 | Fixed SOC Pstate [P0] *| |
538 | DF Cstates [Enabled] *| |
539 | Preferred IO [Manual] *| |
540 | Preferred IO Bus [##] *| |
542 | *|-----------------------------|
543 | *|><: Select Screen |
544 | *|^v: Select Item |
546 | +|+/-: Change Opt. |
547 | +|F1: General Help |
548 | +|F2: Previous Values |
549 | +|F3: Optimized Defaults |
550 | v|F4: Save & Exit |
555 ## EPYC zn2 Server BIOS Configuration - DUT
560 | Quiet Boot [Enabled] |Boot option |
562 | Option ROM Messages [Force BIOS] | |
563 | Bootup NumLock State [On] | |
564 | Wait For "F1" If Error [Enabled] | |
565 | INT19 Trap Response [Immediate] | |
566 | Re-try Boot [Disabled] | |
568 | Power Configuration | |
569 | Watch Dog Function [Disabled] | |
570 | Restore on AC Power Loss [Last State] | |
571 | Power Button Function [Instant Off] | |
574 ### CPU Configuration
578 | -------------------------------------------------- *| |
579 | PCI AER Support [Disabled] *| |
580 | High Precision Event Timer [Disabled] *| |
581 | NUMA Nodes Per Socket [NPS2] *| |
582 | ACPI SRAT L3 Cache As NUMA Domain [Auto] *| |
584 | CPU Configuration ^| |
585 | -------------------------------------------------- *| |
586 | SMT Control [Auto] *| |
587 | Core Performance Boost [Auto] *| |
588 | Global C-state control [Disabled] *| |
589 | Local APIC Mode [Auto] *| |
590 | CCD Control [Auto] *| |
591 | Core Control [Auto] *| |
592 | Core Control [Auto] *| |
593 | L1 Stream HW Prefetcher [Enabled] *| |
594 | L2 Stream HW Prefetcher [Enabled] *| |
595 | SVM Mode [Enabled] *| |
596 | SMEE [Disabled] *| |
598 |> CPU1 Information *| |
600 | NB Configuration ^| |
601 | -------------------------------------------------- *| |
602 | Determinism Control [Manual] *| |
603 | Determinism Slider [Performance] *| |
604 | cTDP Control [Disabled] *| |
605 | IOMMU [Disabled] *| |
606 | ACS Enable [Auto] *| |
607 | Package Power Limit Control [Auto] *| |
609 | Fixed SOC Pstate [P0] *| |
610 | DF Cstates [Enabled] *| |
611 | Preferred IO [Manual] *| |
612 | Preferred IO Bus [##] *| |
614 | *|-----------------------------|
615 | *|><: Select Screen |
616 | *|^v: Select Item |
618 | +|+/-: Change Opt. |
619 | +|F1: General Help |
620 | +|F2: Previous Values |
621 | +|F3: Optimized Defaults |
622 | v|F4: Save & Exit |
627 ## EPYC zn2 Server Firmware Inventory
630 Host. IPMI IP. BMC. BIOS. CPLD. CPU Microcode. PCI Bus. X710 Firmware. XXV710 Firmware. i40e. MLX5 Firmware. mlx5_core
631 s60-t210-sut1. 10.30.55.24. 03.10.04. 1.1. 02.c2.00. 0x8301034. ?. 6.80 0x80003ce6 1.2074.0. 6.01 0x80003554 1.1747.0. 2.1.14-k. 16.26.1040. 4.6-1.0.1.
632 s61-t210-tg1. 10.30.55.25. 03.10.04. T20200528164548. 02.c2.00. 0x8301038. ?. 6.80 0x80003ce6 1.2074.0. 6.01 0x80003554 1.1747.0. 2.1.14-k. 16.26.1040. 4.6-1.0.1.