1 # SuperMicro Cascadelake Servers - HW and BIOS Configuration
3 1. [Linux lscpu](#linux-lscpu)
4 1. [Linux dmidecode](#dmidecode)
5 1. [Linux dmidecode pci](#linux-dmidecode-pci)
6 1. [Linux dmidecode memory](#linux-dmidecode-memory)
7 1. [EPYC zn2 Server BIOS Configuration](#epyc-zn2-server-bios-configuration)
8 1. [Boot Feature](#boot-feature)
9 1. [CPU Configuration](#cpu-configuration)
10 1. [Advanced Power Management Configuration](#advanced-power-management-configuration)
11 1. [CPU P State Control](#cpu-p-state-control)
12 1. [Hardware PM State Control](#hardware-pm-state-control)
13 1. [CPU C State Control](#cpu-c-state-control)
14 1. [Package C State Control](#package-c-state-control)
15 1. [CPU T State Control](#cpu-t-state-control)
16 1. [Chipset Configuration](#chipset-configuration)
17 1. [North Bridge](#north-bridge)
18 1. [UPI Configuration](#upi-configuration)
19 1. [Memory Configuration](#memory-configuration)
20 1. [IIO Configuration](#iio-configuration)
21 1. [CPU1 Configuration](#cpu1-configuration)
22 1. [CPU2 Configuration](#cpu2-configuration)
23 1. [South Bridge](#south-bridge)
24 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration)
25 1. [ACPI Settings](#acpi-settings)
26 1. [EPYC zn2 Server Firmware Inventory](#epyc-zn2-server-firmware-inventory)
33 CPU op-mode(s): 32-bit, 64-bit
34 Byte Order: Little Endian
36 On-line CPU(s) list: 0-63
38 Core(s) per socket: 32
41 Vendor ID: AuthenticAMD
44 Model name: AMD EPYC 7532 32-Core Processor
47 CPU max MHz: 2400.0000
48 CPU min MHz: 1500.0000
55 NUMA node0 CPU(s): 0-15,32-47
56 NUMA node1 CPU(s): 16-31,48-63
57 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate sme ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid overflow_recov succor smca
63 CPU op-mode(s): 32-bit, 64-bit
64 Byte Order: Little Endian
66 On-line CPU(s) list: 0-63
68 Core(s) per socket: 32
71 Vendor ID: AuthenticAMD
74 Model name: AMD EPYC 7532 32-Core Processor
77 CPU max MHz: 2400.0000
78 CPU min MHz: 1500.0000
85 NUMA node0 CPU(s): 0-15,32-47
86 NUMA node1 CPU(s): 16-31,48-63
87 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate sme ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid overflow_recov succor smca
94 Handle 0x0026, DMI type 7, 27 bytes
96 Socket Designation: L1 Cache
97 Configuration: Enabled, Not Socketed, Level 1
98 Operational Mode: Write Back
100 Installed Size: 2048 kB
101 Maximum Size: 2048 kB
102 Supported SRAM Types:
104 Installed SRAM Type: Pipeline Burst
106 Error Correction Type: Multi-bit ECC
108 Associativity: 8-way Set-associative
110 Handle 0x0027, DMI type 7, 27 bytes
112 Socket Designation: L2 Cache
113 Configuration: Enabled, Not Socketed, Level 2
114 Operational Mode: Write Back
116 Installed Size: 16384 kB
117 Maximum Size: 16384 kB
118 Supported SRAM Types:
120 Installed SRAM Type: Pipeline Burst
122 Error Correction Type: Multi-bit ECC
124 Associativity: 8-way Set-associative
126 Handle 0x0028, DMI type 7, 27 bytes
128 Socket Designation: L3 Cache
129 Configuration: Enabled, Not Socketed, Level 3
130 Operational Mode: Write Back
132 Installed Size: 262144 kB
133 Maximum Size: 262144 kB
134 Supported SRAM Types:
136 Installed SRAM Type: Pipeline Burst
138 Error Correction Type: Multi-bit ECC
140 Associativity: 16-way Set-associative
142 Handle 0x0029, DMI type 4, 48 bytes
143 Processor Information
144 Socket Designation: CPU
145 Type: Central Processor
147 Manufacturer: Advanced Micro Devices, Inc.
148 ID: 10 0F 83 00 FF FB 8B 17
149 Signature: Family 23, Model 49, Stepping 0
151 FPU (Floating-point unit on-chip)
152 VME (Virtual mode extension)
153 DE (Debugging extension)
154 PSE (Page size extension)
155 TSC (Time stamp counter)
156 MSR (Model specific registers)
157 PAE (Physical address extension)
158 MCE (Machine check exception)
159 CX8 (CMPXCHG8 instruction supported)
160 APIC (On-chip APIC hardware supported)
161 SEP (Fast system call)
162 MTRR (Memory type range registers)
163 PGE (Page global enable)
164 MCA (Machine check architecture)
165 CMOV (Conditional move instruction supported)
166 PAT (Page attribute table)
167 PSE-36 (36-bit page size extension)
168 CLFSH (CLFLUSH instruction supported)
169 MMX (MMX technology supported)
170 FXSR (FXSAVE and FXSTOR instructions supported)
171 SSE (Streaming SIMD extensions)
172 SSE2 (Streaming SIMD extensions 2)
173 HTT (Multi-threading)
174 Version: AMD EPYC 7532 32-Core Processor
176 External Clock: 100 MHz
178 Current Speed: 2400 MHz
179 Status: Populated, Enabled
181 L1 Cache Handle: 0x0026
182 L2 Cache Handle: 0x0027
183 L3 Cache Handle: 0x0028
184 Serial Number: Unknown
195 Enhanced Virtualization
196 Power/Performance Control
199 ## Linux dmidecode pci
203 Getting SMBIOS data from sysfs.
204 SMBIOS 3.2.0 present.
205 # SMBIOS implementations newer than version 3.1.1 are not
206 # fully supported by this version of dmidecode.
208 Handle 0x000A, DMI type 9, 17 bytes
209 System Slot Information
210 Designation: M.2-HC1 CPU PCI-E 4.0 X4/X2
211 Type: x4 PCI Express 3 x4
212 Current Usage: Available
218 PME signal is supported
219 Bus Address: 0000:ff:00.0
221 Handle 0x000B, DMI type 9, 17 bytes
222 System Slot Information
223 Designation: M.2-HC2 CPU PCI-E 4.0 X2
224 Type: x2 PCI Express 3 x2
225 Current Usage: Available
231 PME signal is supported
232 Bus Address: 0000:ff:00.0
234 Handle 0x0042, DMI type 9, 17 bytes
235 System Slot Information
236 Designation: RSC-W-66G4 SLOT1 PCI-E 4.0 X16
237 Type: x16 PCI Express 3 x16
238 Current Usage: In Use
243 PME signal is supported
244 Bus Address: 0000:41:00.0
246 Handle 0x0043, DMI type 9, 17 bytes
247 System Slot Information
248 Designation: RSC-W-66G4 SLOT2 PCI-E 4.0 X16
249 Type: x16 PCI Express 3 x16
250 Current Usage: In Use
255 PME signal is supported
256 Bus Address: 0000:81:00.0
258 Handle 0x0045, DMI type 9, 17 bytes
259 System Slot Information
260 Designation: RSC-WR-6 SLOT1 PCI-E 4.0 X16
261 Type: x16 PCI Express 3 x16
262 Current Usage: In Use
267 PME signal is supported
268 Bus Address: 0000:01:00.0
272 ## Linux dmidecode memory
275 $ dmidecode -t memory
277 Getting SMBIOS data from sysfs.
278 SMBIOS 3.2.0 present.
279 # SMBIOS implementations newer than version 3.1.1 are not
280 # fully supported by this version of dmidecode.
282 Handle 0x0023, DMI type 16, 23 bytes
283 Physical Memory Array
284 Location: System Board Or Motherboard
286 Error Correction Type: Multi-bit ECC
287 Maximum Capacity: 2 TB
288 Error Information Handle: 0x0022
291 Handle 0x002B, DMI type 17, 84 bytes
294 Error Information Handle: 0x002A
301 Bank Locator: P0_Node0_Channel0_Dimm0
303 Type Detail: Synchronous Registered (Buffered)
305 Manufacturer: SK Hynix
306 Serial Number: 431E9216
307 Asset Tag: P1-DIMMA1_AssetTag (date:19/00)
308 Part Number: HMA84GR7CJR4N-XN
310 Configured Clock Speed: 3200 MT/s
311 Minimum Voltage: 1.2 V
312 Maximum Voltage: 1.2 V
313 Configured Voltage: 1.2 V
315 Handle 0x002E, DMI type 17, 84 bytes
318 Error Information Handle: 0x002D
325 Bank Locator: P0_Node0_Channel1_Dimm0
327 Type Detail: Synchronous Registered (Buffered)
329 Manufacturer: SK Hynix
330 Serial Number: 431E91D2
331 Asset Tag: P1-DIMMB1_AssetTag (date:19/00)
332 Part Number: HMA84GR7CJR4N-XN
334 Configured Clock Speed: 3200 MT/s
335 Minimum Voltage: 1.2 V
336 Maximum Voltage: 1.2 V
337 Configured Voltage: 1.2 V
339 Handle 0x0031, DMI type 17, 84 bytes
342 Error Information Handle: 0x0030
349 Bank Locator: P0_Node0_Channel2_Dimm0
351 Type Detail: Synchronous Registered (Buffered)
353 Manufacturer: SK Hynix
354 Serial Number: 431E918A
355 Asset Tag: P1-DIMMC1_AssetTag (date:19/00)
356 Part Number: HMA84GR7CJR4N-XN
358 Configured Clock Speed: 3200 MT/s
359 Minimum Voltage: 1.2 V
360 Maximum Voltage: 1.2 V
361 Configured Voltage: 1.2 V
363 Handle 0x0034, DMI type 17, 84 bytes
366 Error Information Handle: 0x0033
373 Bank Locator: P0_Node0_Channel3_Dimm0
375 Type Detail: Synchronous Registered (Buffered)
377 Manufacturer: SK Hynix
378 Serial Number: 431E9187
379 Asset Tag: P1-DIMMD1_AssetTag (date:19/00)
380 Part Number: HMA84GR7CJR4N-XN
382 Configured Clock Speed: 3200 MT/s
383 Minimum Voltage: 1.2 V
384 Maximum Voltage: 1.2 V
385 Configured Voltage: 1.2 V
387 Handle 0x0037, DMI type 17, 84 bytes
390 Error Information Handle: 0x0036
397 Bank Locator: P0_Node0_Channel4_Dimm0
399 Type Detail: Synchronous Registered (Buffered)
401 Manufacturer: SK Hynix
402 Serial Number: 431E9178
403 Asset Tag: P1-DIMME1_AssetTag (date:19/00)
404 Part Number: HMA84GR7CJR4N-XN
406 Configured Clock Speed: 3200 MT/s
407 Minimum Voltage: 1.2 V
408 Maximum Voltage: 1.2 V
409 Configured Voltage: 1.2 V
411 Handle 0x003A, DMI type 17, 84 bytes
414 Error Information Handle: 0x0039
421 Bank Locator: P0_Node0_Channel5_Dimm0
423 Type Detail: Synchronous Registered (Buffered)
425 Manufacturer: SK Hynix
426 Serial Number: 431E9206
427 Asset Tag: P1-DIMMF1_AssetTag (date:19/00)
428 Part Number: HMA84GR7CJR4N-XN
430 Configured Clock Speed: 3200 MT/s
431 Minimum Voltage: 1.2 V
432 Maximum Voltage: 1.2 V
433 Configured Voltage: 1.2 V
435 Handle 0x003D, DMI type 17, 84 bytes
438 Error Information Handle: 0x003C
445 Bank Locator: P0_Node0_Channel6_Dimm0
447 Type Detail: Synchronous Registered (Buffered)
449 Manufacturer: SK Hynix
450 Serial Number: 431E9207
451 Asset Tag: P1-DIMMG1_AssetTag (date:19/00)
452 Part Number: HMA84GR7CJR4N-XN
454 Configured Clock Speed: 3200 MT/s
455 Minimum Voltage: 1.2 V
456 Maximum Voltage: 1.2 V
457 Configured Voltage: 1.2 V
459 Handle 0x0040, DMI type 17, 84 bytes
462 Error Information Handle: 0x003F
469 Bank Locator: P0_Node0_Channel7_Dimm0
471 Type Detail: Synchronous Registered (Buffered)
473 Manufacturer: SK Hynix
474 Serial Number: 431E9209
475 Asset Tag: P1-DIMMH1_AssetTag (date:19/00)
476 Part Number: HMA84GR7CJR4N-XN
478 Configured Clock Speed: 3200 MT/s
479 Minimum Voltage: 1.2 V
480 Maximum Voltage: 1.2 V
481 Configured Voltage: 1.2 V
484 ## EPYC zn2 Server BIOS Configuration - TG
489 | Quiet Boot [Enabled] |Boot option |
491 | Option ROM Messages [Force BIOS] | |
492 | Bootup NumLock State [On] | |
493 | Wait For "F1" If Error [Enabled] | |
494 | INT19 Trap Response [Immediate] | |
495 | Re-try Boot [Disabled] | |
497 | Power Configuration | |
498 | Watch Dog Function [Disabled] | |
499 | Restore on AC Power Loss [Last State] | |
500 | Power Button Function [Instant Off] | |
503 ### CPU Configuration
507 | -------------------------------------------------- *| |
508 | PCI AER Support [Disabled] *| |
509 | High Precision Event Timer [Disabled] *| |
510 | NUMA Nodes Per Socket [NPS2] *| |
511 | ACPI SRAT L3 Cache As NUMA Domain [Auto] *| |
513 | CPU Configuration ^| |
514 | -------------------------------------------------- *| |
515 | SMT Control [Auto] *| |
516 | Core Performance Boost [Auto] *| |
517 | Global C-state control [Disabled] *| |
518 | Local APIC Mode [Auto] *| |
519 | CCD Control [Auto] *| |
520 | Core Control [Auto] *| |
521 | Core Control [Auto] *| |
522 | L1 Stream HW Prefetcher [Enabled] *| |
523 | L2 Stream HW Prefetcher [Enabled] *| |
524 | SVM Mode [Enabled] *| |
525 | SMEE [Disabled] *| |
527 |> CPU1 Information *| |
529 | NB Configuration ^| |
530 | -------------------------------------------------- *| |
531 | Determinism Control [Manual] *| |
532 | Determinism Slider [Performance] *| |
533 | cTDP Control [Disabled] *| |
534 | IOMMU [Disabled] *| |
535 | ACS Enable [Auto] *| |
536 | Package Power Limit Control [Auto] *| |
538 | Fixed SOC Pstate [P0] *| |
539 | DF Cstates [Enabled] *| |
540 | Preferred IO [Manual] *| |
541 | Preferred IO Bus [##] *| |
543 | *|-----------------------------|
544 | *|><: Select Screen |
545 | *|^v: Select Item |
547 | +|+/-: Change Opt. |
548 | +|F1: General Help |
549 | +|F2: Previous Values |
550 | +|F3: Optimized Defaults |
551 | v|F4: Save & Exit |
556 ## EPYC zn2 Server BIOS Configuration - DUT
561 | Quiet Boot [Enabled] |Boot option |
563 | Option ROM Messages [Force BIOS] | |
564 | Bootup NumLock State [On] | |
565 | Wait For "F1" If Error [Enabled] | |
566 | INT19 Trap Response [Immediate] | |
567 | Re-try Boot [Disabled] | |
569 | Power Configuration | |
570 | Watch Dog Function [Disabled] | |
571 | Restore on AC Power Loss [Last State] | |
572 | Power Button Function [Instant Off] | |
575 ### CPU Configuration
579 | -------------------------------------------------- *| |
580 | PCI AER Support [Disabled] *| |
581 | High Precision Event Timer [Disabled] *| |
582 | NUMA Nodes Per Socket [NPS2] *| |
583 | ACPI SRAT L3 Cache As NUMA Domain [Auto] *| |
585 | CPU Configuration ^| |
586 | -------------------------------------------------- *| |
587 | SMT Control [Auto] *| |
588 | Core Performance Boost [Auto] *| |
589 | Global C-state control [Disabled] *| |
590 | Local APIC Mode [Auto] *| |
591 | CCD Control [Auto] *| |
592 | Core Control [Auto] *| |
593 | Core Control [Auto] *| |
594 | L1 Stream HW Prefetcher [Enabled] *| |
595 | L2 Stream HW Prefetcher [Enabled] *| |
596 | SVM Mode [Enabled] *| |
597 | SMEE [Disabled] *| |
599 |> CPU1 Information *| |
601 | NB Configuration ^| |
602 | -------------------------------------------------- *| |
603 | Determinism Control [Manual] *| |
604 | Determinism Slider [Performance] *| |
605 | cTDP Control [Disabled] *| |
606 | IOMMU [Disabled] *| |
607 | ACS Enable [Auto] *| |
608 | Package Power Limit Control [Auto] *| |
610 | Fixed SOC Pstate [P0] *| |
611 | DF Cstates [Enabled] *| |
612 | Preferred IO [Manual] *| |
613 | Preferred IO Bus [##] *| |
615 | *|-----------------------------|
616 | *|><: Select Screen |
617 | *|^v: Select Item |
619 | +|+/-: Change Opt. |
620 | +|F1: General Help |
621 | +|F2: Previous Values |
622 | +|F3: Optimized Defaults |
623 | v|F4: Save & Exit |
628 ## EPYC zn2 Server Firmware Inventory
631 Host. IPMI IP. BMC. BIOS. CPLD. CPU Microcode. PCI Bus. X710 Firmware. XXV710 Firmware. i40e. MLX5 Firmware. mlx5_core
632 s60-t210-sut1. 10.30.55.24. 03.10.04. 1.1a. 02.c2.00. 0x8301038. ?. 6.80 0x80003ce6 1.2074.0. 6.01 0x80003554 1.1747.0. 2.8.20-k. 16.29.1016. 5.2-1.0.4.
633 s61-t210-tg1. 10.30.55.25. 03.10.04. 1.1a. 02.c2.00. 0x8301038. ?. 6.80 0x80003ce6 1.2007.0. 6.80 0x80003d05 1.2007.0. 2.8.20-k. 16.29.1016. 5.2-1.0.4.