X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=docs%2Flab%2Ftestbed_specifications.md;h=fad1bdc229069b92a8bd31a38ffbb9b588b6aad1;hp=579ccf47573eebbb81fa22c73deafe8db0e8ab15;hb=82b34c726b4eb93fbb8ca48b491dd7da65cb813b;hpb=0723f2785e6681a645b3444481e4d23d505aa383 diff --git a/docs/lab/testbed_specifications.md b/docs/lab/testbed_specifications.md index 579ccf4757..fad1bdc229 100644 --- a/docs/lab/testbed_specifications.md +++ b/docs/lab/testbed_specifications.md @@ -18,6 +18,7 @@ 1. [3-Node-TaiShan Arm Huawei (3n-tsh)](#3-node-taishan-arm-huawei-3n-tsh) 1. [3-Node-Altra Arm Ampere (3n-alt)](#3-node-altra-arm-armpere-3n-alt) 1. [3-Node-Icelake Xeon Intel (3n-icx)](#3-node-icelake-xeon-intel-3n-icx) + 1. [3-Node-SnowRidge Atom Intel (3n-snr)](#3-node-snowridge-atom-intel-3n-snr) 1. [Server Management](#server-management) 1. [Requirements](#requirements) 1. [Addressing](#addressing) @@ -37,12 +38,13 @@ 1. [2-Node-Cascadelake Servers (2n-clx) PROD](#2-node-cascadelake-servers-2n-clx-prod) 1. [2-Node-Zen2 Servers (2n-zn2) PROD](#2-node-zen2-servers-2n-zn2-prod]) 1. [2-Node-ThunderX2 Servers (2n-tx2) PROD](#2-node-thunderx2-servers-2n-tx2-prod) - 1. [2-Node-Icelake Servers (2n-icx) TBD](#2-node-icelake-servers-2n-icx-tbd) + 1. [2-Node-Icelake Servers (2n-icx) PROD](#2-node-icelake-servers-2n-icx-prod) 1. [3-Node-Skylake Servers (3n-skx) PROD](#3-node-skylake-servers-3n-skx-prod) 1. [3-Node-Rangeley Servers (3n-rng) VERIFY](#3-node-rangeley-servers-3n-rng-verify) 1. [3-Node-Taishan Servers (3n-tsh) PROD](#3-node-taishan-servers-3n-tsh-prod) - 1. [3-Node-Altra Servers (3n-alt) TBD](#3-node-altra-servers-3n-alt-tbd) - 1. [3-Node-Icelake Servers (3n-icx) TBD](#3-node-icelake-servers-3n-icx-tbd) + 1. [3-Node-Altra Servers (3n-alt) PROD](#3-node-altra-servers-3n-alt-prod) + 1. [3-Node-Icelake Servers (3n-icx) PROD](#3-node-icelake-servers-3n-icx-prod) + 1. [3-Node-SnowRidge Servers (3n-snr) PROD](#3-node-snowridge-servers-3n-snr-prod) 1. [Per Testbed Wiring](#per-testbed-wiring) 1. [1-Node-Skylake Wiring (1n-skx) PROD](#1-node-skylake-wiring-1n-skx-prod) 1. [1-Node-ThunderX2 Wiring (1n-tx2) PROD](#1-node-thunderx2-wiring-1n-tx2-prod) @@ -53,12 +55,13 @@ 1. [2-Node-Cascadelake Wiring (2n-clx) PROD](#2-node-cascadelake-wiring-2n-clx-prod) 1. [2-Node-Zen2 Wiring (2n-zn2) PROD](#2-node-zen2-wiring-2n-zn2-prod]) 1. [2-Node-ThunderX2 Wiring (2n-tx2) PROD](#2-node-thunderx2-wiring-2n-tx2-prod) - 1. [2-Node-Icelake Servers (2n-icx) TBD](#2-node-icelake-servers-2n-icx-tbd) + 1. [2-Node-Icelake Servers (2n-icx) PROD](#2-node-icelake-servers-2n-icx-prod) 1. [3-Node-Skylake Wiring (3n-skx) PROD](#3-node-skylake-wiring-3n-skx-prod) - 1. [3-Node-Rangeley Wiring (3n-rng) TODO](#3-node-rangeley-wiring-3n-rng-todo) + 1. [3-Node-Rangeley Wiring (3n-rng) VERIFY](#3-node-rangeley-wiring-3n-rng-todo) 1. [3-Node-Taishan Wiring (3n-tsh) PROD](#3-node-taishan-wiring-3n-tsh-prod) - 1. [3-Node-Altra Wiring (3n-alt) TBD](#3-node-altra-wiring-3n-alt-tbd) - 1. [3-Node-Icelake Wiring (3n-icx) TBD](#3-node-icelake-wiring-3n-icx-tbd) + 1. [3-Node-Altra Wiring (3n-alt) PROD](#3-node-altra-wiring-3n-alt-prod) + 1. [3-Node-Icelake Wiring (3n-icx) PROD](#3-node-icelake-wiring-3n-icx-prod) + 1. [3-Node-SnowRidge Wiring (3n-snr) PROD](#3-node-snowridge-wiring-3n-snr-prod) 1. [Inventory](#inventory) 1. [Appliances](#appliances) 1. [Arm Servers](#arm-servers) @@ -77,26 +80,27 @@ hosted by LFN FD.io CSIT project. ### Summary List ``` - #. CSIT_tb Purpose SUT TG #TB #SUT #TG #hsw #skx #ps1 #rng #dnv #tx2 #tsh #alt #clx #zn2 #icx - 1. 1-Node-Haswell nomad hsw na 4 4 0 4 0 0 0 0 0 0 0 0 0 0 - 2. 1-Node-Skylake dev skx na 2 2 0 0 2 0 0 0 0 0 0 0 0 0 - 3. 1-Node-ThunderX2 dev tx2 na 2 2 0 0 0 0 0 0 2 0 0 0 0 0 - 4. 1-Node-Cascadelake dev clx lcx 1 1 0 0 0 0 0 0 0 0 0 1 0 0 - 5. 2-Node-Skylake perf skx skx 4 4 4 0 8 0 0 0 0 0 0 0 0 0 - 6. 2-Node-Denverton perf dnv skx 1 1 1 0 .5 0 0 1 0 0 0 0 0 0 - 7. 2-Node-IxiaPS1L47 tcp skx ps1 1 1 1 0 1 1 0 0 0 0 0 0 0 0 - 8. 2-Node-Cascadelake perf clx clx 3 3 3 0 0 0 0 0 0 0 0 6 0 0 - 9. 2-Node-ThunderX2 perf tx2 skx 1 1 .5 0 .5 0 0 0 1 0 0 0 0 0 -10. 2-Node-Icelake perf icx icx 4 4 4 0 0 0 0 0 0 0 0 0 0 8 -11. 3-Node-Skylake perf skx skx 2 4 2 0 6 0 0 0 0 0 0 0 0 0 -12. 3-Node-Rangeley perf rng skx 1 3 1 0 0 0 2 0 0 0 0 0 0 0 -13. 3-Node-Taishan perf tsh skx 1 2 .5 0 .5 0 0 0 0 2 0 0 0 0 -14. 3-Node-Altra perf alt icx 1 2 .5 0 0 0 0 0 0 0 2 0 0 .5 -15. 3-Node-Denverton perf dnv skx 1 2 1 0 .5 0 0 2 0 0 0 0 0 0 -16. 2-Node-Zen2 perf zn2 zn2 1 1 1 0 0 0 0 0 0 0 0 0 2 0 -17. 3-Node-Icelake perf icx icx 2 4 2 0 0 0 0 0 0 0 0 6 0 6 -18. 1-Node-AmpereAltra nomad alt na 2 2 0 0 0 0 0 0 0 0 2 0 0 0 - Totals: 34 43 21.5 4 19 1 2 3 3 2 4 7 2 14.5 + #. CSIT_tb Purpose SUT TG #TB #SUT #TG #hsw #skx #ps1 #rng #dnv #tx2 #tsh #alt #clx #zn2 #icx #snr + 1. 1-Node-Haswell nomad hsw na 4 4 0 4 0 0 0 0 0 0 0 0 0 0 0 + 2. 1-Node-Skylake dev skx na 2 2 0 0 2 0 0 0 0 0 0 0 0 0 0 + 3. 1-Node-ThunderX2 dev tx2 na 2 2 0 0 0 0 0 0 2 0 0 0 0 0 0 + 4. 1-Node-Cascadelake dev clx lcx 1 1 0 0 0 0 0 0 0 0 0 1 0 0 0 + 5. 1-Node-AmpereAltra nomad alt na 2 2 0 0 0 0 0 0 0 0 2 0 0 0 0 + 6. 2-Node-Skylake perf skx skx 3 3 3 0 6 0 0 0 0 0 0 0 0 0 0 + 7. 2-Node-Denverton perf dnv skx 1 1 1 0 .5 0 0 1 0 0 0 0 0 0 0 + 8. 2-Node-IxiaPS1L47 tcp skx ps1 1 1 1 0 1 1 0 0 0 0 0 0 0 0 0 + 9. 2-Node-Cascadelake perf clx clx 3 3 3 0 0 0 0 0 0 0 0 6 0 0 0 +10. 2-Node-ThunderX2 perf tx2 skx 1 1 .5 0 .5 0 0 0 1 0 0 0 0 0 0 +11. 2-Node-Icelake perf icx icx 4 4 4 0 0 0 0 0 0 0 0 0 0 8 0 +12. 3-Node-Skylake perf skx skx 2 4 2 0 6 0 0 0 0 0 0 0 0 0 0 +13. 3-Node-Rangeley perf rng skx 1 3 1 0 0 0 2 0 0 0 0 0 0 0 0 +14. 3-Node-Taishan perf tsh skx 1 2 .5 0 .5 0 0 0 0 2 0 0 0 0 0 +15. 3-Node-Altra perf alt icx 1 2 1 0 0 0 0 0 0 0 2 0 0 1 0 +16. 3-Node-Denverton perf dnv skx 1 2 1 0 .5 0 0 2 0 0 0 0 0 0 0 +17. 2-Node-Zen2 perf zn2 zn2 1 1 1 0 0 0 0 0 0 0 0 0 2 0 0 +18. 3-Node-Icelake perf icx icx 2 4 2 0 0 0 0 0 0 0 0 0 0 6 0 +19. 3-Node-SnowRidge perf snr icx 1 2 .5 0 0 0 0 0 0 0 0 0 0 .5 2 + Totals: 34 44 21.5 4 17 1 2 3 3 2 4 7 2 15.5 2 ``` ### 1-Node-Skylake Xeon Intel (1n-skx) @@ -208,6 +212,14 @@ TG (Server-Type-F3) connected in a 3-node circular topology ([Server Types](#server-types)). Used for FD.io performance tests. +### 3-Node-SnowRidge Atom Intel (3n-snr) + +Each 3-Node-SnowRidge testbed includes two SUTs (Server-Type-G1) and one +TG (Server-Type-F4) connected in a 3-node circular topology +([Server Types](#server-types)). +Used for FD.io performance tests. + + ## Server Management ### Requirements @@ -266,16 +278,17 @@ Name | Comment 10.30.50.13 | LF Reserved 10.30.50.14 | LF Reserved 10.30.50.15 | LF Reserved -10.30.50.22 | s42-nomad -10.30.50.24 | s43-nomad -10.30.50.25 | s44-nomad -10.30.50.26 | s45-nomad -10.30.50.28 | s41-nomad -10.30.50.29 | s39-nomad -10.30.51.29 | s22-t35-sut1 screen -r /dev/ttyusb0 -10.30.50.30 | s40-nomad -10.30.51.30 | s23-t35-sut2 screen -r /dev/ttyusb1 -10.30.51.30 | s24-t35-sut3 screen -r /dev/ttyusb2 +10.30.50.16 | s16-nomad +10.30.50.17 | s17-nomad +10.30.50.18 | s18-nomad +10.30.50.19 | s19-nomad +10.30.50.20 | s20-nomad +10.30.50.21 | s21-nomad +10.30.50.22 | s22-nomad +10.30.50.23 | s23-nomad +10.30.50.24 | s24-nomad +10.30.50.25 | s25-nomad +10.30.50.26 | s26-nomad 10.30.50.36 | s17-t33-sut1 10.30.50.37 | s18-t33-sut2 10.30.50.38 | fdio-marvell-dev @@ -309,25 +322,27 @@ Name | Comment 10.30.50.71 | s56-t14-sut1 10.30.50.72 | s62-t34-sut1 10.30.50.73 | s63-t34-sut2 -10.30.50.74 | s64-t34t36-tg1 +10.30.50.74 | s64-t34-tg1 10.30.50.75 | s65-t37-sut1 10.30.50.76 | s66-t37-sut2 10.30.50.77 | s67-t37-tg1 -10.30.50.78 | s68-t38-sut1 -10.30.50.79 | s69-t38-sut2 -10.30.50.80 | s70-t38-tg1 +10.30.50.78 | s78-t38-sut1 +10.30.50.79 | s79-t38-sut2 +10.30.50.80 | s80-t38-tg1 10.30.50.81 | s71-t212-sut1 10.30.50.82 | s72-t212-tg1 -10.30.50.83 | s73-t213-sut1 -10.30.50.84 | s74-t213-tg1 -10.30.50.85 | s75-t214-sut1 -10.30.50.86 | s76-t214-tg1 -10.30.50.87 | s77-t215-sut1 -10.30.50.88 | s78-t215-tg1 -10.30.50.89 | s79-t39t310-tg1 -10.30.50.90 | s80-t311t312-tg1 +10.30.50.83 | s83-t213-sut1 +10.30.50.84 | s84-t213-tg1 +10.30.50.85 | s85-t214-sut1 +10.30.50.86 | s86-t214-tg1 +10.30.50.87 | s87-t215-sut1 +10.30.50.88 | s88-t215-tg1 +10.30.50.89 | s89-t39t310-tg1 +10.30.50.90 | s90-t311t312-tg1 10.30.50.91 | s58-nomad 10.30.50.92 | s59-nomad +10.30.50.93 | s93-t39-sut1 +10.30.50.94 | s94-t39-sut2 10.30.50.255 | Broadcast 10.30.55.0 | network 10.30.55.1 | Router @@ -335,10 +350,6 @@ Name | Comment 10.30.55.11 | s29-t26-sut1 10.30.55.12 | s30-t35-sut1 10.30.55.13 | s31-t35-sut2 -10.30.55.14 | s46-nomad -10.30.55.15 | s47-nomad -10.30.55.16 | s48-nomad -10.30.55.17 | s57-nomad 10.30.55.18 | s33-t27-sut1 10.30.55.19 | s34-t27-tg1 10.30.55.20 | s35-t28-sut1 @@ -363,13 +374,17 @@ Name | Comment 10.30.51.7 | LF Reserved 10.30.51.8 | LF Reserved 10.30.51.15 | LF Reserved -10.30.51.22 | s42-nomad -10.30.51.24 | s43-nomad -10.30.51.25 | s44-nomad -10.30.51.26 | s45-nomad -10.30.51.28 | s41-nomad -10.30.51.29 | s39-nomad -10.30.51.30 | s40-nomad +10.30.51.16 | s16-nomad +10.30.51.17 | s17-nomad +10.30.51.18 | s18-nomad +10.30.51.19 | s19-nomad +10.30.51.20 | s20-nomad +10.30.51.21 | s21-nomad +10.30.51.22 | s22-nomad +10.30.51.23 | s23-nomad +10.30.51.24 | s24-nomad +10.30.51.25 | s25-nomad +10.30.51.26 | s26-nomad 10.30.51.36 | s17-t33-sut1 10.30.51.37 | s18-t33-sut2 10.30.51.38 | fdio-marvell-dev @@ -403,25 +418,27 @@ Name | Comment 10.30.51.71 | s56-t14-sut1 10.30.51.72 | s62-t34-sut1 10.30.51.73 | s63-t34-sut2 -10.30.51.74 | s64-t34t36-tg1 +10.30.51.74 | s64-t34-tg1 10.30.51.75 | s65-t37-sut1 10.30.51.76 | s66-t37-sut2 10.30.51.77 | s67-t37-tg1 -10.30.51.78 | s68-t38-sut1 -10.30.51.79 | s69-t38-sut2 -10.30.51.80 | s70-t38-tg1 +10.30.51.78 | s78-t38-sut1 +10.30.51.79 | s79-t38-sut2 +10.30.51.80 | s80-t38-tg1 10.30.51.81 | s71-t212-sut1 10.30.51.82 | s72-t212-tg1 -10.30.51.83 | s73-t213-sut1 -10.30.51.84 | s74-t213-tg1 -10.30.51.85 | s75-t214-sut1 -10.30.51.86 | s76-t214-tg1 -10.30.51.87 | s77-t215-sut1 -10.30.51.88 | s78-t215-tg1 -10.30.51.89 | s79-t39t310-tg1 -10.30.51.90 | s80-t311t312-tg1 +10.30.51.83 | s83-t213-sut1 +10.30.51.84 | s84-t213-tg1 +10.30.51.85 | s85-t214-sut1 +10.30.51.86 | s86-t214-tg1 +10.30.51.87 | s87-t215-sut1 +10.30.51.88 | s88-t215-tg1 +10.30.51.89 | s89-t39t310-tg1 +10.30.51.90 | s90-t311t312-tg1 10.30.51.91 | s58-nomad 10.30.51.92 | s59-nomad +10.30.51.93 | s93-t39-sut1 +10.30.51.94 | s94-t39-sut2 10.30.51.255 | Broadcast 10.32.8.0 | network 10.32.8.1 | Router @@ -429,10 +446,6 @@ Name | Comment 10.32.8.11 | s29-t26-sut1 10.32.8.12 | s30-t35-sut1 10.32.8.13 | s31-t35-sut2 -10.32.8.14 | s46-nomad -10.32.8.15 | s47-nomad -10.32.8.16 | s48-nomad -10.32.8.17 | s57-nomad 10.32.8.18 | s33-t27-sut1 10.32.8.19 | s34-t27-tg1 10.32.8.20 | s35-t28-sut1 @@ -668,7 +681,7 @@ FD.io CSIT lab contains following server types: - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel. - PCIe Slot9 5e:00.xx: ConnectX5-2p100GE Mellanox. - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. + - PCIe Slot6 86:00.xx: e810-2p100GE Intel. - PCIe Slot8 af:00.xx: empty. - PCIe Slot10 d8:00.xx: empty. 13. Server-Type-C3: Purpose - Cascadelake Xeon TG for FD.io performance testing. @@ -688,13 +701,13 @@ FD.io CSIT lab contains following server types: - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel. - PCIe Slot9 5e:00.xx: ConnectX5-2p100GE Mellanox. - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. + - PCIe Slot6 86:00.xx: ConnectX5-2p100GE Mellanox. + - PCIe Slot8 af:00.xx: ConnectX5-2p100GE Mellanox. - PCIe Slot10 d8:00.xx: empty. 14. Server-Type-C4: Purpose - Cascadelake Xeon Backend hosts for FD.io builds and data processing. - Quantity: 3. - Physical connectivity: - - CIMC and host management ports. + - IPMI and host management ports. - no NIC ports, standalone setup. - Main HW configuration: - Chassis: SuperMicro 1029P-WTRT. @@ -781,28 +794,38 @@ FD.io CSIT lab contains following server types: - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25 - NICs configuration: - Numa0: - - PCIe Slot6 08:00.xx: XL710-QDA2-2p40GE Intel. + - no cards - Numa1: - PCIe Slot18 91:00.xx: XL710-QDA2-2p40GE Intel. 20. Server-Type-E23: Purpose - Altra Arm Ampere SUT for FD.io performance testing. - - Quantity: 1 + - Quantity: 2 - Physical connectivity: - IPMI and host management ports. - NIC ports connected into 3-node topologies. - Main HW configuration: - - Chassis: TBD - - Motherboard: TBD - - Processors: n* TBD - - RAM Memory: n* TBD - - Disks: TBD + - Chassis: WIWYNN Mt.Jade Server System B81.030Z1.0007 2U + - Motherboard: Mt.Jade Motherboard + - Processors: 2* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) + - Processor Signature: Implementor 0x41, Variant 0x3, Architecture 15, Part 0xd0c, Revision 1 + - RAM Memory: 16* 8GB DDR4-3200MT/s + - Disks: 2* 960GB SSD Samsung M.2 NVMe PM983 - NICs configuration: - Numa0: - - PCIe Slotn xx:xx.xx: XL710-QDA2-2p40GE Intel. - - PCIe Slotk xx:xx.xx: mcx556a-edat ConnectX5-2p100GE Mellanox. + - PCIe Slot1 0004:04:00.x: xl710-QDA2-2p40GE Intel. - Numa1: - - PCIe Slotn xx:xx.xx: XL710-QDA2-2p40GE Intel. - - PCIe Slotk xx:xx.xx: mcx556a-edat ConnectX5-2p100GE Mellanox. -21. Server-Type-E31: Purpose - Skylake Xeon TG for FD.io performance testing. + - no cards. +21. Server-Type-E24 : Purpose - Altra Arm Ampere for FD.io build. + - Quantity: 2. + - Physical connectivity: + - IPMI and host management ports. + - Main HW configuration: + - Chassis: Gigabyte R152-P30-00 1U + - Motherboard: MP32-AR1-00 + - Processors: 1* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) + - Processor Signature: Implementor 0x0a, Variant 0x1, Architecture 6, Part 0x000, Revision 1 + - RAM Memory: 12* 16GB DDR4-3200MT/s + - Disks: 1* 960GB SSD Samsung M.2 NVMe PM983 +22. Server-Type-E31: Purpose - Skylake Xeon TG for FD.io performance testing. - Quantity: 1 - Physical connectivity: - IPMI and host management ports. @@ -822,7 +845,7 @@ FD.io CSIT lab contains following server types: - PCIe Slot6 86:00.xx: empty. - PCIe Slot8 af:00.xx: XL710-QDA2-2p40GE Intel. - PCIe Slot10 d8:00.xx: x710-4p10GE Intel. -22. Server-Type-F1: Purpose - Icelake Xeon SUT for FD.io performance testing. +23. Server-Type-F1: Purpose - Icelake Xeon SUT for FD.io performance testing. - Quantity: 8. - Physical connectivity: - IPMI and host management ports. @@ -842,7 +865,7 @@ FD.io CSIT lab contains following server types: - PCIe Slot6 86:00.xx: empty. - PCIe Slot8 af:00.xx: empty. - PCIe Slot10 d8:00.xx: empty. -23. Server-Type-F2: Purpose - Icelake Xeon TG for FD.io performance testing. +24. Server-Type-F2: Purpose - Icelake Xeon TG for FD.io performance testing. - Quantity: 3. - Physical connectivity: - IPMI and host management ports. @@ -862,7 +885,7 @@ FD.io CSIT lab contains following server types: - PCIe Slot6 86:00.xx: e810-2CQDA2-2p100GE Intel. - PCIe Slot8 af:00.xx: empty. - PCIe Slot10 d8:00.xx: empty. -24. Server-Type-F3: Purpose - Icelake Xeon TG for FD.io performance testing. +25. Server-Type-F3: Purpose - Icelake Xeon TG for FD.io performance testing. - Quantity: 3. - Physical connectivity: - IPMI and host management ports. @@ -882,7 +905,7 @@ FD.io CSIT lab contains following server types: - PCIe Slot6 86:00.xx: empty. - PCIe Slot8 af:00.xx: empty. - PCIe Slot10 d8:00.xx: empty. -25. Server-Type-F4: Purpose - Icelake Xeon Shared TG for FD.io performance testing. +26. Server-Type-F4: Purpose - Icelake Xeon Shared TG for FD.io performance testing. - Quantity: 3. - Physical connectivity: - IPMI and host management ports. @@ -902,16 +925,20 @@ FD.io CSIT lab contains following server types: - PCIe Slot6 86:00.xx: e810-XXVDA4-4p25GE Intel. - PCIe Slot8 af:00.xx: e810-2CQDA2-2p100GE Intel. - PCIe Slot10 d8:00.xx: empty. -26. Server-Type-E24 : Purpose - Altra Arm Ampere for FD.io build. - - Quantity: 2. +27. Server-Type-G1: Purpose - SnowRidge Atom SUT for FD.io performance testing. + - Quantity: 2 - Physical connectivity: - IPMI and host management ports. + - NIC ports connected into 3-node testbed topology. - Main HW configuration: - - Chassis: Gigabyte R152-P30-00 1U - - Motherboard: MP32-AR1-00 - - Processors: 1* Ampere(R) Altra(R) Processor (Neoverse N1) - - RAM Memory: 4* 16GB RDIMM-3200MHz - - Disks: 1* 960GB SSD Samsung M.2 NVMe PM983 + - Chassis: Intel JACOBSVILLE SDP. + - Motherboard: Intel JACOBSVILLE E63448-400. + - Processors: 1* Intel Atom P5362B 2.2 GHz. + - RAM Memory: 2* 16GB DDR4-2933. + - Disks: ?* ? SATA SSD. + - NICs configuration: + - Numa0: (x16, PCIe3.0 lane) + - PCIe BuiltIn ec:00.xx: e810-XXVDA4-4p25GE Intel. ``` ### Naming Convention @@ -1232,8 +1259,10 @@ Note: ServerB28 (TG) is shared between testbed26 & testbed35 - s34-t27-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - s34-t27-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - s34-t27-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s34-t27-tg1-c6/p1 - 100GE-port1 e810-2p100GE. - - s34-t27-tg1-c6/p2 - 100GE-port2 e810-2p100GE. + - s34-t27-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE. + - s34-t27-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE. + - s38-t27-tg1-c8/p1 - 100GE-port1 ConnectX5-2p100GE. + - s38-t27-tg1-c8/p2 - 100GE-port2 ConnectX5-2p100GE. - s34-t27-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - s34-t27-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. - SUT [Server-Type-C2]: @@ -1264,8 +1293,10 @@ Note: ServerB28 (TG) is shared between testbed26 & testbed35 - s36-t28-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - s36-t28-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - s36-t28-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s36-t28-tg1-c6/p1 - 100GE-port1 e810-2p100GE. - - s36-t28-tg1-c6/p2 - 100GE-port2 e810-2p100GE. + - s36-t28-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE. + - s36-t28-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE. + - s38-t28-tg1-c8/p1 - 100GE-port1 ConnectX5-2p100GE. + - s38-t28-tg1-c8/p2 - 100GE-port2 ConnectX5-2p100GE. - s36-t28-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - s36-t28-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. - SUT [Server-Type-C2]: @@ -1296,8 +1327,8 @@ Note: ServerB28 (TG) is shared between testbed26 & testbed35 - s38-t29-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - s38-t29-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - s38-t29-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s38-t29-tg1-c6/p1 - 100GE-port1 e810-2p100GE. - - s38-t29-tg1-c6/p2 - 100GE-port2 e810-2p100GE. + - s38-t29-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE. + - s38-t29-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE. - s38-t29-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - s38-t29-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. ``` @@ -1346,8 +1377,6 @@ Note: Server19 (TG) is shared between testbed33 & testbed211 - IPMI IP: 10.30.50.69 - Host IP: 10.30.51.69 - portnames: - - s27-t211-sut1-c6/p1 - 40GE-port1 XL710-QDA2-2p40GE. - - s27-t211-sut1-c6/p2 - 40GE-port2 XL710-QDA2-2p40GE. - s27-t211-sut1-c18/p1 - 40GE-port1 XL710-QDA2-2p40GE. - s27-t211-sut1-c18/p2 - 40GE-port2 XL710-QDA2-2p40GE. - TG [Server-Type-E31]: @@ -1370,7 +1399,7 @@ Note: Server19 (TG) is shared between testbed33 & testbed211 - s19-t33t211-tg1-c10/p4 - 10GE-port4 x710-4p10GE. ``` -#### 2-Node-Icelake Servers (2n-icx) TBD +#### 2-Node-Icelake Servers (2n-icx) PROD ``` - SUT [Server-Type-F1]: @@ -1405,94 +1434,94 @@ Note: Server19 (TG) is shared between testbed33 & testbed211 - s72-t212-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - SUT [Server-Type-F1]: - testbedname: testbed213. - - hostname: s73-t213-sut1. + - hostname: s83-t213-sut1. - IPMI IP: 10.30.51.83 - Host IP: 10.30.50.83 - portnames: - - s73-t213-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s73-t213-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s73-t213-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s73-t213-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s73-t213-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s73-t213-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s73-t213-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s73-t213-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s83-t213-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s83-t213-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s83-t213-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s83-t213-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s83-t213-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s83-t213-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s83-t213-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s83-t213-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - TG [Server-Type-F2]: - testbedname: testbed213. - - hostname: s74-t213-tg1. + - hostname: s84-t213-tg1. - IPMI IP: 10.30.51.84 - Host IP: 10.30.50.84 - portnames: - - s74-t213-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s74-t213-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s74-t213-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s74-t213-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s74-t213-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s74-t213-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s74-t213-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s74-t213-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s74-t213-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s74-t213-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s84-t213-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s84-t213-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s84-t213-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s84-t213-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s84-t213-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s84-t213-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s84-t213-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s84-t213-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s84-t213-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s84-t213-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - SUT [Server-Type-F1]: - testbedname: testbed214. - - hostname: s75-t214-sut1. + - hostname: s85-t214-sut1. - IPMI IP: 10.30.51.85 - Host IP: 10.30.50.85 - portnames: - - s75-t214-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s75-t214-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s75-t214-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s75-t214-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s75-t214-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s75-t214-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s75-t214-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s75-t214-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s85-t214-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s85-t214-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s85-t214-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s85-t214-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s85-t214-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s85-t214-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s85-t214-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s85-t214-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - TG [Server-Type-F2]: - testbedname: testbed214. - - hostname: s76-t214-tg1. + - hostname: s86-t214-tg1. - IPMI IP: 10.30.51.86 - Host IP: 10.30.50.86 - portnames: - - s76-t214-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s76-t214-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s76-t214-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s76-t214-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s76-t214-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s76-t214-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s76-t214-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s76-t214-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s76-t214-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s76-t214-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s86-t214-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s86-t214-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s86-t214-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s86-t214-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s86-t214-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s86-t214-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s86-t214-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s86-t214-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s86-t214-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s86-t214-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - SUT [Server-Type-F1]: - testbedname: testbed215. - - hostname: s77-t215-sut1. + - hostname: s87-t215-sut1. - IPMI IP: 10.30.51.87 - Host IP: 10.30.50.87 - portnames: - - s77-t215-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s77-t215-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s77-t215-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s77-t215-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s77-t215-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s77-t215-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s77-t215-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s77-t215-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s87-t215-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s87-t215-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s87-t215-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s87-t215-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s87-t215-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s87-t215-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s87-t215-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s87-t215-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - TG [Server-Type-F2]: - testbedname: testbed215. - - hostname: s78-t215-tg1. + - hostname: s88-t215-tg1. - IPMI IP: 10.30.51.88 - Host IP: 10.30.50.88 - portnames: - - s78-t215-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s78-t215-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s78-t215-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s78-t215-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s78-t215-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s78-t215-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s78-t215-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s78-t215-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s78-t215-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s78-t215-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s88-t215-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s88-t215-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s88-t215-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s88-t215-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s88-t215-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s88-t215-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s88-t215-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s88-t215-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s88-t215-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s88-t215-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. ``` #### 3-Node-Skylake Servers (3n-skx) PROD @@ -1659,9 +1688,7 @@ Note: Server19 (TG) is shared between testbed33 & testbed211 - s19-t33t211-tg1-c10/p4 - 10GE-port4 x710-4p10GE. ``` -#### 3-Node-Altra Servers (3n-alt) TBD - -Note: Server64 (TG) is shared between testbed34 & testbed36 +#### 3-Node-Altra Servers (3n-alt) PROD ``` - SUT [Server-Type-E23]: @@ -1670,28 +1697,32 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - IPMI IP: 10.30.50.72 - Host IP: 10.30.51.72 - portnames: - - s62-t34-sut1-cn/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s62-t34-sut1-cn/p2 - 40GE-port2 xl710-QDA2-2p40GE. - - s62-t34-sut1-ck/p1 - 100GE-port1 ConnectX5-2p100GE. - - s62-t34-sut1-ck/p2 - 100GE-port1 ConnectX5-2p100GE. + - s62-t34-sut1-c1/p1 - 40GE-port1 xl710-QDA2-2p40GE. + - s62-t34-sut1-c1/p2 - 40GE-port2 xl710-QDA2-2p40GE. - SUT [Server-Type-E23]: - testbedname: testbed34. - hostname: s63-t34-sut2. - IPMI IP: 10.30.50.73 - Host IP: 10.30.51.73 - portnames: - - s63-t34-sut2-cn/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s63-t34-sut2-cn/p2 - 40GE-port2 xl710-QDA2-2p40GE. - - s63-t34-sut2-ck/p1 - 100GE-port1 ConnectX5-2p100GE. - - s63-t34-sut2-ck/p2 - 100GE-port1 ConnectX5-2p100GE. + - s63-t34-sut2-c1/p1 - 40GE-port1 xl710-QDA2-2p40GE. + - s63-t34-sut2-c1/p2 - 40GE-port2 xl710-QDA2-2p40GE. - TG [Server-Type-F4]: - testbedname: testbed34. - - hostname: s64-t34t36-tg1. + - hostname: s64-t34-tg1. - IPMI IP: 10.30.50.74 - Host IP: 10.30.51.74 - portnames: - - s64-t34-tg1-c1/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s64-t34-tg1-c1/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s64-t34-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s64-t34-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s64-t34-tg1-c4/p1 - 40GE-port1 xl710-QDA2-2p40GE. + - s64-t34-tg1-c4/p2 - 40GE-port2 xl710-QDA2-2p40GE. + - s64-t34-tg1-c6/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s64-t34-tg1-c6/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s64-t34-tg1-c6/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s64-t34-tg1-c6/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s64-t34-tg1-c8/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s64-t34-tg1-c8/p2 - 100GE-port2 e810-2CQDA2-2p100GE. ``` #### 3-Node-Denverton Servers (3n-dnv) PROD @@ -1719,7 +1750,7 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - s31-t35-sut2-p4 - 10GE-port4 x553 fiber port. ``` -#### 3-Node-Icelake Servers (3n-icx) TBD +#### 3-Node-Icelake Servers (3n-icx) PROD ``` - ServerF1 [Server-Type-F1]: @@ -1766,46 +1797,81 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - s67-t37-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - ServerF1 [Server-Type-F1]: - testbedname: testbed38. - - hostname: s68-t38-sut1. + - hostname: s78-t38-sut1. - IPMI IP: 10.30.50.78 - Host IP: 10.30.51.78 - portnames: - - s68-t38-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s68-t38-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s68-t38-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s68-t38-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s68-t38-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s68-t38-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s68-t38-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s68-t38-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s78-t38-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s78-t38-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s78-t38-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s78-t38-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s78-t38-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s78-t38-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s78-t38-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s78-t38-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - ServerF1 [Server-Type-F1]: - testbedname: testbed38. - - hostname: s69-t38-sut2. + - hostname: s79-t38-sut2. - IPMI IP: 10.30.50.79 - Host IP: 10.30.51.79 - portnames: - - s69-t38-sut2-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s69-t38-sut2-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s69-t38-sut2-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s69-t38-sut2-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s69-t38-sut2-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s69-t38-sut2-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s69-t38-sut2-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s69-t38-sut2-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s79-t38-sut2-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s79-t38-sut2-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s79-t38-sut2-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s79-t38-sut2-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s79-t38-sut2-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s79-t38-sut2-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s79-t38-sut2-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s79-t38-sut2-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - ServerF3 [Server-Type-F3]: - testbedname: testbed38. - - hostname: s70-t38-tg1. + - hostname: s80-t38-tg1. - IPMI IP: 10.30.50.80 - Host IP: 10.30.51.80 - portnames: - - s70-t38-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s70-t38-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s70-t38-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s70-t38-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s70-t38-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s70-t38-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s70-t38-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s70-t38-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. + - s80-t38-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. + - s80-t38-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. + - s80-t38-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s80-t38-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s80-t38-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s80-t38-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. + - s80-t38-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. + - s80-t38-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. +``` + +#### 3-Node-SnowRidge Servers (3n-snr) PROD + +``` +- ServerG1 [Server-Type-G1]: + - testbedname: testbed39. + - hostname: s93-t39-sut1. + - IPMI IP: 10.30.50.93 + - Host IP: 10.30.51.93 + - portnames: + - s93-t39-sut1-c1/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s93-t39-sut1-c1/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s93-t39-sut1-c1/p2 - 25GE-port3 e810-XXVDA4-4p25GE. + - s93-t39-sut1-c1/p2 - 25GE-port4 e810-XXVDA4-4p25GE. +- ServerG1 [Server-Type-G1]: + - testbedname: testbed39. + - hostname: s94-t39-sut2. + - IPMI IP: 10.30.50.94 + - Host IP: 10.30.51.94 + - portnames: + - s94-t39-sut2-c1/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s94-t39-sut2-c1/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s94-t39-sut2-c1/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s94-t39-sut2-c1/p4 - 25GE-port4 e810-XXVDA4-4p25GE. +- ServerF4 [Server-Type-F4]: + - testbedname: testbed39. + - hostname: s89-t39t310-tg1. + - IPMI IP: 10.30.50.89 + - Host IP: 10.30.51.89 + - portnames: + - s89-t39t310-tg1-c6/p1 - 25GE-port1 e810-XXVDA4-4p25GE. + - s89-t39t310-tg1-c6/p2 - 25GE-port2 e810-XXVDA4-4p25GE. + - s89-t39t310-tg1-c6/p3 - 25GE-port3 e810-XXVDA4-4p25GE. + - s89-t39t310-tg1-c6/p4 - 25GE-port4 e810-XXVDA4-4p25GE. ``` ### Per Testbed Wiring @@ -1964,9 +2030,12 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - ring4 100GE-ports ConnectX5-2p100GE on SUT: - s34-t27-tg1-c9/p1 to s33-t27-sut1-c9/p1. - s33-t27-sut1-c9/p2 to s34-t27-tg1-c9/p2. - - ring5 100GE-ports e810-2p100GE on SUT: + - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG: - s34-t27-tg1-c6/p1 to s33-t27-sut1-c6/p1. - s33-t27-sut1-c6/p2 to s34-t27-tg1-c6/p2. + - ring6 100GE-ports e810-2p100GE on TG: + - s34-t27-tg1-c8/p1 to s34-t27-tg1-c8/p2. + - s34-t27-tg1-c8/p2 to s34-t27-tg1-c8/p1. - testbed28: - ring1 10GE-ports x710-4p10GE on SUT: - s36-t28-tg1-c2/p1 to s35-t28-sut1-c2/p1. @@ -1980,9 +2049,12 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - ring4 100GE-ports ConnectX5-2p100GE on SUT: - s36-t28-tg1-c9/p1 to s35-t28-sut1-c9/p1. - s35-t28-sut1-c9/p2 to s36-t28-tg1-c9/p2. - - ring5 100GE-ports e810-2p100GE on SUT: + - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG: - s36-t28-tg1-c6/p1 to s35-t28-sut1-c6/p1. - s35-t28-sut1-c6/p2 to s36-t28-tg1-c6/p2. + - ring6 100GE-ports e810-2p100GE on TG: + - s36-t28-tg1-c8/p1 to s36-t28-tg1-c8/p2. + - s36-t28-tg1-c8/p2 to s36-t28-tg1-c8/p1. - testbed29: - ring1 10GE-ports x710-4p10GE on SUT: - s38-t29-tg1-c2/p1 to s37-t29-sut1-c2/p1. @@ -1996,7 +2068,7 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - ring4 100GE-ports ConnectX5-2p100GE on SUT: - s38-t29-tg1-c9/p1 to s37-t29-sut1-c9/p1. - s37-t29-sut1-c9/p2 to s38-t29-tg1-c9/p2. - - ring6 100GE-ports e810-2p100GE on SUT: + - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG: - s38-t29-tg1-c6/p1 to s37-t29-sut1-c6/p1. - s37-t29-sut1-c6/p2 to s38-t29-tg1-c6/p2. ``` @@ -2028,7 +2100,7 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - s27-t211-sut1-c18/p2 - s19-t33t211-tg1-c8/p2. ``` -#### 2-Node-Icelake Wiring (2n-icx) TBD +#### 2-Node-Icelake Wiring (2n-icx) PROD ``` - testbed212: @@ -2048,49 +2120,49 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - s72-t212-tg1-c6/p2 to s72-t212-tg1-c6/p1. - testbed213: - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s74-t213-tg1-c2/p1 to s73-t213-sut1-c2/p1. - - s73-t213-sut1-c2/p2 to s74-t213-tg1-c2/p2. + - s84-t213-tg1-c2/p1 to s83-t213-sut1-c2/p1. + - s83-t213-sut1-c2/p2 to s84-t213-tg1-c2/p2. - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s74-t213-tg1-c4/p1 to s73-t213-sut1-c4/p1. - - s73-t213-sut1-c4/p2 to s74-t213-tg1-c4/p2. - - s74-t213-tg1-c4/p3 to s73-t213-sut1-c4/p3. - - s73-t213-sut1-c4/p4 to s74-t213-tg1-c4/p4. + - s84-t213-tg1-c4/p1 to s83-t213-sut1-c4/p1. + - s83-t213-sut1-c4/p2 to s84-t213-tg1-c4/p2. + - s84-t213-tg1-c4/p3 to s83-t213-sut1-c4/p3. + - s83-t213-sut1-c4/p4 to s84-t213-tg1-c4/p4. - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s74-t213-tg1-c9/p1 to s73-t213-sut1-c9/p1. - - s73-t213-sut1-c9/p2 to s74-t213-tg1-c9/p2. + - s84-t213-tg1-c9/p1 to s83-t213-sut1-c9/p1. + - s83-t213-sut1-c9/p2 to s84-t213-tg1-c9/p2. - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s74-t213-tg1-c6/p1 to s74-t213-tg1-c6/p2. - - s74-t213-tg1-c6/p2 to s74-t213-tg1-c6/p1. + - s84-t213-tg1-c6/p1 to s84-t213-tg1-c6/p2. + - s84-t213-tg1-c6/p2 to s84-t213-tg1-c6/p1. - testbed214: - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s76-t214-tg1-c2/p1 to s75-t214-sut1-c2/p1. - - s75-t214-sut1-c2/p2 to s76-t214-tg1-c2/p2. + - s86-t214-tg1-c2/p1 to s85-t214-sut1-c2/p1. + - s85-t214-sut1-c2/p2 to s86-t214-tg1-c2/p2. - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s76-t214-tg1-c4/p1 to s75-t214-sut1-c4/p1. - - s75-t214-sut1-c4/p2 to s76-t214-tg1-c4/p2. - - s76-t214-tg1-c4/p3 to s75-t214-sut1-c4/p3. - - s75-t214-sut1-c4/p4 to s76-t214-tg1-c4/p4. + - s86-t214-tg1-c4/p1 to s85-t214-sut1-c4/p1. + - s85-t214-sut1-c4/p2 to s86-t214-tg1-c4/p2. + - s86-t214-tg1-c4/p3 to s85-t214-sut1-c4/p3. + - s85-t214-sut1-c4/p4 to s86-t214-tg1-c4/p4. - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s76-t214-tg1-c9/p1 to s75-t214-sut1-c9/p1. - - s75-t214-sut1-c9/p2 to s76-t214-tg1-c9/p2. + - s86-t214-tg1-c9/p1 to s85-t214-sut1-c9/p1. + - s85-t214-sut1-c9/p2 to s86-t214-tg1-c9/p2. - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s76-t214-tg1-c6/p1 to s76-t214-tg1-c6/p2. - - s76-t214-tg1-c6/p2 to s76-t214-tg1-c6/p1. + - s86-t214-tg1-c6/p1 to s86-t214-tg1-c6/p2. + - s86-t214-tg1-c6/p2 to s86-t214-tg1-c6/p1. - testbed215: - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s78-t215-tg1-c2/p1 to s77-t215-sut1-c2/p1. - - s77-t215-sut1-c2/p2 to s78-t215-tg1-c2/p2. + - s88-t215-tg1-c2/p1 to s87-t215-sut1-c2/p1. + - s87-t215-sut1-c2/p2 to s88-t215-tg1-c2/p2. - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s78-t215-tg1-c4/p1 to s77-t215-sut1-c4/p1. - - s77-t215-sut1-c4/p2 to s78-t215-tg1-c4/p2. - - s78-t215-tg1-c4/p3 to s77-t215-sut1-c4/p3. - - s77-t215-sut1-c4/p4 to s78-t215-tg1-c4/p4. + - s88-t215-tg1-c4/p1 to s87-t215-sut1-c4/p1. + - s87-t215-sut1-c4/p2 to s88-t215-tg1-c4/p2. + - s88-t215-tg1-c4/p3 to s87-t215-sut1-c4/p3. + - s87-t215-sut1-c4/p4 to s88-t215-tg1-c4/p4. - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s78-t215-tg1-c9/p1 to s77-t215-sut1-c9/p1. - - s77-t215-sut1-c9/p2 to s78-t215-tg1-c9/p2. + - s88-t215-tg1-c9/p1 to s87-t215-sut1-c9/p1. + - s87-t215-sut1-c9/p2 to s88-t215-tg1-c9/p2. - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s78-t215-tg1-c6/p1 to s78-t215-tg1-c6/p2. - - s78-t215-tg1-c6/p2 to s78-t215-tg1-c6/p1. + - s88-t215-tg1-c6/p1 to s88-t215-tg1-c6/p2. + - s88-t215-tg1-c6/p2 to s88-t215-tg1-c6/p1. ``` #### 3-Node-Skylake Wiring (3n-skx) PROD @@ -2138,7 +2210,7 @@ Note: Server64 (TG) is shared between testbed34 & testbed36 - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4. ``` -#### 3-Node-Rangeley Wiring (3n-rng) TODO +#### 3-Node-Rangeley Wiring (3n-rng) VERIFY ``` To be completed. @@ -2158,18 +2230,14 @@ To be completed. - s18-t33-sut2-c4/p1 - s19-t33t211-tg1-c4/p1. ``` -#### 3-Node-Altra Wiring (3n-alt) TBD +#### 3-Node-Altra Wiring (3n-alt) PROD ``` - testbed34: - ring1 40GE-ports xl710-QDA2-2p40GE on SUTs: - - s64-t34-tg1-cn/p2 - s62-t34-sut1-cn/p2. - - s62-t34-sut1-cn/p1 - s63-t34-sut2-cn/p2. - - s63-t34-sut2-cn/p1 - s64-t34-tg1-cn/p1. - - ring2 100GE-ports ConnectX5-2p100GE on SUTs: - - s64-t34-tg1-ck/p2 - s62-t34-sut1-ck/p2. - - s62-t34-sut1-ck/p1 - s63-t34-sut2-ckp2. - - s63-t34-sut2-ck/p1 - s64-t34-tg1-ck/p1. + - s64-t34-tg1-c4/p1 - s62-t34-sut1-c1/p2. + - s62-t34-sut1-c1/p1 - s63-t34-sut2-c1/p2. + - s63-t34-sut2-c1/p1 - s64-t34-tg1-c4/p2. ``` #### 3-Node-Denverton Wiring (3n-dnv) PROD @@ -2207,20 +2275,33 @@ To be completed. - s66-t37-sut2-c9/p1 to s67-t37-tg1-c9/p2. - testbed38: - ring1 25GE-ports xxv710-DA2-2p25GE on SUTs: - - s70-t38-tg1-c2/p1 to s68-t38-sut1-c2/p1. - - s68-t38-sut1-c2/p2 to s69-t38-sut2-c2/p2. - - s69-t38-sut2-c2/p1 to s70-t38-tg1-c2/p2. + - s80-t38-tg1-c2/p1 to s78-t38-sut1-c2/p1. + - s78-t38-sut1-c2/p2 to s79-t38-sut2-c2/p2. + - s79-t38-sut2-c2/p1 to s80-t38-tg1-c2/p2. - ring2 25GE-ports e810-XXVDA4-4p25GE on SUT: - - s70-t38-tg1-c4/p1 to s68-t38-sut1-c4/p1. - - s68-t38-sut1-c4/p2 to s69-t38-sut2-c4/p2. - - s69-t38-sut2-c4/p1 to s70-t38-tg1-c4/p2. - - s70-t38-tg1-c4/p3 to s68-t38-sut1-c4/p3. - - s68-t38-sut1-c4/p4 to s69-t38-sut2-c4/p4. - - s69-t38-sut2-c4/p3 to s70-t38-tg1-c4/p4. + - s80-t38-tg1-c4/p1 to s78-t38-sut1-c4/p1. + - s78-t38-sut1-c4/p2 to s79-t38-sut2-c4/p2. + - s79-t38-sut2-c4/p1 to s80-t38-tg1-c4/p2. + - s80-t38-tg1-c4/p3 to s78-t38-sut1-c4/p3. + - s78-t38-sut1-c4/p4 to s79-t38-sut2-c4/p4. + - s79-t38-sut2-c4/p3 to s80-t38-tg1-c4/p4. - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT - - s70-t38-tg1-c9/p1 to s68-t38-sut1-c9/p1. - - s68-t38-sut1-c9/p2 to s69-t38-sut2-c9/p2. - - s69-t38-sut2-c9/p1 to s70-t38-tg1-c9/p2. + - s80-t38-tg1-c9/p1 to s78-t38-sut1-c9/p1. + - s78-t38-sut1-c9/p2 to s79-t38-sut2-c9/p2. + - s79-t38-sut2-c9/p1 to s80-t38-tg1-c9/p2. +``` + +#### 3-Node-SnowRidge Wiring (3n-snr) PROD + +``` +- testbed39: + - ring1 25GE-ports e810-XXVDA4-4p25GE on SUTs and TG: + - s89-t39t310-tg1-c6/p1 to s93-t39-sut1-c1/p1. + - s93-t39-sut1-c1/p2 to s94-t39-sut2-c1/p2. + - s94-t39-sut2-c1/p1 to s89-t39t310-tg1-c6/p2. + - s89-t39t310-tg1-c6/p3 to s93-t39-sut1-c1/p3. + - s93-t39-sut1-c1/p4 to s94-t39-sut2-c1/p4. + - s94-t39-sut2-c1/p3 to s89-t39t310-tg1-c6/p4. ``` ## Inventory @@ -2259,11 +2340,20 @@ To be completed. - Processors: 2* hip07-d05 ~ 32* Arm Cortex-A72. - RAM Memory: 8* 16GB DDR4-2400MT/s. - Disks: 1* 4TB SATA HDD. - - 2 * Ampere Altra - - Chassis: TBD - - Processors: TBD - - RAM Memory: TBD - - Disks: TBD +2. Arm Neoverse N1 servers + - 2 * Ampere Altra (Performance) + - Chassis: WIWYNN Mt.Jade Server System B81.030Z1.0007 2U + - Processors: 2* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) + - Processor Signature: Implementor 0x41, Variant 0x3, Architecture 15, Part 0xd0c, Revision 1 + - RAM Memory: 16* 8GB DDR4-3200MT/s + - Disks: 2* 960GB SSD Samsung M.2 NVMe PM983 + - 2 * Ampere Altra (Build) + - Chassis: Gigabyte R152-P30-00 1U + - Motherboard: MP32-AR1-00 + - Processors: 1* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) + - Processor Signature: Implementor 0x0a, Variant 0x1, Architecture 6, Part 0x000, Revision 1 + - RAM Memory: 12* 16GB DDR4-3200MT/s + - Disks: 1* 960GB SSD Samsung M.2 NVMe PM983 ``` ### Xeon and Atom Servers @@ -2288,15 +2378,13 @@ To be completed. ``` 1. 10GE NICs - - 14 * Intel® Ethernet Converged Network Adapter X710-DA4 - - 6 * Intel® Ethernet Converged Network Adapter X710-DA2 - - 6 * Intel® Ethernet Converged Network Adapter X520-DA2 + - ? 2. 25GE NICs - - 12 * Intel® Ethernet Network Adapter XXV710-DA2 + - ? 3. 40GE NICs - - 2 * Intel® Ethernet Converged Network Adapter XL710-QDA2 + - ? 4. 100GE NICs - - 4 * mcx556a-edat NICs (not on site yet, in transit) + - ? ``` ### Pluggables and Cables @@ -2305,27 +2393,26 @@ Pluggables: ``` 1. 10GE SFP+ - - 16 * Intel E10GSFPSR Ethernet SFP+ SR Optics - - 80 * 10G SR optic (generic, "Intel" compatible branded) + - ? 2. 25GE SFP28 - - None + - ? 3. 40GE QSFP+ - - None + - ? 4. 100GE - - 8 * mcp1600-c002 qsfp28 pluggables and cables (not on site yet, in transit) + - ? ``` Standalone cables: ``` 1. 10GE - - None + - ? 2. 25GE - - None + - ? 3. 40GE QSFP+ - - 20 * Intel XLDACBL5 40G QSFP+ Passive DAC Cable + - ? 4. 100GE - - None + - ? ``` ### Other Parts