feat(infra): Onboard Mellanox I.
[csit.git] / docs / lab / testbed_specifications.md
index 30343aa..2c1cd38 100644 (file)
@@ -95,7 +95,8 @@ hosted by LFN FD.io CSIT project.
 15. 3-Node-Denverton   perf   dnv   skx   1    2    1    0    .5   0    0    2    0    0    0    0    0    0
 16. 2-Node-Zen2        perf   zn2   zn2   1    1    1    0    0    0    0    0    0    0    0    0    2    0
 17. 3-Node-Icelake     perf   icx   icx   2    4    2    0    0    0    0    0    0    0    0    6    0    6
-                                 Totals: 32   41  21.5   4   19    1    2    3    3    2    2    7    2  14.5
+18. 1-Node-AmpereAltra nomad  alt   na    2    2    0    0    0    0    0    0    0    0    2    0    0    0
+                                 Totals: 34   43  21.5   4   19    1    2    3    3    2    4    7    2  14.5
 ```
 
 ### 1-Node-Skylake Xeon Intel (1n-skx)
@@ -325,6 +326,8 @@ Name         | Comment
 10.30.50.88  | s78-t215-tg1
 10.30.50.89  | s79-t39t310-tg1
 10.30.50.90  | s80-t311t312-tg1
+10.30.50.91  | s58-nomad
+10.30.50.92  | s59-nomad
 10.30.50.255 | Broadcast
 10.30.55.0   | network
 10.30.55.1   | Router
@@ -417,6 +420,8 @@ Name         | Comment
 10.30.51.88  | s78-t215-tg1
 10.30.51.89  | s79-t39t310-tg1
 10.30.51.90  | s80-t311t312-tg1
+10.30.51.91  | s58-nomad
+10.30.51.92  | s59-nomad
 10.30.51.255 | Broadcast
 10.32.8.0    | network
 10.32.8.1    | Router
@@ -663,7 +668,7 @@ FD.io CSIT lab contains following server types:
             - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel.
             - PCIe Slot9 5e:00.xx: ConnectX5-2p100GE Mellanox.
         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
-            - PCIe Slot6 86:00.xx: empty.
+            - PCIe Slot6 86:00.xx: e810-2p100GE Intel.
             - PCIe Slot8 af:00.xx: empty.
             - PCIe Slot10 d8:00.xx: empty.
 13. Server-Type-C3: Purpose - Cascadelake Xeon TG for FD.io performance testing.
@@ -683,13 +688,13 @@ FD.io CSIT lab contains following server types:
             - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel.
             - PCIe Slot9 5e:00.xx: ConnectX5-2p100GE Mellanox.
         - Numa1: (x16, x16, x16 PCIe3.0 lanes)
-            - PCIe Slot6 86:00.xx: empty.
-            - PCIe Slot8 af:00.xx: empty.
+            - PCIe Slot6 86:00.xx: ConnectX5-2p100GE Mellanox.
+            - PCIe Slot8 af:00.xx: ConnectX5-2p100GE Mellanox.
             - PCIe Slot10 d8:00.xx: empty.
 14. Server-Type-C4: Purpose - Cascadelake Xeon Backend hosts for FD.io builds and data processing.
     - Quantity: 3.
     - Physical connectivity:
-        - CIMC and host management ports.
+        - IPMI and host management ports.
         - no NIC ports, standalone setup.
     - Main HW configuration:
         - Chassis: SuperMicro 1029P-WTRT.
@@ -897,6 +902,16 @@ FD.io CSIT lab contains following server types:
             - PCIe Slot6 86:00.xx: e810-XXVDA4-4p25GE Intel.
             - PCIe Slot8 af:00.xx: e810-2CQDA2-2p100GE Intel.
             - PCIe Slot10 d8:00.xx: empty.
+26. Server-Type-E24 : Purpose - Altra Arm Ampere for FD.io build.
+    - Quantity: 2.
+    - Physical connectivity:
+        - IPMI and host management ports.
+    - Main HW configuration:
+        - Chassis: Gigabyte R152-P30-00 1U
+        - Motherboard: MP32-AR1-00
+        - Processors: 1* Ampere(R) Altra(R) Processor (Neoverse N1)
+        - RAM Memory: 4* 16GB RDIMM-3200MHz
+        - Disks: 1* 960GB SSD Samsung M.2 NVMe PM983
 ```
 
 ### Naming Convention
@@ -1217,8 +1232,10 @@ Note: ServerB28 (TG) is shared between testbed26 & testbed35
         - s34-t27-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
         - s34-t27-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
         - s34-t27-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
-        - s34-t27-tg1-c6/p1 - 100GE-port1 e810-2p100GE.
-        - s34-t27-tg1-c6/p2 - 100GE-port2 e810-2p100GE.
+        - s34-t27-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE.
+        - s34-t27-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE.
+        - s38-t27-tg1-c8/p1 - 100GE-port1 ConnectX5-2p100GE.
+        - s38-t27-tg1-c8/p2 - 100GE-port2 ConnectX5-2p100GE.
         - s34-t27-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE.
         - s34-t27-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE.
 - SUT [Server-Type-C2]:
@@ -1249,8 +1266,10 @@ Note: ServerB28 (TG) is shared between testbed26 & testbed35
         - s36-t28-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
         - s36-t28-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
         - s36-t28-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
-        - s36-t28-tg1-c6/p1 - 100GE-port1 e810-2p100GE.
-        - s36-t28-tg1-c6/p2 - 100GE-port2 e810-2p100GE.
+        - s36-t28-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE.
+        - s36-t28-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE.
+        - s38-t28-tg1-c8/p1 - 100GE-port1 ConnectX5-2p100GE.
+        - s38-t28-tg1-c8/p2 - 100GE-port2 ConnectX5-2p100GE.
         - s36-t28-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE.
         - s36-t28-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE.
 - SUT [Server-Type-C2]:
@@ -1281,8 +1300,8 @@ Note: ServerB28 (TG) is shared between testbed26 & testbed35
         - s38-t29-tg1-c2/p4 - 10GE-port4 x710-4p10GE.
         - s38-t29-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE.
         - s38-t29-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE.
-        - s38-t29-tg1-c6/p1 - 100GE-port1 e810-2p100GE.
-        - s38-t29-tg1-c6/p2 - 100GE-port2 e810-2p100GE.
+        - s38-t29-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE.
+        - s38-t29-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE.
         - s38-t29-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE.
         - s38-t29-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE.
 ```
@@ -1949,9 +1968,12 @@ Note: Server64 (TG) is shared between testbed34 & testbed36
     - ring4 100GE-ports ConnectX5-2p100GE on SUT:
         - s34-t27-tg1-c9/p1 to s33-t27-sut1-c9/p1.
         - s33-t27-sut1-c9/p2 to s34-t27-tg1-c9/p2.
-    - ring5 100GE-ports e810-2p100GE on SUT:
+    - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG:
         - s34-t27-tg1-c6/p1 to s33-t27-sut1-c6/p1.
         - s33-t27-sut1-c6/p2 to s34-t27-tg1-c6/p2.
+    - ring6 100GE-ports e810-2p100GE on TG:
+        - s34-t27-tg1-c8/p1 to s34-t27-tg1-c8/p2.
+        - s34-t27-tg1-c8/p2 to s34-t27-tg1-c8/p1.
 - testbed28:
     - ring1 10GE-ports x710-4p10GE on SUT:
         - s36-t28-tg1-c2/p1 to s35-t28-sut1-c2/p1.
@@ -1965,9 +1987,12 @@ Note: Server64 (TG) is shared between testbed34 & testbed36
     - ring4 100GE-ports ConnectX5-2p100GE on SUT:
         - s36-t28-tg1-c9/p1 to s35-t28-sut1-c9/p1.
         - s35-t28-sut1-c9/p2 to s36-t28-tg1-c9/p2.
-    - ring5 100GE-ports e810-2p100GE on SUT:
+    - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG:
         - s36-t28-tg1-c6/p1 to s35-t28-sut1-c6/p1.
         - s35-t28-sut1-c6/p2 to s36-t28-tg1-c6/p2.
+    - ring6 100GE-ports e810-2p100GE on TG:
+        - s36-t28-tg1-c8/p1 to s36-t28-tg1-c8/p2.
+        - s36-t28-tg1-c8/p2 to s36-t28-tg1-c8/p1.
 - testbed29:
     - ring1 10GE-ports x710-4p10GE on SUT:
         - s38-t29-tg1-c2/p1 to s37-t29-sut1-c2/p1.
@@ -1981,7 +2006,7 @@ Note: Server64 (TG) is shared between testbed34 & testbed36
     - ring4 100GE-ports ConnectX5-2p100GE on SUT:
         - s38-t29-tg1-c9/p1 to s37-t29-sut1-c9/p1.
         - s37-t29-sut1-c9/p2 to s38-t29-tg1-c9/p2.
-    - ring6 100GE-ports e810-2p100GE on SUT:
+    - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG:
         - s38-t29-tg1-c6/p1 to s37-t29-sut1-c6/p1.
         - s37-t29-sut1-c6/p2 to s38-t29-tg1-c6/p2.
 ```
@@ -2171,7 +2196,7 @@ To be completed.
         - s28-t26t35-tg1-c6/p2 to s31-t35-sut2-p4.
 ```
 
-#### 3-Node-Icelake Wiring (3n-icx) TBD
+#### 3-Node-Icelake Wiring (3n-icx) PROD
 
 ```
 - testbed37: