# FD.io CSIT Testbed Specifications
-1. [FD.io CSIT Testbed Specifications](#fdio-csit-testbed-specifications)
+1. [Purpose](#purpose)
1. [Testbeds Overview](#testbeds-overview)
1. [Summary List](#summary-list)
1. [1-Node-Skylake Xeon Intel (1n-skx)](#1-node-skylake-xeon-intel-1n-skx)
1. [Server and Port Naming](#server-and-port-naming)
1. [Testbeds Configuration](#testbeds-configuration)
1. [Per Testbed Server Allocation and Naming](#per-testbed-server-allocation-and-naming)
- 1 [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
- 1 [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
- 1 [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
- 1 [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
- 1 [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
- 1 [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
- 1 [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
- 1 [3-Node-Rangeley (3n-rng) VERIFY](#3-node-rangeley-3n-rng-verify)
- 1 [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
- 1 [3-Node-Mcbin (3n-mcb) TODO](#3-node-mcbin-3n-mcb-todo)
+ 1. [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
+ 1. [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
+ 1. [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
+ 1. [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
+ 1. [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
+ 1. [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
+ 1. [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
+ 1. [3-Node-Rangeley (3n-rng) VERIFY](#3-node-rangeley-3n-rng-verify)
+ 1. [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
+ 1. [3-Node-Mcbin (3n-mcb) TODO](#3-node-mcbin-3n-mcb-todo)
1. [Per Testbed Wiring](#per-testbed-wiring)
- 1 [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
- 1 [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
- 1 [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
- 1 [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
- 1 [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
- 1 [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
- 1 [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
- 1 [3-Node-Rangeley (3n-rng) TODO](#3-node-rangeley-3n-rng-todo)
- 1 [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
- 1 [3-Node-Mcbin (3n-mcb) WIP](#3-node-mcbin-3n-mcb-wip)
+ 1. [1-Node-Skylake (1n-skx) PROD](#1-node-skylake-1n-skx-prod)
+ 1. [1-Node-Thunderx2 (1n-tx2) WIP](#1-node-thunderx2-1n-tx2-wip)
+ 1. [2-Node-Skylake (2n-skx) PROD](#2-node-skylake-2n-skx-prod)
+ 1. [2-Node-Denverton (2n-dnv) TODO](#2-node-denverton-2n-dnv-todo)
+ 1. [2-Node-IxiaPS1L47 (2n-ps1) VERIFY](#2-node-ixiaps1l47-2n-ps1-verify)
+ 1. [3-Node-Haswell (3n-hsw) PROD](#3-node-haswell-3n-hsw-prod)
+ 1. [3-Node-Skylake (3n-skx) PROD](#3-node-skylake-3n-skx-prod)
+ 1. [3-Node-Rangeley (3n-rng) TODO](#3-node-rangeley-3n-rng-todo)
+ 1. [3-Node-Taishan (3n-tsh) WIP](#3-node-taishan-3n-tsh-wip)
+ 1. [3-Node-Mcbin (3n-mcb) WIP](#3-node-mcbin-3n-mcb-wip)
1. [Inventory](#inventory)
1. [Appliances](#appliances)
1. [Arm Servers](#arm-servers)
1. [Pluggables and Cables](#pluggables-and-cables)
1. [Other Parts](#other-parts)
-## FD.io CSIT Testbed Specifications
+## Purpose
This note includes specification of the physical testbed infrastructure
hosted by LFN FD.io CSIT project.
9. 3-Node-Taishan perf tsh skx 1 2 1 0 .5 0 0 0 0 2 0
10. 3-Node-Mcbin perf mcb skx 1 2 1 0 .5 0 0 0 0 0 2
11. 1-Node-VIRL func hsw --- 3 3 0 3 0 0 0 0 0 0 0
- Totals: 17 26 14 12 19 1 2 1 1 2 2
+12. 3-Node-Denverton perf dnv skx 1 2 1 0 .5 0 0 2 0 0 0
+ Totals: 18 28 15 12 19 1 2 3 1 2 2
```
### 1-Node-Skylake Xeon Intel (1n-skx)
TG (Ixia PSOne appliance) with 10GE interfaces connected back-to-back.
Used for FD.io TCP/IP and HTTP performance tests.
-### 3-Node-Haswell Xeon Intel (3n-skx)
+### 3-Node-Haswell Xeon Intel (3n-hsw)
+
+Each 3-Node-Haswell testbed includes two SUTs (Type-A1 servers) and one
+TG (Type-A2 server) connected in full-mesh triangle.
+Used for FD.io performance tests.
### 3-Node-Skylake Xeon Intel (3n-skx)
- Disks: 1* 4TB SATA HDD
- NICs configuration:
- PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox.
- - PCIe Slot6 11:00.xx: 82599-2p10GE Intel.
+ - PCIe Slot6 11:00.xx: x520-2p10GE Intel.
4. Type-B4: Purpose - MACCHIATObin Arm Marvell SUT for FD.io performance testing.
- Quantity: 3
- Physical connectivity:
- s10-t24-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
```
-#### 2-Node-Denverton (2n-dnv) TODO
+#### 2-Node-Denverton (2n-dnv) WIP
+
+Note: ServerB28 (TG) is shared between testbed26 & testbed35
```
-To be completed.
+- ServerB28 [Type-B2]:
+ - testbednames: testbed26 and testbed35.
+ - hostname: s28-t26t35-tg1.
+ - IPMI IP: 10.30.55.10
+ - Host IP: 10.32.8.10
+ - portnames:
+ - s28-t26t35-tg1-c2/p1 - 10GE-port1 x710da2-2p10GE.
+ - s28-t26t35-tg1-c2/p2 - 10GE-port2 x710da2-2p10GE.
+ - s28-t26t35-tg1-c4/p1 - 10GE-port1 x550t2-2p10GE.
+ - s28-t26t35-tg1-c4/p2 - 10GE-port2 x550t2-2p10GE.
+ - s28-t26t35-tg1-c9/p1 - 10GE-port1 x550t2-2p10GE.
+ - s28-t26t35-tg1-c9/p2 - 10GE-port2 x550t2-2p10GE.
+ - s28-t26t35-tg1-c6/p1 - 10GE-port1 x710da2-2p10GE.
+ - s28-t26t35-tg1-c6/p2 - 10GE-port2 x710da2-2p10GE.
+ - s28-t26t35-tg1-c8/p1 - 10GE-port1 x550t2-2p10GE.
+ - s28-t26t35-tg1-c8/p2 - 10GE-port2 x550t2-2p10GE.
+ - s28-t26t35-tg1-c10/p1 - 10GE-port1 x550t2-2p10GE.
+ - s28-t26t35-tg1-c10/p2 - 10GE-port2 x550t2-2p10GE.
+- ServerB29 [Type-B10]:
+ - testbednames: testbed26.
+ - hostname: s29-t26-sut1.
+ - IPMI IP: 10.30.55.11
+ - Host IP: 10.32.8.11
+ - portnames:
+ - s29-t26-sut1-p1 - 10GE-port1 x553 copper port.
+ - s29-t26-sut1-p2 - 10GE-port2 x553 copper port.
+ - s29-t26-sut1-p3 - 10GE-port3 x553 fiber port.
+ - s29-t26-sut1-p4 - 10GE-port4 x553 fiber port.
```
#### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
- s16-t32-tg1-c9/p2 - FUTURE 100GE-port2 ConnectX5-2p100GE.
```
-Note: ServerB19 (TG) is shared between testbed33 & testbed34
-
#### 3-Node-Rangeley (3n-rng) VERIFY
Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB.
#### 3-Node-Taishan (3n-tsh) WIP
+Note: ServerB19 (TG) is shared between testbed33 & testbed34
+
```
- ServerB17 [Type-B3]:
- testbedname: testbed33.
- IPMI IP: 10.30.50.36
- Host IP: 10.30.51.36
- portnames:
- - s17-t33-sut1-c6/p1 - 10GE-port1 82599-2p10GE.
- - s17-t33-sut1-c6/p2 - 10GE-port2 82599-2p10GE.
+ - s17-t33-sut1-c6/p1 - 10GE-port1 x520-2p10GE.
+ - s17-t33-sut1-c6/p2 - 10GE-port2 x520-2p10GE.
- s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE.
- s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE.
- ServerB18 [Type-B3]:
- IPMI IP: 10.30.50.37
- Host IP: 10.30.51.37
- portnames:
- - s18-t33-sut2-c6/p1 - 10GE-port1 82599-2p10GE.
- - s18-t33-sut2-c6/p2 - 10GE-port2 82599-2p10GE.
+ - s18-t33-sut2-c6/p1 - 10GE-port1 x520-2p10GE.
+ - s18-t33-sut2-c6/p2 - 10GE-port2 x520-2p10GE.
- s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE.
- s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE.
- ServerB19 [Type-B2]:
- s21-t34-sut2-ca/p2 - 10GE-port2 Marvell.
```
+#### 3-Node-Denverton (3n-dnv) WIP
+
+```
+- ServerB30 [Type-B10]:
+ - testbednames: testbed35.
+ - hostname: s30-t35-sut1.
+ - IPMI IP: 10.30.55.12
+ - Host IP: 10.32.8.12
+ - portnames:
+ - s30-t35-sut1-p1 - 10GE-port1 x553 copper port.
+ - s30-t35-sut1-p2 - 10GE-port2 x553 copper port.
+ - s30-t35-sut1-p3 - 10GE-port3 x553 fiber port.
+ - s30-t35-sut1-p4 - 10GE-port4 x553 fiber port.
+- ServerB31 [Type-B10]:
+ - testbednames: testbed35.
+ - hostname: s31-t35-sut2.
+ - IPMI IP: 10.30.55.13
+ - Host IP: 10.32.8.13
+ - portnames:
+ - s31-t35-sut2-p1 - 10GE-port1 x553 copper port.
+ - s31-t35-sut2-p2 - 10GE-port2 x553 copper port.
+ - s31-t35-sut2-p3 - 10GE-port3 x553 fiber port.
+ - s31-t35-sut2-p4 - 10GE-port4 x553 fiber port.
+```
+
#### 3-Node-Mcbin (3n-mcb) TODO
```
- s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4.
```
-#### 2-Node-Denverton (2n-dnv) TODO
+#### 2-Node-Denverton (2n-dnv) WIP
```
-To be completed.
+- testbed26:
+ - ring1 10GE-ports x553 copper port on SUT:
+ - s28-t26t35-tg1-c4/p1 to s29-t26-sut1-p1.
+ - s28-t26t35-tg1-c9/p1 to s29-t26-sut1-p2.
+ - ring2 10GE-ports x553 fiber port on SUT:
+ - s28-t26t35-tg1-c2/p1 to s29-t26-sut1-p3.
+ - s28-t26t35-tg1-c2/p2 to s29-t26-sut1-p4.
```
#### 2-Node-IxiaPS1L47 (2n-ps1) VERIFY
```
- testbed33:
- - ring1 10GE-ports 82599-2p10GE on SUTs:
+ - ring1 10GE-ports x520-2p10GE on SUTs:
- t33t34-tg1-c2/p2 - t33-sut1-c6/p2.
- t33-sut1-c6/p1 - t33-sut2-c6/p2.
- t33-sut2-c6/p1 - t33t34-tg1-c2/p1.
- t34-sut2-ca/p2 - t33t34-tg1-c2/p4.
```
+#### 3-Node-Denverton (3n-dnv) WIP
+
+```
+- testbed35:
+ - ring1 10GE-ports x553 copper port on SUTs:
+ - s28-t26t35-tg1-c8/p1 to s30-t35-sut1-p2.
+ - s30-t35-sut1-p1 to s31-t35-sut2-p1.
+ - s28-t26t35-tg1-c10/p1 to s31-t35-sut2-p2.
+ - ring2 10GE-ports x553 fiber port on SUTs:
+ - s28-t26t35-tg1-c6/p1 to s30-t35-sut1-p4.
+ - s30-t35-sut1-p3 to s31-t35-sut2-p3.
+ - s28-t26t35-tg1-c6/p2 to s31-t35-sut2-p4.
+```
+
## Inventory
### Appliances