Network
The ICARUS network connects compute nodes, login nodes, and shared storage over high-speed Ethernet.
- Network connectivity: Two bonded 100 Gbit/s links provide up to 200 Gbit/s aggregate bandwidth on the verified login-node configuration.
- Login nodes: Provide SSH access and data transfers.
- Compute nodes: Use a private network without direct internet access.
- MPI: Uses the configured libraries for inter-node communication.
- Shared storage: Lustre traffic runs over TCP/IP.
High-Speed Network
| Component | Login-node configuration |
|---|---|
| Network speed per link | 100 Gbit/s |
| Active links | 2 |
| Aggregate link capacity | Up to 200 Gbit/s |
| Network adapters | NVIDIA/Mellanox ConnectX-6 Dx |
| Link aggregation | IEEE 802.3ad / LACP |
| Jumbo frames | MTU 9216 on the bond and physical interfaces |
| RDMA support | RDMA over Converged Ethernet (RoCE) |
The 200 Gbit/s figure is aggregate capacity; a single connection is limited to one 100 Gbit/s link.
Management Network
A separate management network supports system administration and monitoring.