| GPUs | 8x NVIDIA A100 Tensor Core GPUs with 80GB HBM2e memory each |
|---|---|
| Total GPU Memory | 640 GB HBM2e (8x 80GB) |
| GPU Interconnect | 3rd Generation NVIDIA NVLink and NVSwitch for 600 GB/s GPU-to-GPU bandwidth |
| CPU | Dual 64-core AMD EPYC 7742 Processors |
| System Memory | 2 TB DDR4 (3200 MHz) |
| Networking | 9x Mellanox ConnectX-6 VPI HDR InfiniBand ports (200Gb/s) |
| Storage | |
| OS Drive | 4x 1.92 TB NVMe M.2 SSDs (RAID 0) |
| Internal Storage | 8x 3.84 TB U.2 NVMe SSDs (hot-swappable, configurable up to 30.72 TB raw) |
| Power Supply | 6x 3000W (N+N redundant) |
| Max Power Consumption | 6.5 kW |
| Form Factor | 8U Rackmount |