HPC Specifications
Nodes
- SXM Nodes: 4
- Total Nodes: 12
- Node Configuration: Each node has 8 GPUs and 2 Processors.
- Node Memory: Each node has 640 GB of RAM.
Node Interconnect
- Interconnect: InfiniBand
- Speed: 200 Gb/s communication between nodes.
Software and OS
- Operating System: Rocky Linux 8.6
- Job Scheduling: SLURM (Simple Linux Utility for Resource Management)
Storage
- RAID Configuration: RAID-6 is implemented for reliable data storage. RAID-6 provides fault tolerance by allowing the system to continue functioning even if two disk drives fail simultaneously.
- Filesystem: The system uses the WekaIO parallel filesystem, specifically designed for AI/ML tasks.
Storage Performance Metrics
- Read IOPS (Input/Output Operations Per Second): 4 million
- Write IOPS (Input/Output Operations Per Second): 630,000
- Read Bandwidth (BW): 67GB/s
- Write Bandwidth (BW): 33GB/s
Our HPC System
Is a computational powerhouse tailored for AI, ML, and high-performance
computing. Its ideal for demanding workloads, this configuration delivers
substantial computational power, making it well-suited for complex simulations
and data-intensive applications.
Node Specifications
|
Node (PCIe) |
Node (SXM) |
Node (A30) |
Node (L40S) |
| Processor Type |
Intel Xeon Gold 6330 |
Intel Xeon Gold 6330 |
Intel Xeon Gold 6330 |
Intel Xeon Platinum 8562Y+ |
| Processors per Node |
2 |
2 |
2 |
2 |
| Cores per Node |
56 |
56 |
56 |
64 |
| Clock Speed |
2.0 GHz |
2.0 GHz |
2.0 GHz |
2.8 GHz |
| GPU Type |
NVIDIA A100 - 80 GB |
NVIDIA A100 - 80 GB |
NVIDIA A30 - 24 GB |
NVIDIA L40S - 48 GB |
| GPUs per Node |
8 |
8 |
6 |
8 |
| Interconnect |
PCIe 4.0 |
NVSwitch |
NVLink (paired) |
PCIe 4.0 |
| GPU Bandwidth |
32 GB/s |
600 GB/s |
100 GB/s (per pair) |
32 GB/s |
| Memory per Node |
640 GB DDR4 |
640 GB DDR4 |
1 TB DDR4 |
1 TB DDR5 |
| Node Type |
Specifications |
| Node (PCIe) |
- Processor Type
- Intel Xeon Gold 6330
- Processors per Node
- 2
- Cores per Node
- 56
- Clock Speed
- 2.0 GHz
- GPU Type
- NVIDIA A100 - 80 GB
- GPUs per Node
- 8
- Interconnect
- PCIe 4.0
- GPU Bandwidth
- 32 GB/s
- Memory per Node
- 640 GB DDR4
|
| Node (SXM) |
- Processor Type
- Intel Xeon Gold 6330
- Processors per Node
- 2
- Cores per Node
- 56
- Clock Speed
- 2.0 GHz
- GPU Type
- NVIDIA A100 - 80 GB
- GPUs per Node
- 8
- Interconnect
- NVSwitch
- GPU Bandwidth
- 600 GB/s
- Memory per Node
- 640 GB DDR4
|
| Node (A30) |
- Processor Type
- Intel Xeon Gold 6330
- Processors per Node
- 2
- Cores per Node
- 56
- Clock Speed
- 2.0 GHz
- GPU Type
- NVIDIA A30 - 24 GB
- GPUs per Node
- 6
- Interconnect
- NVLink (paired)
- GPU Bandwidth
- 100 GB/s (per pair)
- Memory per Node
- 1 TB DDR4
|
| Node (L40S) |
- Processor Type
- Intel Xeon Platinum 8562Y+
- Processors per Node
- 2
- Cores per Node
- 64
- Clock Speed
- 2.8 GHz
- GPU Type
- NVIDIA L40S - 48 GB
- GPUs per Node
- 8
- Interconnect
- PCIe 4.0
- GPU Bandwidth
- 32 GB/s
- Memory per Node
- 1 TB DDR5
|
