NVIDIA · Datacenter System
DGX GB200 NVL72 (72 GPUs)
Grace Blackwell
Prefill · prompt processing
Not benchmarked
Inference · generation speed
Not benchmarked
GPU / CPU chip
NVIDIA Blackwell (GB200) / 36 NVIDIA Grace Arm CPUs
RAM / VRAM
13,400 GB GPU total
No verified model-specific throughput measurement is published here yet. Prefill and generation rates depend on the model, precision, batch size and runtime.
Hardware specifications
| Product family | DGX |
| Model / configuration | DGX GB200 NVL72 |
| Released | 2024 |
| Manufacturer | NVIDIA |
| Hardware category | Datacenter System |
| Architecture | Grace Blackwell |
| Form factor | Liquid-cooled rack |
| CPU | 36 NVIDIA Grace Arm CPUs |
| CPU cores | 2592 |
| Accelerator model | NVIDIA Blackwell (GB200) |
| Accelerator count | 72 |
| Interconnect | 5th-generation NVLink |
Where to buy
No verified retailer listings have been added for this hardware yet.
Retailer links do not guarantee stock or a current price.
Observed prices
No source-backed price observations recorded yet.
Historical observations retain their original currency. Prices are not converted or adjusted for regional taxes.
Memory & bandwidth
| Primary memory (comparison) | 13,400 GB GPU total |
| Memory technology | HBM3e (72 GPUs) |
| Total GPU memory | 13,400 GB |
| GPU / system bandwidth | 576,000 GB/s total |
System memory, aggregate GPU memory and memory available to one accelerator are separate measurements. Do not treat total multi-GPU memory as a single unified pool.
Inference runtimes
No verified runtime compatibility records for this configuration yet.
Runtime support is not a model throughput or memory-fit benchmark.
13.4 TB total GPU HBM3e and 576 TB/s aggregate GPU bandwidth; not per GPU.