NVIDIA · Datacenter Gpu
GH200 Grace Hopper (144 GB HBM3e)
Grace Hopper
Prefill · prompt processing
Not benchmarked
Inference · generation speed
Not benchmarked
GPU / CPU chip
GH200 Grace Hopper (144 GB HBM3e)
RAM / VRAM
144 GB GPU
No verified model-specific throughput measurement is published here yet. Prefill and generation rates depend on the model, precision, batch size and runtime.
Hardware specifications
| Model / configuration | GH200 Grace Hopper (144 GB HBM3e) |
| Manufacturer | NVIDIA |
| Hardware category | Datacenter Gpu |
| Architecture | Grace Hopper |
| Accelerator model | GH200 Grace Hopper (144 GB HBM3e) |
| Accelerator count | 1 |
Where to buy
No verified retailer listings have been added for this hardware yet.
Retailer links do not guarantee stock or a current price.
Observed prices
No source-backed price observations recorded yet.
Historical observations retain their original currency. Prices are not converted or adjusted for regional taxes.
Memory & bandwidth
| Primary memory (comparison) | 144 GB GPU |
| Memory technology | HBM3e (GPU memory) |
| Memory per GPU | 144 GB |
| Total GPU memory | 144 GB |
| GPU / system bandwidth | 4,900 GB/s /GPU |
| GPU bandwidth | 4,900 GB/s |
Inference runtimes
Runtime support is not a model throughput or memory-fit benchmark.