Directory
Hardware
Compare GPU/CPU chips, prompt-processing (prefill) speed and inference generation speed. Token rates are measured for specific models and runtimes, not theoretical hardware specifications.
56 hardware models · Showing 51–56
| Select hardware to compare | Hardware | GPU / CPU chip | Prefill (tok/s) | Inference (tok/s) | RAM / VRAM |
|---|---|---|---|---|---|
| B200 | — | — | 180 GB GPU | ||
| Arc Pro B70 | — | — | 32 GB GPU | ||
| Arc Pro B65 | — | — | 32 GB GPU | ||
| Arc Pro B60 | — | — | 24 GB GPU | ||
| A100 SXM 80 GB | — | — | 80 GB GPU | ||
| A100 SXM 40 GB | — | — | 40 GB GPU |