Directory
Hardware
Compare GPU/CPU chips, prompt-processing (prefill) speed and inference generation speed. Token rates are measured for specific models and runtimes, not theoretical hardware specifications.
29 hardware models · Showing 26–29
| Select hardware to compare | Hardware | GPU / CPU chip | Prefill (tok/s) | Inference (tok/s) | RAM / VRAM |
|---|---|---|---|---|---|
| Arc Pro B65 | — | — | 32 GB GPU | ||
| Arc Pro B60 | — | — | 24 GB GPU | ||
| A100 SXM 80 GB | — | — | 80 GB GPU | ||
| A100 SXM 40 GB | — | — | 40 GB GPU |