Inference provider
Catalogue
Available models
| Model | Endpoint | Context | Input /M | Output /M | Cached input /M | Cache write /M | Uptime 1d |
|---|---|---|---|---|---|---|---|
| baseten/fp8 | 1.0M | $0.13 | $0.26 | $0.03 | — | 99.30% | |
| baseten/fp8/us | 1.0M | $0.13 | $0.26 | $0.03 | — | 98.89% | |
| baseten/fast | 1.0M | $0.60 | $2.40 | $0.01 | — | 99.79% | |
| baseten/fp32 | 1.0M | $0.30 | $1.20 | $0.007 | — | 99.80% | |
| baseten/fp8 | 1.0M | $0.30 | $1.20 | $0.007 | — | 100.00% | |
| baseten/fast | 1.0M | $2.10 | $6.60 | $0.21 | — | 100.00% | |
| baseten/fp8 | 1.0M | $1.40 | $4.40 | $0.14 | — | 100.00% | |
| baseten/fp8/us | 1.0M | $1.40 | $4.40 | $0.14 | — | 100.00% | |
| baseten/us/fast | 1.0M | $2.10 | $6.60 | $0.21 | — | 100.00% | |
| baseten/fast | 1.0M | $2.10 | $6.60 | $0.21 | — | 100.00% | |
| baseten/fp4 | 1.0M | $1.40 | $4.40 | $0.14 | — | 100.00% | |
| baseten/fp4/us | 1.0M | $1.40 | $4.40 | $0.14 | — | 100.00% | |
| baseten/us/fast | 1.0M | $2.10 | $6.60 | $0.21 | — | 99.89% | |
| baseten/fp8 | 1.0M | $0.15 | $0.50 | $0.03 | — | 95.49% | |
| baseten/fp8/us | 1.0M | $0.15 | $0.50 | $0.03 | — | 96.32% | |
| baseten/fp8 | 1.0M | $3.00 | $15.00 | $0.30 | — | 100.00% | |
| baseten/fp4 | 203K | $0.60 | $2.40 | $0.12 | — | 100.00% | |
| baseten/fp4/us | 203K | $0.60 | $2.40 | $0.12 | — | 99.92% | |
| baseten/fp4 | 128K | $0.10 | $0.50 | $0.10 | — | 100.00% | |
| baseten/fp4/us | 128K | $0.10 | $0.50 | $0.10 | — | 100.00% |
