Llama 3.1 8B Instruct

Compact open Llama model for lightweight chat, drafting, and self-hosting
- Context
- 131K
- Released
- 2y ago
- Parameters
- 8B
- Input / 1M tokens
- $0.05
- Output / 1M tokens
- $0.08
- Cached input / 1M tokens
- $0.02
Sources:models.devOpenRouter
Benchmarks
DeepSWE is the primary coding benchmark where an exact model evaluation exists. Other sourced evaluations appear below; missing scores are not zero.
Not evaluated in DeepSWE 1.1 as of 2026-09-22. Results are only shown for exact model versions in the official dataset. Official leaderboard.
Other published benchmarks
| Evaluation | Reported score and source |
|---|---|
| GPQA diamond | |
| OTIS Mock AIME 2024-2025 |
Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.
Specifications
- Developer
- Meta
- Model family
- Llama
- Type
- Language model
- Predecessor
- —
- Successor
- —
- Released
- July 23, 2024
- Model ID
meta-llama/llama-3.1-8b-instruct- Openness
- Open weights
- License
- —
- Parameters
- 8B
- Input modalities
- text
- Output modalities
- text
- Modality
- text->text
- Native context
- 128K
- Tokenizer
- Llama3
- Max output tokens
- 118K
- Knowledge cutoff
- 2023-12
- Hugging Face
- meta-llama/Meta-Llama-3.1-8B-Instruct
- Source freshness
- Metadata synced Oct 8, 2026, 10:17 PM UTC
Open-weight builds
Ollama variants
Every published Ollama tag matched to this model, including parameter editions, instruction/base variants, and quantized builds.
| Variant | Parameters | Type | Quantization | Size | Context | Input |
|---|---|---|---|---|---|---|
| llama3.1:8b-instruct-fp16 | 8B | instruct | FP16 | 16 GB | 128K | text |
| llama3.1:8b-instruct-q2_K | 8B | instruct | Q2_K | 3.2 GB | 128K | text |
| llama3.1:8b-instruct-q3_K_L | 8B | instruct | Q3_K_L | 4.3 GB | 128K | text |
| llama3.1:8b-instruct-q3_K_M | 8B | instruct | Q3_K_M | 4 GB | 128K | text |
| llama3.1:8b-instruct-q3_K_S | 8B | instruct | Q3_K_S | 3.7 GB | 128K | text |
| llama3.1:8b-instruct-q4_0 | 8B | instruct | Q4_0 | 4.7 GB | 128K | text |
| llama3.1:8b-instruct-q4_1 | 8B | instruct | Q4_1 | 5.1 GB | 128K | text |
| llama3.1:latest | 8B | instruct | Q4_K_M | 4.9 GB | 128K | text |
| llama3.1:8b-instruct-q4_K_S | 8B | instruct | Q4_K_S | 4.7 GB | 128K | text |
| llama3.1:8b-instruct-q5_0 | 8B | instruct | Q5_0 | 5.6 GB | 128K | text |
| llama3.1:8b-instruct-q5_1 | 8B | instruct | Q5_1 | 6.1 GB | 128K | text |
| llama3.1:8b-instruct-q5_K_M | 8B | instruct | Q5_K_M | 5.7 GB | 128K | text |
| llama3.1:8b-instruct-q5_K_S | 8B | instruct | Q5_K_S | 5.6 GB | 128K | text |
| llama3.1:8b-instruct-q6_K | 8B | instruct | Q6_K | 6.6 GB | 128K | text |
| llama3.1:8b-instruct-q8_0 | 8B | instruct | Q8_0 | 8.5 GB | 128K | text |
| llama3.1:8b-text-fp16 | 8B | text | FP16 | 16 GB | 128K | text |
| llama3.1:8b-text-q2_K | 8B | text | Q2_K | 3.2 GB | 128K | text |
| llama3.1:8b-text-q3_K_L | 8B | text | Q3_K_L | 4.3 GB | 128K | text |
| llama3.1:8b-text-q3_K_M | 8B | text | Q3_K_M | 4 GB | 128K | text |
| llama3.1:8b-text-q3_K_S | 8B | text | Q3_K_S | 3.7 GB | 128K | text |
| llama3.1:8b-text-q4_0 | 8B | text | Q4_0 | 4.7 GB | 128K | text |
| llama3.1:8b-text-q4_1 | 8B | text | Q4_1 | 5.1 GB | 128K | text |
| llama3.1:8b-text-q4_K_M | 8B | text | Q4_K_M | 4.9 GB | 128K | text |
| llama3.1:8b-text-q4_K_S | 8B | text | Q4_K_S | 4.7 GB | 128K | text |
| llama3.1:8b-text-q5_0 | 8B | text | Q5_0 | 5.6 GB | 128K | text |
| llama3.1:8b-text-q5_1 | 8B | text | Q5_1 | 6.1 GB | 128K | text |
| llama3.1:8b-text-q5_K_M | 8B | text | Q5_K_M | 5.7 GB | 128K | text |
| llama3.1:8b-text-q5_K_S | 8B | text | Q5_K_S | 5.6 GB | 128K | text |
| llama3.1:8b-text-q6_K | 8B | text | Q6_K | 6.6 GB | 128K | text |
| llama3.1:8b-text-q8_0 | 8B | text | Q8_0 | 8.5 GB | 128K | text |
| llama3.1:70b-instruct-fp16 | 70B | instruct | FP16 | 141 GB | 128K | text |
| llama3.1:70b-instruct-q2_K | 70B | instruct | Q2_K | 26 GB | 128K | text |
| llama3.1:70b-instruct-q3_K_L | 70B | instruct | Q3_K_L | 37 GB | 128K | text |
| llama3.1:70b-instruct-q3_K_M | 70B | instruct | Q3_K_M | 34 GB | 128K | text |
| llama3.1:70b-instruct-q3_K_S | 70B | instruct | Q3_K_S | 31 GB | 128K | text |
| llama3.1:70b-instruct-q4_0 | 70B | instruct | Q4_0 | 40 GB | 128K | text |
| llama3.1:70b | 70B | instruct | Q4_K_M | 43 GB | 128K | text |
| llama3.1:70b-instruct-q4_K_S | 70B | instruct | Q4_K_S | 40 GB | 128K | text |
| llama3.1:70b-instruct-q5_0 | 70B | instruct | Q5_0 | 49 GB | 128K | text |
| llama3.1:70b-instruct-q5_1 | 70B | instruct | Q5_1 | 53 GB | 128K | text |
| llama3.1:70b-instruct-q5_K_M | 70B | instruct | Q5_K_M | 50 GB | 128K | text |
| llama3.1:70b-instruct-q5_K_S | 70B | instruct | Q5_K_S | 49 GB | 128K | text |
| llama3.1:70b-instruct-q6_K | 70B | instruct | Q6_K | 58 GB | 128K | text |
| llama3.1:70b-instruct-q8_0 | 70B | instruct | Q8_0 | 75 GB | 128K | text |
| llama3.1:70b-text-fp16 | 70B | text | FP16 | 141 GB | 128K | text |
| llama3.1:70b-text-q2_K | 70B | text | Q2_K | 26 GB | 128K | text |
| llama3.1:70b-text-q3_K_L | 70B | text | Q3_K_L | 37 GB | 128K | text |
| llama3.1:70b-text-q3_K_M | 70B | text | Q3_K_M | 34 GB | 128K | text |
| llama3.1:70b-text-q3_K_S | 70B | text | Q3_K_S | 31 GB | 128K | text |
| llama3.1:70b-text-q4_0 | 70B | text | Q4_0 | 40 GB | 128K | text |
| llama3.1:70b-text-q4_1 | 70B | text | Q4_1 | 44 GB | 128K | text |
| llama3.1:70b-text-q4_K_M | 70B | text | Q4_K_M | 43 GB | 128K | text |
| llama3.1:70b-text-q4_K_S | 70B | text | Q4_K_S | 40 GB | 128K | text |
| llama3.1:70b-text-q5_0 | 70B | text | Q5_0 | 49 GB | 128K | text |
| llama3.1:70b-text-q5_1 | 70B | text | Q5_1 | 53 GB | 128K | text |
| llama3.1:70b-text-q5_K_M | 70B | text | Q5_K_M | 50 GB | 128K | text |
| llama3.1:70b-text-q5_K_S | 70B | text | Q5_K_S | 49 GB | 128K | text |
| llama3.1:70b-text-q6_K | 70B | text | Q6_K | 58 GB | 128K | text |
| llama3.1:70b-text-q8_0 | 70B | text | Q8_0 | 75 GB | 128K | text |
| llama3.1:405b-instruct-fp16 | 405B | instruct | FP16 | 812 GB | 128K | text |
| llama3.1:405b-instruct-q2_K | 405B | instruct | Q2_K | 149 GB | 128K | text |
| llama3.1:405b-instruct-q3_K_L | 405B | instruct | Q3_K_L | 213 GB | 128K | text |
| llama3.1:405b-instruct-q3_K_M | 405B | instruct | Q3_K_M | 195 GB | 128K | text |
| llama3.1:405b-instruct-q3_K_S | 405B | instruct | Q3_K_S | 175 GB | 128K | text |
| llama3.1:405b-instruct-q4_0 | 405B | instruct | Q4_0 | 229 GB | 128K | text |
| llama3.1:405b-instruct-q4_1 | 405B | instruct | Q4_1 | 254 GB | 128K | text |
| llama3.1:405b | 405B | instruct | Q4_K_M | 243 GB | 128K | text |
| llama3.1:405b-instruct-q4_K_S | 405B | instruct | Q4_K_S | 231 GB | 128K | text |
| llama3.1:405b-instruct-q5_0 | 405B | instruct | Q5_0 | 279 GB | 128K | text |
| llama3.1:405b-instruct-q5_1 | 405B | instruct | Q5_1 | 305 GB | 128K | text |
| llama3.1:405b-instruct-q5_K_M | 405B | instruct | Q5_K_M | 287 GB | 128K | text |
| llama3.1:405b-instruct-q5_K_S | 405B | instruct | Q5_K_S | 279 GB | 128K | text |
| llama3.1:405b-instruct-q6_K | 405B | instruct | Q6_K | 333 GB | 128K | text |
| llama3.1:405b-instruct-q8_0 | 405B | instruct | Q8_0 | 431 GB | 128K | text |
| llama3.1:405b-text-fp16 | 405B | text | FP16 | 812 GB | 128K | text |
| llama3.1:405b-text-q2_K | 405B | text | Q2_K | 149 GB | 128K | text |
| llama3.1:405b-text-q3_K_L | 405B | text | Q3_K_L | 213 GB | 128K | text |
| llama3.1:405b-text-q3_K_M | 405B | text | Q3_K_M | 195 GB | 128K | text |
| llama3.1:405b-text-q3_K_S | 405B | text | Q3_K_S | 175 GB | 128K | text |
| llama3.1:405b-text-q4_0 | 405B | text | Q4_0 | 229 GB | 128K | text |
| llama3.1:405b-text-q4_1 | 405B | text | Q4_1 | 254 GB | 128K | text |
| llama3.1:405b-text-q4_K_M | 405B | text | Q4_K_M | 243 GB | 128K | text |
| llama3.1:405b-text-q4_K_S | 405B | text | Q4_K_S | 231 GB | 128K | text |
| llama3.1:405b-text-q5_0 | 405B | text | Q5_0 | 279 GB | 128K | text |
| llama3.1:405b-text-q5_1 | 405B | text | Q5_1 | 305 GB | 128K | text |
| llama3.1:405b-text-q5_K_M | 405B | text | Q5_K_M | 287 GB | 128K | text |
| llama3.1:405b-text-q5_K_S | 405B | text | Q5_K_S | 279 GB | 128K | text |
| llama3.1:405b-text-q6_K | 405B | text | Q6_K | 333 GB | 128K | text |
| llama3.1:405b-text-q8_0 | 405B | text | Q8_0 | 431 GB | 128K | text |
Additional source evidence
- Source model
- meta/llama-3.1-8b-instruct
- Source family
- llama
- Last updated
- 2024-07-23
- Knowledge cutoff
- 2023-12
- Model context
- 128K
- Model output limit
- 4K
- Open weights
- Yes
- File attachments
- No
- Reasoning
- No
- Tool calling
- Yes
- Temperature control
- Yes
Downloadable weights
Complete source record (JSON)
{
"id": "meta/llama-3.1-8b-instruct",
"name": "Llama-3.1-8B-Instruct",
"description": "Compact open Llama model for lightweight chat, drafting, and self-hosting",
"family": "llama",
"last_updated": "2024-07-23",
"knowledge": "2023-12",
"attachment": false,
"reasoning": false,
"tool_call": true,
"temperature": true,
"modalities": {
"input": [
"text"
],
"output": [
"text"
]
},
"limit": {
"context": 128000,
"output": 4096
},
"release_date": "2024-07-23",
"open_weights": true,
"weights": [
{
"label": "Hugging Face",
"url": "https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct"
}
]
}Infrastructure
Provider availability
| Provider | Endpoint | Context | Input /M tokens | Output /M tokens | Cached input /M tokens | Cache write /M tokens | Uptime 1d | Data handling |
|---|---|---|---|---|---|---|---|---|
| deepinfra/fp8 | 131K | $0.02 | $0.04 | — | — | 100.00% | ZDR: YesTraining: Unknown Prompt logging: Unknown Retention: Unknown Checked 2026-10-15 | |
| novita/fp8 | 16K | $0.02 | $0.05 | — | — | 97.99% | ZDR: YesTraining: Unknown Prompt logging: Unknown Retention: Unknown Checked 2026-10-15 | |
| groq | 131K | $0.05 | $0.08 | $0.02 | — | 100.00% | ZDR: YesTraining: Unknown Prompt logging: Unknown Retention: Unknown Checked 2026-10-15 | |
| cloudflare/fp8 | 32K | $0.15 | $0.29 | — | — | 99.47% | ZDR: NoTraining: Unknown Prompt logging: Unknown Retention: Unknown Checked 2026-10-15 | |
| coreweave/bf16 | 131K | $0.22 | $0.22 | $0.22 | — | 100.00% | ZDR: YesTraining: Unknown Prompt logging: Unknown Retention: Unknown Checked 2026-10-15 |
Provider data:OpenRouter
Deployment graph
Can I run this?
Vertical Tabs only shows compatibility when it has structured evidence tying this exact model to hardware, runtime, quantization, memory use, and observed performance.