Qwen
Qwen2.5 7B Instruct
Tool callingStructured output
- Context
- 33K
- Released
- 2y ago
- Parameters
- 7B
- Input / 1M tokens
- $0.10
- Output / 1M tokens
- $0.20
Sources:OpenRouter
Benchmarks
DeepSWE is the primary coding benchmark where an exact model evaluation exists. Other sourced evaluations appear below; missing scores are not zero.
Not evaluated in DeepSWE 1.1 as of 2026-09-22. Results are only shown for exact model versions in the official dataset. Official leaderboard.
Other published benchmarks
| Evaluation | Reported score and source |
|---|---|
| GPQA diamond | |
| OTIS Mock AIME 2024-2025 |
Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.
Specifications
- Developer
- Qwen
- Model family
- Qwen
- Type
- Language model
- Predecessor
- —
- Successor
- —
- Released
- September 19, 2024
- Model ID
qwen/qwen-2.5-7b-instruct- Openness
- Open weights
- License
- —
- Parameters
- 7B
- Input modalities
- text
- Output modalities
- text
- Modality
- text->text
- Native context
- 32K
- Tokenizer
- Qwen
- Max output tokens
- 29K
- Knowledge cutoff
- 2024-06-30
- Hugging Face
- Qwen/Qwen2.5-7B-Instruct
- Source freshness
- Endpoints synced Oct 15, 2026, 2:24 PM UTC
Open-weight builds
Ollama variants
Every published Ollama tag matched to this model, including parameter editions, instruction/base variants, and quantized builds.
| Variant | Parameters | Type | Quantization | Size | Context | Input |
|---|---|---|---|---|---|---|
| qwen2.5:0.5b-base-q2_K | 0.5B | base | Q2_K | 339 MB | 32K | text |
| qwen2.5:0.5b-base-q3_K_L | 0.5B | base | Q3_K_L | 369 MB | 32K | text |
| qwen2.5:0.5b-base-q3_K_M | 0.5B | base | Q3_K_M | 355 MB | 32K | text |
| qwen2.5:0.5b-base-q3_K_S | 0.5B | base | Q3_K_S | 338 MB | 32K | text |
| qwen2.5:0.5b-base-q4_0 | 0.5B | base | Q4_0 | 352 MB | 32K | text |
| qwen2.5:0.5b-base-q4_1 | 0.5B | base | Q4_1 | 375 MB | 32K | text |
| qwen2.5:0.5b-base | 0.5B | base | Q4_K_M | 398 MB | 32K | text |
| qwen2.5:0.5b-base-q4_K_S | 0.5B | base | Q4_K_S | 385 MB | 32K | text |
| qwen2.5:0.5b-base-q5_0 | 0.5B | base | Q5_0 | 397 MB | 32K | text |
| qwen2.5:0.5b-base-q5_1 | 0.5B | base | Q5_1 | 419 MB | 32K | text |
| qwen2.5:0.5b-base-q5_K_S | 0.5B | base | Q5_K_S | 413 MB | 32K | text |
| qwen2.5:0.5b-base-q8_0 | 0.5B | base | Q8_0 | 531 MB | 32K | text |
| qwen2.5:0.5b-instruct-fp16 | 0.5B | instruct | FP16 | 994 MB | 32K | text |
| qwen2.5:0.5b-instruct-q2_K | 0.5B | instruct | Q2_K | 339 MB | 32K | text |
| qwen2.5:0.5b-instruct-q3_K_L | 0.5B | instruct | Q3_K_L | 369 MB | 32K | text |
| qwen2.5:0.5b-instruct-q3_K_M | 0.5B | instruct | Q3_K_M | 355 MB | 32K | text |
| qwen2.5:0.5b-instruct-q3_K_S | 0.5B | instruct | Q3_K_S | 338 MB | 32K | text |
| qwen2.5:0.5b-instruct-q4_0 | 0.5B | instruct | Q4_0 | 352 MB | 32K | text |
| qwen2.5:0.5b-instruct-q4_1 | 0.5B | instruct | Q4_1 | 375 MB | 32K | text |
| qwen2.5:0.5b | 0.5B | instruct | Q4_K_M | 398 MB | 32K | text |
| qwen2.5:0.5b-instruct-q4_K_S | 0.5B | instruct | Q4_K_S | 385 MB | 32K | text |
| qwen2.5:0.5b-instruct-q5_0 | 0.5B | instruct | Q5_0 | 397 MB | 32K | text |
| qwen2.5:0.5b-instruct-q5_1 | 0.5B | instruct | Q5_1 | 419 MB | 32K | text |
| qwen2.5:0.5b-instruct-q5_K_M | 0.5B | instruct | Q5_K_M | 420 MB | 32K | text |
| qwen2.5:0.5b-instruct-q5_K_S | 0.5B | instruct | Q5_K_S | 413 MB | 32K | text |
| qwen2.5:0.5b-instruct-q6_K | 0.5B | instruct | Q6_K | 506 MB | 32K | text |
| qwen2.5:0.5b-instruct-q8_0 | 0.5B | instruct | Q8_0 | 531 MB | 32K | text |
| qwen2.5:1.5b-instruct-fp16 | 1.5B | instruct | FP16 | 3.1 GB | 32K | text |
| qwen2.5:1.5b-instruct-q2_K | 1.5B | instruct | Q2_K | 676 MB | 32K | text |
| qwen2.5:1.5b-instruct-q3_K_L | 1.5B | instruct | Q3_K_L | 880 MB | 32K | text |
| qwen2.5:1.5b-instruct-q3_K_M | 1.5B | instruct | Q3_K_M | 824 MB | 32K | text |
| qwen2.5:1.5b-instruct-q3_K_S | 1.5B | instruct | Q3_K_S | 761 MB | 32K | text |
| qwen2.5:1.5b-instruct-q4_0 | 1.5B | instruct | Q4_0 | 935 MB | 32K | text |
| qwen2.5:1.5b-instruct-q4_1 | 1.5B | instruct | Q4_1 | 1 GB | 32K | text |
| qwen2.5:1.5b | 1.5B | instruct | Q4_K_M | 986 MB | 32K | text |
| qwen2.5:1.5b-instruct-q4_K_S | 1.5B | instruct | Q4_K_S | 940 MB | 32K | text |
| qwen2.5:1.5b-instruct-q5_0 | 1.5B | instruct | Q5_0 | 1.1 GB | 32K | text |
| qwen2.5:1.5b-instruct-q5_1 | 1.5B | instruct | Q5_1 | 1.2 GB | 32K | text |
| qwen2.5:1.5b-instruct-q5_K_M | 1.5B | instruct | Q5_K_M | 1.1 GB | 32K | text |
| qwen2.5:1.5b-instruct-q5_K_S | 1.5B | instruct | Q5_K_S | 1.1 GB | 32K | text |
| qwen2.5:1.5b-instruct-q6_K | 1.5B | instruct | Q6_K | 1.3 GB | 32K | text |
| qwen2.5:1.5b-instruct-q8_0 | 1.5B | instruct | Q8_0 | 1.6 GB | 32K | text |
| qwen2.5:3b-instruct-fp16 | 3B | instruct | FP16 | 6.2 GB | 32K | text |
| qwen2.5:3b-instruct-q2_K | 3B | instruct | Q2_K | 1.3 GB | 32K | text |
| qwen2.5:3b-instruct-q3_K_L | 3B | instruct | Q3_K_L | 1.7 GB | 32K | text |
| qwen2.5:3b-instruct-q3_K_M | 3B | instruct | Q3_K_M | 1.6 GB | 32K | text |
| qwen2.5:3b-instruct-q3_K_S | 3B | instruct | Q3_K_S | 1.5 GB | 32K | text |
| qwen2.5:3b-instruct-q4_0 | 3B | instruct | Q4_0 | 1.8 GB | 32K | text |
| qwen2.5:3b-instruct-q4_1 | 3B | instruct | Q4_1 | 2 GB | 32K | text |
| qwen2.5:3b | 3B | instruct | Q4_K_M | 1.9 GB | 32K | text |
| qwen2.5:3b-instruct-q4_K_S | 3B | instruct | Q4_K_S | 1.8 GB | 32K | text |
| qwen2.5:3b-instruct-q5_0 | 3B | instruct | Q5_0 | 2.2 GB | 32K | text |
| qwen2.5:3b-instruct-q5_1 | 3B | instruct | Q5_1 | 2.3 GB | 32K | text |
| qwen2.5:3b-instruct-q5_K_M | 3B | instruct | Q5_K_M | 2.2 GB | 32K | text |
| qwen2.5:3b-instruct-q5_K_S | 3B | instruct | Q5_K_S | 2.2 GB | 32K | text |
| qwen2.5:3b-instruct-q6_K | 3B | instruct | Q6_K | 2.5 GB | 32K | text |
| qwen2.5:3b-instruct-q8_0 | 3B | instruct | Q8_0 | 3.3 GB | 32K | text |
| qwen2.5:7b-instruct-fp16 | 7B | instruct | FP16 | 15 GB | 32K | text |
| qwen2.5:7b-instruct-q2_K | 7B | instruct | Q2_K | 3 GB | 32K | text |
| qwen2.5:7b-instruct-q3_K_L | 7B | instruct | Q3_K_L | 4.1 GB | 32K | text |
| qwen2.5:7b-instruct-q3_K_M | 7B | instruct | Q3_K_M | 3.8 GB | 32K | text |
| qwen2.5:7b-instruct-q3_K_S | 7B | instruct | Q3_K_S | 3.5 GB | 32K | text |
| qwen2.5:7b-instruct-q4_0 | 7B | instruct | Q4_0 | 4.4 GB | 32K | text |
| qwen2.5:7b-instruct-q4_1 | 7B | instruct | Q4_1 | 4.9 GB | 32K | text |
| qwen2.5:latest | 7B | instruct | Q4_K_M | 4.7 GB | 32K | text |
| qwen2.5:7b-instruct-q4_K_S | 7B | instruct | Q4_K_S | 4.5 GB | 32K | text |
| qwen2.5:7b-instruct-q5_0 | 7B | instruct | Q5_0 | 5.3 GB | 32K | text |
| qwen2.5:7b-instruct-q5_1 | 7B | instruct | Q5_1 | 5.8 GB | 32K | text |
| qwen2.5:7b-instruct-q5_K_M | 7B | instruct | Q5_K_M | 5.4 GB | 32K | text |
| qwen2.5:7b-instruct-q5_K_S | 7B | instruct | Q5_K_S | 5.3 GB | 32K | text |
| qwen2.5:7b-instruct-q6_K | 7B | instruct | Q6_K | 6.3 GB | 32K | text |
| qwen2.5:7b-instruct-q8_0 | 7B | instruct | Q8_0 | 8.1 GB | 32K | text |
| qwen2.5:14b-instruct-fp16 | 14B | instruct | FP16 | 30 GB | 32K | text |
| qwen2.5:14b-instruct-q2_K | 14B | instruct | Q2_K | 5.8 GB | 32K | text |
| qwen2.5:14b-instruct-q3_K_L | 14B | instruct | Q3_K_L | 7.9 GB | 32K | text |
| qwen2.5:14b-instruct-q3_K_M | 14B | instruct | Q3_K_M | 7.3 GB | 32K | text |
| qwen2.5:14b-instruct-q3_K_S | 14B | instruct | Q3_K_S | 6.7 GB | 32K | text |
| qwen2.5:14b-instruct-q4_0 | 14B | instruct | Q4_0 | 8.5 GB | 32K | text |
| qwen2.5:14b-instruct-q4_1 | 14B | instruct | Q4_1 | 9.4 GB | 32K | text |
| qwen2.5:14b | 14B | instruct | Q4_K_M | 9 GB | 32K | text |
| qwen2.5:14b-instruct-q4_K_S | 14B | instruct | Q4_K_S | 8.6 GB | 32K | text |
| qwen2.5:14b-instruct-q5_0 | 14B | instruct | Q5_0 | 10 GB | 32K | text |
| qwen2.5:14b-instruct-q5_1 | 14B | instruct | Q5_1 | 11 GB | 32K | text |
| qwen2.5:14b-instruct-q5_K_M | 14B | instruct | Q5_K_M | 11 GB | 32K | text |
| qwen2.5:14b-instruct-q5_K_S | 14B | instruct | Q5_K_S | 10 GB | 32K | text |
| qwen2.5:14b-instruct-q6_K | 14B | instruct | Q6_K | 12 GB | 32K | text |
| qwen2.5:14b-instruct-q8_0 | 14B | instruct | Q8_0 | 16 GB | 32K | text |
| qwen2.5:32b-instruct-fp16 | 32B | instruct | FP16 | 66 GB | 32K | text |
| qwen2.5:32b-instruct-q2_K | 32B | instruct | Q2_K | 12 GB | 32K | text |
| qwen2.5:32b-instruct-q3_K_L | 32B | instruct | Q3_K_L | 17 GB | 32K | text |
| qwen2.5:32b-instruct-q3_K_M | 32B | instruct | Q3_K_M | 16 GB | 32K | text |
| qwen2.5:32b-instruct-q3_K_S | 32B | instruct | Q3_K_S | 14 GB | 32K | text |
| qwen2.5:32b-instruct-q4_0 | 32B | instruct | Q4_0 | 19 GB | 32K | text |
| qwen2.5:32b-instruct-q4_1 | 32B | instruct | Q4_1 | 21 GB | 32K | text |
| qwen2.5:32b | 32B | instruct | Q4_K_M | 20 GB | 32K | text |
| qwen2.5:32b-instruct-q4_K_S | 32B | instruct | Q4_K_S | 19 GB | 32K | text |
| qwen2.5:32b-instruct-q5_0 | 32B | instruct | Q5_0 | 23 GB | 32K | text |
| qwen2.5:32b-instruct-q5_1 | 32B | instruct | Q5_1 | 25 GB | 32K | text |
| qwen2.5:32b-instruct-q5_K_M | 32B | instruct | Q5_K_M | 23 GB | 32K | text |
| qwen2.5:32b-instruct-q5_K_S | 32B | instruct | Q5_K_S | 23 GB | 32K | text |
| qwen2.5:32b-instruct-q6_K | 32B | instruct | Q6_K | 27 GB | 32K | text |
| qwen2.5:32b-instruct-q8_0 | 32B | instruct | Q8_0 | 35 GB | 32K | text |
| qwen2.5:72b-instruct-fp16 | 72B | instruct | FP16 | 145 GB | 32K | text |
| qwen2.5:72b-instruct-q2_K | 72B | instruct | Q2_K | 30 GB | 32K | text |
| qwen2.5:72b-instruct-q3_K_L | 72B | instruct | Q3_K_L | 40 GB | 32K | text |
| qwen2.5:72b-instruct-q3_K_M | 72B | instruct | Q3_K_M | 38 GB | 32K | text |
| qwen2.5:72b-instruct-q3_K_S | 72B | instruct | Q3_K_S | 34 GB | 32K | text |
| qwen2.5:72b-instruct-q4_0 | 72B | instruct | Q4_0 | 41 GB | 32K | text |
| qwen2.5:72b-instruct-q4_1 | 72B | instruct | Q4_1 | 46 GB | 32K | text |
| qwen2.5:72b | 72B | instruct | Q4_K_M | 47 GB | 32K | text |
| qwen2.5:72b-instruct-q4_K_S | 72B | instruct | Q4_K_S | 44 GB | 32K | text |
| qwen2.5:72b-instruct-q5_0 | 72B | instruct | Q5_0 | 50 GB | 32K | text |
| qwen2.5:72b-instruct-q5_1 | 72B | instruct | Q5_1 | 55 GB | 32K | text |
| qwen2.5:72b-instruct-q5_K_M | 72B | instruct | Q5_K_M | 54 GB | 32K | text |
| qwen2.5:72b-instruct-q5_K_S | 72B | instruct | Q5_K_S | 51 GB | 32K | text |
| qwen2.5:72b-instruct-q6_K | 72B | instruct | Q6_K | 64 GB | 32K | text |
| qwen2.5:72b-instruct-q8_0 | 72B | instruct | Q8_0 | 77 GB | 32K | text |
Infrastructure
Provider availability
| Provider | Endpoint | Context | Input /M tokens | Output /M tokens | Cached input /M tokens | Cache write /M tokens | Uptime 1d | Data handling |
|---|---|---|---|---|---|---|---|---|
| phala | 33K | $0.10 | $0.20 | — | — | 100.00% | ZDR: YesTraining: Unknown Prompt logging: Unknown Retention: Unknown Checked 2026-10-15 |
Provider data:OpenRouter
Deployment graph
Can I run this?
Vertical Tabs only shows compatibility when it has structured evidence tying this exact model to hardware, runtime, quantization, memory use, and observed performance.