Qwen2.5-Coder-0.5B

Tiny open Qwen code model for lightweight completion and on-device coding

Context window
32.8K
tokens in · 8.2K out
ECI STANDING#267 of 270
SCORE87.6360.63–99.82 CI
FRONTIER LAGLaunched 18.8 months behindScores about what LLaMA-65B did in February 2023.
SCORES LIKE THESE MODELS
RedPajama-INCITE-7B-Base · May 202389.96
Dolly 2.0-12bDatabricks · Apr 202389.2
DeepSeek Coder 6.7BDeepSeek,Peking University · Nov 202389.13
StarCoder 2 3BHugging Face,ServiceNow,Nvidia,BigCode · Feb 202488.26
Full Epoch Capabilities Index ranking ↗

Epoch benchmark boards

Best result on each board it has run. The tick marks the leader.

GSM8K
34%#50 of 82
HellaSwag
48%#68 of 75
ARC AI2
34%#69 of 76
Winogrande
55%#74 of 77

Qwen's past year

48 release days in the past year, about one every 8 days. The next is expected around Nov 2, 2026. Forecasts ↗

NovDecJanFebMarAprMayJunJulAugSepOctNov

Specifications

RELEASE DATENov 12, 2024
WEIGHTSOpen weights
CONTEXT WINDOW32.8K
MAX OUTPUT8.2K
REASONINGNot listed
TOOL CALLINGNot listed
INPUTStext
OUTPUTStext

Models.dev record ↗

Specifications and prices from Models.dev; availability and limits may differ by provider. Benchmarks from Epoch AI (CC BY 4.0), LiveBench and the other sources named above.