Glimmer Index
Plus $4/mo

GPT-4o mini

OpenAI · Released Jul 18, 2024 · Closed weights

Small omni GPT for cheap multimodal assistance and production-scale traffic

Strongest at
Writing
Better than 9% of the past year's models · one benchmark so far
Price per 1M tokens
$0.15 / $0.6
input / output · OpenAI
Context window
128K
tokens in · 16.4K out
Lab announcement ↗Open in the timeline

Capability profile

Scored against 91 models released in the past year. 50 is the average model; further out is better.

This modelMedian of the past year
5090Median of the past yearCoding: 23 · Better than 3%Writing: 33 · Better than 9%Reasoning: 33 · Better than 7%Math: 27 · Better than 2%Science: 29 · Better than 0%CodingWritingReasoningMathScience
Coding23Better than 3% · 1 test
Writing33Better than 9% · 1 test
Reasoning33Better than 7%
Math27Better than 2%
Science29Better than 0%

No results yet: Reading & documents, Visual reasoning, Computer use

Where these scores come from

Each capability combines the published benchmarks listed here, rescaled so 50 is the reference average and 15 points is one standard deviation. A hollow dot rests on a single benchmark.

Price against capability

The shaded corner holds anything better and cheaper. Prices blend input and output 3 to 1.

6 models from the past year score higher on Writing for less: DeepSeek V4.1 Flash, Gemma 4 31B IT, DeepSeek V4 Flash and 3 more.

$0.3$1$3$10204060Kimi K3.1 Pro: 70, $4 per 1MClaude Haiku 5.5: 46, $0.2 per 1MMistral Large 4: 41, $2.06 per 1MGemini 4 Argon: 63, $4 per 1MGPT-6.1 Sol: 64, $4 per 1MClaude Sonnet 5.5: 55, $4 per 1MGPT-6 Sol: 61, $4 per 1MGPT-6 Luna: 22, $0.2 per 1MClaude Opus 5.5: 65, $8 per 1MGrok 4.7: 64, $3 per 1MDeepSeek V4.1 Flash: 56, $0.21 per 1MGPT-6 Astra: 69, $20 per 1MMuse Spark 1.3: 65, $2 per 1MGemini 3.8 Flash: 65, $1.5 per 1MClaude Fable 5.1: 69, $20 per 1MGLM-5.3-Flash: 15, $0.24 per 1MDeepSeek V4 Flash Vision Exp: 56, $0.32 per 1MQwen3.8 27B: 52, $1.12 per 1MGLM-5.3: 65, $2.15 per 1MGemini 3.7 Flash: 61, $1.5 per 1MDeepSeek V4 Pro 0813: 49, $0.99 per 1MQwen3.8 2.4T A95B: 62, $3 per 1MGrok 4.6: 44, $3 per 1MMuse Glimmer 30B: 59, $0.52 per 1MMuse Spark 1.2: 62, $2 per 1MQwen3.8 Max: 57, $3 per 1MDeepSeek V4 Flash 0731: 52, $0.15 per 1MClaude Opus 5: 64, $10 per 1MGemini 3.6 Flash: 63, $1.5 per 1MGemini 3.5 Flash Lite: 53, $0.85 per 1MKimi K3: 64, $6 per 1MGPT-5.6 Terra: 57, $4.5 per 1MGPT-5.6 Sol: 65, $8 per 1MGPT-5.6 Luna: 53, $0.45 per 1MGrok 4.5: 44, $3 per 1MClaude Sonnet 5: 57, $4 per 1MGLM-5.2: 55, $2.15 per 1MKimi K2.7 Code: 23, $1.71 per 1MClaude Fable 5: 68, $20 per 1MClaude Opus 4.8: 62, $10 per 1MQwen3.7 Max: 48, $3.75 per 1MGemini 3.5 Flash: 56, $3.38 per 1MDeepSeek V4 Pro: 54, $1.19 per 1MDeepSeek V4 Flash: 52, $0.18 per 1MGPT-5.5: 64, $11.2 per 1MQwen3.6 27B: 16, $1.35 per 1MKimi K2.6: 56, $1.71 per 1MQwen3.6 Max Preview: 44, $2.92 per 1MGrok 4.3: 29, $1.56 per 1MGrok Build 0.1: 43, $1.25 per 1MClaude Opus 4.7: 61, $10 per 1MMuse Spark 1.1: 58, $2 per 1MGLM-5.1: 56, $2.15 per 1MGemma 4 31B IT: 54, $0.25 per 1MGemma 4 26B A4B IT: 51, $0.14 per 1MQwen3.6 Plus: 31, $1.12 per 1MGPT-5.4 nano: 49, $0.46 per 1MGPT-5.4 mini: 52, $1.69 per 1MGPT-5.4: 63, $5.62 per 1MGemini 3.1 Flash Lite Preview: 43, $0.56 per 1MQwen3.5 35B-A3B: 39, $0.69 per 1MQwen3.5 27B: 52, $0.82 per 1MQwen3.5 122B-A10B: 47, $1.1 per 1MGemini 3.1 Pro Preview: 57, $4.5 per 1MClaude Sonnet 4.6: 57, $6 per 1MQwen3.5 397B-A17B: 59, $1.35 per 1MGLM-5: 60, $1.55 per 1MClaude Opus 4.6: 56, $10 per 1MKimi K2.5: 62, $1 per 1MGLM-4.7: 58, $1 per 1MGemini 3 Flash Preview: 49, $1.12 per 1MGPT-5.2 Codex: 46, $4.81 per 1MGPT-5.2: 59, $4.81 per 1MMistral Large 3: 38, $0.75 per 1MMinistral 3 14B: 28, $0.2 per 1MDeepSeek V3.2: 49, $0.32 per 1MKimi K2 Thinking: 61, $1.07 per 1MGPT-4o mini: 33, $0.26 per 1MGPT-4o miniPrice per 1M tokens →↑ Writing$1$10204060Kimi K3.1 Pro: 70, $4 per 1MClaude Haiku 5.5: 46, $0.2 per 1MMistral Large 4: 41, $2.06 per 1MGemini 4 Argon: 63, $4 per 1MGPT-6.1 Sol: 64, $4 per 1MClaude Sonnet 5.5: 55, $4 per 1MGPT-6 Sol: 61, $4 per 1MGPT-6 Luna: 22, $0.2 per 1MClaude Opus 5.5: 65, $8 per 1MGrok 4.7: 64, $3 per 1MDeepSeek V4.1 Flash: 56, $0.21 per 1MGPT-6 Astra: 69, $20 per 1MMuse Spark 1.3: 65, $2 per 1MGemini 3.8 Flash: 65, $1.5 per 1MClaude Fable 5.1: 69, $20 per 1MGLM-5.3-Flash: 15, $0.24 per 1MDeepSeek V4 Flash Vision Exp: 56, $0.32 per 1MQwen3.8 27B: 52, $1.12 per 1MGLM-5.3: 65, $2.15 per 1MGemini 3.7 Flash: 61, $1.5 per 1MDeepSeek V4 Pro 0813: 49, $0.99 per 1MQwen3.8 2.4T A95B: 62, $3 per 1MGrok 4.6: 44, $3 per 1MMuse Glimmer 30B: 59, $0.52 per 1MMuse Spark 1.2: 62, $2 per 1MQwen3.8 Max: 57, $3 per 1MDeepSeek V4 Flash 0731: 52, $0.15 per 1MClaude Opus 5: 64, $10 per 1MGemini 3.6 Flash: 63, $1.5 per 1MGemini 3.5 Flash Lite: 53, $0.85 per 1MKimi K3: 64, $6 per 1MGPT-5.6 Terra: 57, $4.5 per 1MGPT-5.6 Sol: 65, $8 per 1MGPT-5.6 Luna: 53, $0.45 per 1MGrok 4.5: 44, $3 per 1MClaude Sonnet 5: 57, $4 per 1MGLM-5.2: 55, $2.15 per 1MKimi K2.7 Code: 23, $1.71 per 1MClaude Fable 5: 68, $20 per 1MClaude Opus 4.8: 62, $10 per 1MQwen3.7 Max: 48, $3.75 per 1MGemini 3.5 Flash: 56, $3.38 per 1MDeepSeek V4 Pro: 54, $1.19 per 1MDeepSeek V4 Flash: 52, $0.18 per 1MGPT-5.5: 64, $11.2 per 1MQwen3.6 27B: 16, $1.35 per 1MKimi K2.6: 56, $1.71 per 1MQwen3.6 Max Preview: 44, $2.92 per 1MGrok 4.3: 29, $1.56 per 1MGrok Build 0.1: 43, $1.25 per 1MClaude Opus 4.7: 61, $10 per 1MMuse Spark 1.1: 58, $2 per 1MGLM-5.1: 56, $2.15 per 1MGemma 4 31B IT: 54, $0.25 per 1MGemma 4 26B A4B IT: 51, $0.14 per 1MQwen3.6 Plus: 31, $1.12 per 1MGPT-5.4 nano: 49, $0.46 per 1MGPT-5.4 mini: 52, $1.69 per 1MGPT-5.4: 63, $5.62 per 1MGemini 3.1 Flash Lite Preview: 43, $0.56 per 1MQwen3.5 35B-A3B: 39, $0.69 per 1MQwen3.5 27B: 52, $0.82 per 1MQwen3.5 122B-A10B: 47, $1.1 per 1MGemini 3.1 Pro Preview: 57, $4.5 per 1MClaude Sonnet 4.6: 57, $6 per 1MQwen3.5 397B-A17B: 59, $1.35 per 1MGLM-5: 60, $1.55 per 1MClaude Opus 4.6: 56, $10 per 1MKimi K2.5: 62, $1 per 1MGLM-4.7: 58, $1 per 1MGemini 3 Flash Preview: 49, $1.12 per 1MGPT-5.2 Codex: 46, $4.81 per 1MGPT-5.2: 59, $4.81 per 1MMistral Large 3: 38, $0.75 per 1MMinistral 3 14B: 28, $0.2 per 1MDeepSeek V3.2: 49, $0.32 per 1MKimi K2 Thinking: 61, $1.07 per 1MGPT-4o mini: 33, $0.26 per 1MGPT-4o miniPrice per 1M tokens →↑ Writing

OpenAI $0.15 / $0.6 · OpenRouter $0.15 / $0.6 · Cached input $0.075

The GPT-5.4 mini line

4 releases in the GPT-5.4 mini line.

GPT-4o miniJul 18, 2024270dGPT-4.1 miniApr 14, 2025115dGPT-5 MiniAug 7, 2025222dGPT-5.4 miniMar 17, 2026

A newer release is out: GPT-5.4 mini.

ECI STANDING#177 of 270
SCORE126.46120.11–128.49 CI
FRONTIER LAGLaunched 4.6 months behindScores about what Claude 3 Opus did in February 2024.
SCORES LIKE THESE MODELS
Gemini 1.5 Pro (May 2024)Google DeepMind · May 2024126.94
Claude 3 OpusAnthropic · Feb 2024126.9
GPT-4 Turbo (Nov 2023)OpenAI · Jan 2024126.43
Llama 3.1-70BMeta AI · Jul 2024125.93
Full Epoch Capabilities Index ranking ↗

Epoch benchmark boards

Best result on each board it has run. The tick marks the leader.

PIQA
89%#1 of 59
GSM8K
91%#5 of 82
MMLU
82%#19 of 127
MATH level 5
53%#51 of 98
GeoBench
64%#18 of 28
Balrog
17%#29 of 39
Mystery Game Puzzles
12%#71 of 88
VPCT
34%#25 of 29
5 more boards
ARC-AGI-2
0%#94 of 103
Chess Puzzles
3%#88 of 93
FrontierMath-Tiers-1-3-v2-Private
1%#87 of 90
SimpleQA Verified
8%#84 of 85
SimpleBench
11%#89 of 89

OpenAI's past year

24 release days in the past year, about one every 15 days. The next is expected around Nov 8, 2026. Forecasts ↗

NovDecJanFebMarAprMayJunJulAugSepOctNov

Specifications

RELEASE DATEJul 18, 2024
WEIGHTSClosed weights
CONTEXT WINDOW128K
MAX OUTPUT16.4K
REASONINGNot listed
TOOL CALLINGNot listed
INPUTStext, image/jpeg, image/png, image/gif, image/webp, application/pdf
OUTPUTStext

Models.dev record ↗

Specifications and prices from Models.dev; availability and limits may differ by provider. Benchmarks from Epoch AI (CC BY 4.0), LiveBench and the other sources named above.