SUDOKU BENCHMARK · REASONING MEDIUM

GPT-6.2 Astra

Openai · released 2026-11-17 · route gpt-6.2-astra · Model profile · Chess results

Results

Score
10095%: 91 to 100
Grids solved
42 of 42
Blank cells filled correctly
100.0%
Wrong cells / empty cells / changed a given / no grid
0 / 0 / 0 / 0
Broke the rules (complete grid repeating a digit)
0
Near misses (three cells or fewer wrong)
0
Average stated confidence
100%
Average confidence when it had not solved it
n/a
Sure but wrong (90% or more, unsolved)
0
Calibration (Brier, lower is better)
0.000
API-equivalent cost per grid
$0.199
API-equivalent cost per solved grid
$0.199
Seconds per grid
178
Tokens per grid (in / out)
36,556 / 3,538
Reasoning tokens per grid
3,253
Retries for an unreadable reply
0
Aborted on our side (not counted)
0

By tier

TierNeedsSolvedOutput tokensSeconds
CozySingles only6 of 61,667129
GentleScanning6 of 62,732121
SteadyLocked candidates6 of 62,848147
TrickyHidden pairs and triples6 of 64,659248
DeviousWings and fish6 of 62,780136
ExpertDeep wings and fish6 of 63,558156
BeyondNo human technique finishes it6 of 66,524306

Cells by the technique they needed

Each blank cell is tagged with the simplest technique that fills it, given everything a solver could fill before it.

TechniqueCellsFilled correctly
Last free cell432100.0%
Scanning674100.0%
Locked candidates274100.0%
Hidden pairs and triples258100.0%
Wings and fish165100.0%
Deep wings and fish181100.0%
Search249100.0%

Every answer

Cozy #1Solved 50 of 50 cells100% sure · 1,944 tokens · $0.123Cozy #2Solved 48 of 48 cells100% sure · 1,594 tokens · $0.109Cozy #3Solved 49 of 49 cells100% sure · 2,156 tokens · $0.175Cozy #4Solved 50 of 50 cells100% sure · 1,647 tokens · $0.144Cozy #5Solved 49 of 49 cells100% sure · 1,502 tokens · $0.106Cozy #6Solved 39 of 39 cells100% sure · 1,157 tokens · $0.092Gentle #1Solved 56 of 56 cells100% sure · 3,328 tokens · $0.191Gentle #2Solved 51 of 51 cells100% sure · 2,667 tokens · $0.147Gentle #3Solved 52 of 52 cells100% sure · 2,207 tokens · $0.163Gentle #4Solved 51 of 51 cells100% sure · 2,171 tokens · $0.111Gentle #5Solved 56 of 56 cells100% sure · 3,404 tokens · $0.213Gentle #6Solved 52 of 52 cells100% sure · 2,616 tokens · $0.181Steady #1Solved 53 of 53 cells100% sure · 2,670 tokens · $0.157Steady #2Solved 53 of 53 cells100% sure · 2,856 tokens · $0.139Steady #3Solved 49 of 49 cells100% sure · 2,220 tokens · $0.135Steady #4Solved 54 of 54 cells100% sure · 4,072 tokens · $0.210Steady #5Solved 53 of 53 cells100% sure · 2,283 tokens · $0.138Steady #6Solved 54 of 54 cells100% sure · 2,987 tokens · $0.166Tricky #1Solved 55 of 55 cells100% sure · 2,821 tokens · $0.136Tricky #2Solved 57 of 57 cells100% sure · 10,081 tokens · $0.517Tricky #3Solved 57 of 57 cells100% sure · 2,971 tokens · $0.226Tricky #4Solved 54 of 54 cells100% sure · 3,370 tokens · $0.190Tricky #5Solved 55 of 55 cells100% sure · 3,343 tokens · $0.180Tricky #6Solved 56 of 56 cells100% sure · 5,368 tokens · $0.331Devious #1Solved 55 of 55 cells100% sure · 2,719 tokens · $0.154Devious #2Solved 55 of 55 cells100% sure · 3,556 tokens · $0.165Devious #3Solved 49 of 49 cells100% sure · 2,604 tokens · $0.149Devious #4Solved 40 of 40 cells100% sure · 1,771 tokens · $0.116Devious #5Solved 47 of 47 cells100% sure · 2,466 tokens · $0.144Devious #6Solved 54 of 54 cells100% sure · 3,561 tokens · $0.165Expert #1Solved 58 of 58 cells100% sure · 4,994 tokens · $0.272Expert #2Solved 53 of 53 cells100% sure · 2,252 tokens · $0.183Expert #3Solved 54 of 54 cells100% sure · 3,080 tokens · $0.191Expert #4Solved 57 of 57 cells100% sure · 3,973 tokens · $0.198Expert #5Solved 58 of 58 cells100% sure · 3,705 tokens · $0.170Expert #6Solved 54 of 54 cells100% sure · 3,344 tokens · $0.179Beyond #1Solved 60 of 60 cells100% sure · 7,139 tokens · $0.350Beyond #2Solved 57 of 57 cells100% sure · 7,608 tokens · $0.378Beyond #3Solved 56 of 56 cells100% sure · 8,065 tokens · $0.394Beyond #4Solved 57 of 57 cells100% sure · 5,098 tokens · $0.288Beyond #5Solved 59 of 59 cells100% sure · 5,055 tokens · $0.265Beyond #6Solved 57 of 57 cells100% sure · 6,181 tokens · $0.298