NONOGRAMS BENCHMARK · REASONING MEDIUM

GPT-6.2 Astra

Openai · released 2026-11-17 · route gpt-6.2-astra · Model profile · Chess results · Sudoku results · Mines results · FreeCell results · Starjar results · Nations Royale results · Wildhaven results · Hustle Sim results · Elemental Armory results · Micro Mouse results · Ravelin results

Results

Score
6995%: 58 to 80
Puzzles solved
25 of 36
Cells that match the solution
69.3%
Rows and columns whose clue it satisfies
61.8%
Wrong cells / left cells unknown / no grid
0 / 11 / 0
Near misses (three cells or fewer wrong)
0
Average stated confidence
69%
Average confidence when it had not solved it
0%
Sure but wrong (90% or more, unsolved)
0
Calibration (Brier, lower is better)
0.000
API-equivalent cost per solved puzzle
$0.361
Tokens per puzzle (in / out)
48,993 / 4,408
Reasoning tokens per puzzle
3,832
Retries for an unreadable reply
0
API-equivalent cost per puzzle
$0.251
Seconds per puzzle
230.2
Replies cut off at the length limit
0.0%
Aborted on our side (not counted)
0

By tier

TierNeedsSolvedOutput tokensSeconds
5 by 5Line logic, a round or two6 of 6837.6
10 by 10Line logic, about 3 rounds6 of 61,06082.0
15 by 15Line logic, about 5 rounds6 of 62,696131.0
20 by 20Line logic, about 8 rounds5 of 66,696402.7
25 by 25Line logic, about 11 rounds1 of 610,991531.3
BeyondLine logic stalls; needs contradiction or search1 of 64,923226.3

Cells by the depth of logic they need

Each cell is tagged with the round of line logic that settles it. Beyond line logic means only contradiction or search does.

DepthCellsRight
First pass2,46398.6%
Rounds 2-33,52092.2%
Rounds 4-71,61150.0%
Round 8 on1,0111.3%
Beyond line logic99516.0%

Every puzzle

5 by 5 #1Solved 25 of 25 cells100% sure · 63 tokens · $0.0375 by 5 #2Solved 25 of 25 cells100% sure · 60 tokens · $0.0375 by 5 #3Solved 25 of 25 cells100% sure · 67 tokens · $0.0375 by 5 #4Solved 25 of 25 cells100% sure · 59 tokens · $0.0135 by 5 #5Solved 25 of 25 cells100% sure · 74 tokens · $0.0135 by 5 #6Solved 25 of 25 cells100% sure · 176 tokens · $0.04210 by 10 #1Solved 100 of 100 cells100% sure · 1,223 tokens · $0.09510 by 10 #2Solved 100 of 100 cells100% sure · 1,319 tokens · $0.09510 by 10 #3Solved 100 of 100 cells100% sure · 1,094 tokens · $0.09010 by 10 #4Solved 100 of 100 cells100% sure · 835 tokens · $0.08010 by 10 #5Solved 100 of 100 cells100% sure · 589 tokens · $0.06510 by 10 #6Solved 100 of 100 cells100% sure · 1,298 tokens · $0.07415 by 15 #1Solved 225 of 225 cells100% sure · 3,241 tokens · $0.15515 by 15 #2Solved 225 of 225 cells100% sure · 2,609 tokens · $0.15415 by 15 #3Solved 225 of 225 cells100% sure · 2,692 tokens · $0.15815 by 15 #4Solved 225 of 225 cells100% sure · 2,401 tokens · $0.15615 by 15 #5Solved 225 of 225 cells100% sure · 2,757 tokens · $0.16815 by 15 #6Solved 225 of 225 cells100% sure · 2,474 tokens · $0.20720 by 20 #1Left cells unknown 193 of 400 cells0% sure · 6,037 tokens · $0.34520 by 20 #2Solved 400 of 400 cells100% sure · 7,390 tokens · $0.42220 by 20 #3Solved 400 of 400 cells100% sure · 7,680 tokens · $0.39020 by 20 #4Solved 400 of 400 cells100% sure · 6,927 tokens · $0.35620 by 20 #5Solved 400 of 400 cells100% sure · 7,583 tokens · $0.34920 by 20 #6Solved 400 of 400 cells100% sure · 4,557 tokens · $0.28025 by 25 #1Left cells unknown 249 of 625 cells0% sure · 6,626 tokens · $0.33625 by 25 #2Left cells unknown 142 of 625 cells0% sure · 6,996 tokens · $0.40025 by 25 #3Left cells unknown 173 of 625 cells0% sure · 10,593 tokens · $0.54925 by 25 #4Solved 625 of 625 cells99% sure · 16,133 tokens · $0.76225 by 25 #5Left cells unknown 294 of 625 cells0% sure · 10,940 tokens · $0.64125 by 25 #6Left cells unknown 383 of 625 cells0% sure · 14,657 tokens · $0.833Beyond #1Solved 225 of 225 cells100% sure · 6,862 tokens · $0.386Beyond #2Left cells unknown 83 of 225 cells0% sure · 5,564 tokens · $0.324Beyond #3Left cells unknown 20 of 225 cells0% sure · 3,407 tokens · $0.170Beyond #4Left cells unknown 44 of 225 cells0% sure · 3,486 tokens · $0.254Beyond #5Left cells unknown 20 of 225 cells0% sure · 3,320 tokens · $0.190Beyond #6Left cells unknown 101 of 225 cells0% sure · 6,898 tokens · $0.375