SUDOKU BENCHMARK · REASONING MEDIUM

Gemini 4 Hydrogen

Google · released 2026-11-12 · route gemini-4-hydrogen · Model profile · Chess results

Results

Score
9595%: 86 to 100
Grids solved
40 of 42
Blank cells filled correctly
95.2%
Wrong cells / empty cells / changed a given / no grid
0 / 2 / 0 / 0
Broke the rules (complete grid repeating a digit)
0
Near misses (three cells or fewer wrong)
0
Average stated confidence
95%
Average confidence when it had not solved it
0%
Sure but wrong (90% or more, unsolved)
0
Calibration (Brier, lower is better)
0.000
API-equivalent cost per grid
$0.185
API-equivalent cost per solved grid
$0.195
Seconds per grid
102
Tokens per grid (in / out)
2,808 / 24,155
Reasoning tokens per grid
24,019
Retries for an unreadable reply
0
Aborted on our side (not counted)
0

By tier

TierNeedsSolvedOutput tokensSeconds
CozySingles only6 of 69,93442
GentleScanning6 of 618,76777
SteadyLocked candidates5 of 621,67796
TrickyHidden pairs and triples6 of 632,812135
DeviousWings and fish5 of 616,70770
ExpertDeep wings and fish6 of 627,012113
BeyondNo human technique finishes it6 of 642,175177

Cells by the technique they needed

Each blank cell is tagged with the simplest technique that fills it, given everything a solver could fill before it.

TechniqueCellsFilled correctly
Last free cell43298.4%
Scanning67496.1%
Locked candidates27486.9%
Hidden pairs and triples258100.0%
Wings and fish16576.4%
Deep wings and fish181100.0%
Search249100.0%

Every answer

Cozy #1Solved 50 of 50 cells100% sure · 12,618 tokens · $0.099Cozy #2Solved 48 of 48 cells100% sure · 7,694 tokens · $0.062Cozy #3Solved 49 of 49 cells100% sure · 12,866 tokens · $0.101Cozy #4Solved 50 of 50 cells100% sure · 11,197 tokens · $0.088Cozy #5Solved 49 of 49 cells100% sure · 8,632 tokens · $0.069Cozy #6Solved 39 of 39 cells100% sure · 6,597 tokens · $0.054Gentle #1Solved 56 of 56 cells100% sure · 21,118 tokens · $0.163Gentle #2Solved 51 of 51 cells100% sure · 15,145 tokens · $0.118Gentle #3Solved 52 of 52 cells100% sure · 15,359 tokens · $0.119Gentle #4Solved 51 of 51 cells100% sure · 13,239 tokens · $0.104Gentle #5Solved 56 of 56 cells100% sure · 28,812 tokens · $0.220Gentle #6Solved 52 of 52 cells100% sure · 18,928 tokens · $0.146Steady #1Left cells empty 0 of 53 cells0% sure · 16,411 tokens · $0.127Steady #2Solved 53 of 53 cells100% sure · 19,205 tokens · $0.148Steady #3Solved 49 of 49 cells100% sure · 22,513 tokens · $0.173Steady #4Solved 54 of 54 cells100% sure · 26,683 tokens · $0.204Steady #5Solved 53 of 53 cells100% sure · 22,055 tokens · $0.170Steady #6Solved 54 of 54 cells100% sure · 23,196 tokens · $0.178Tricky #1Solved 55 of 55 cells100% sure · 21,929 tokens · $0.169Tricky #2Solved 57 of 57 cells100% sure · 53,779 tokens · $0.408Tricky #3Solved 57 of 57 cells100% sure · 31,565 tokens · $0.241Tricky #4Solved 54 of 54 cells100% sure · 30,079 tokens · $0.230Tricky #5Solved 55 of 55 cells100% sure · 21,447 tokens · $0.165Tricky #6Solved 56 of 56 cells100% sure · 38,071 tokens · $0.290Devious #1Solved 55 of 55 cells100% sure · 24,482 tokens · $0.188Devious #2Left cells empty 0 of 55 cells0% sure · 3,562 tokens · $0.031Devious #3Solved 49 of 49 cells100% sure · 20,535 tokens · $0.158Devious #4Solved 40 of 40 cells100% sure · 10,539 tokens · $0.083Devious #5Solved 47 of 47 cells100% sure · 17,402 tokens · $0.135Devious #6Solved 54 of 54 cells100% sure · 23,722 tokens · $0.182Expert #1Solved 58 of 58 cells100% sure · 38,606 tokens · $0.294Expert #2Solved 53 of 53 cells100% sure · 34,110 tokens · $0.260Expert #3Solved 54 of 54 cells100% sure · 18,679 tokens · $0.144Expert #4Solved 57 of 57 cells100% sure · 29,193 tokens · $0.223Expert #5Solved 58 of 58 cells100% sure · 21,092 tokens · $0.162Expert #6Solved 54 of 54 cells100% sure · 20,392 tokens · $0.157Beyond #1Solved 60 of 60 cells100% sure · 49,731 tokens · $0.377Beyond #2Solved 57 of 57 cells100% sure · 38,506 tokens · $0.293Beyond #3Solved 56 of 56 cells100% sure · 59,153 tokens · $0.448Beyond #4Solved 57 of 57 cells100% sure · 23,249 tokens · $0.179Beyond #5Solved 59 of 59 cells100% sure · 41,037 tokens · $0.312Beyond #6Solved 57 of 57 cells100% sure · 41,375 tokens · $0.315