GPT-6.1 Sol
Openai · released 2026-09-29 · route gpt-6.1-sol · Model profile · Chess results · Sudoku results · Mines results · FreeCell results · Starjar results · Nations Royale results · Wildhaven results · Hustle Sim results · Elemental Armory results · Micro Mouse results
Results
- Score
- 6795%: 45 to 88 · 6 of 36 base puzzles so far
- Puzzles solved
- 4 of 6
- Cells that match the solution
- 78.2%
- Rows and columns whose clue it satisfies
- 65.6%
- Wrong cells / left cells unknown / no grid
- 0 / 2 / 0
- Near misses (three cells or fewer wrong)
- 0
- Average stated confidence
- 80%
- Average confidence when it had not solved it
- 40%
- Sure but wrong (90% or more, unsolved)
- 0
- Calibration (Brier, lower is better)
- 0.107
- API-equivalent cost per solved puzzle
- $0.184
- Tokens per puzzle (in / out)
- 19,696 / 10,762
- Reasoning tokens per puzzle
- 10,073
- Retries for an unreadable reply
- 0
- API-equivalent cost per puzzle
- $0.123
- Seconds per puzzle
- 301.0
- Replies cut off at the length limit
- 0.0%
- Aborted on our side (not counted)
- 0
By tier
| Tier | Needs | Solved | Output tokens | Seconds |
|---|---|---|---|---|
| 5 by 5 | Line logic, a round or two | 1 of 1 | 146 | 5.4 |
| 10 by 10 | Line logic, about 3 rounds | 1 of 1 | 2,342 | 68.5 |
| 15 by 15 | Line logic, about 5 rounds | 1 of 1 | 8,474 | 246.9 |
| 20 by 20 | Line logic, about 8 rounds | 1 of 1 | 17,473 | 497.6 |
| 25 by 25 | Line logic, about 11 rounds | 0 of 1 | 30,687 | 827.4 |
| Beyond | Line logic stalls; needs contradiction or search | 0 of 1 | 5,453 | 160.4 |
Cells by the depth of logic they need
Each cell is tagged with the round of line logic that settles it. Beyond line logic means only contradiction or search does.
| Depth | Cells | Right |
|---|---|---|
| First pass | 403 | 99.0% |
| Rounds 2-3 | 613 | 93.0% |
| Rounds 4-7 | 332 | 78.0% |
| Round 8 on | 159 | 13.8% |
| Beyond line logic | 93 | 1.1% |
Every puzzle
5 by 5 #1Solved 25 of 25 cells100% sure · 146 tokens · $0.01010 by 10 #1Solved 100 of 100 cells100% sure · 2,342 tokens · $0.03415 by 15 #1Solved 225 of 225 cells100% sure · 8,474 tokens · $0.09620 by 20 #1Solved 400 of 400 cells100% sure · 17,473 tokens · $0.21825 by 25 #1Left cells unknown 467 of 625 cells80% sure · 30,687 tokens · $0.318Beyond #1Left cells unknown 34 of 225 cells0% sure · 5,453 tokens · $0.060