GPT-6 Sol
Openai · released 2026-09-22 · route gpt-6-sol · Model profile · Chess results · Sudoku results · Mines results · FreeCell results · Starjar results · Nations Royale results · Hustle Sim results · Elemental Armory results · Micro Mouse results
Results
- Score
- 3395%: 12 to 55 · 6 of 36 base puzzles so far
- Puzzles solved
- 2 of 6
- Cells that match the solution
- 26.9%
- Rows and columns whose clue it satisfies
- 18.9%
- Wrong cells / left cells unknown / no grid
- 0 / 4 / 0
- Near misses (three cells or fewer wrong)
- 0
- Average stated confidence
- 38%
- Average confidence when it had not solved it
- 6%
- Sure but wrong (90% or more, unsolved)
- 0
- Calibration (Brier, lower is better)
- 0.010
- API-equivalent cost per solved puzzle
- $0.213
- Tokens per puzzle (in / out)
- 29,739 / 5,410
- Reasoning tokens per puzzle
- 4,681
- Retries for an unreadable reply
- 0
- API-equivalent cost per puzzle
- $0.071
- Seconds per puzzle
- 100.1
- Replies cut off at the length limit
- 0.0%
- Aborted on our side (not counted)
- 0
By tier
| Tier | Needs | Solved | Output tokens | Seconds |
|---|---|---|---|---|
| 5 by 5 | Line logic, a round or two | 1 of 1 | 207 | 6.8 |
| 10 by 10 | Line logic, about 3 rounds | 1 of 1 | 5,099 | 99.0 |
| 15 by 15 | Line logic, about 5 rounds | 0 of 1 | 9,381 | 179.1 |
| 20 by 20 | Line logic, about 8 rounds | 0 of 1 | 6,368 | 117.7 |
| 25 by 25 | Line logic, about 11 rounds | 0 of 1 | 7,055 | 117.2 |
| Beyond | Line logic stalls; needs contradiction or search | 0 of 1 | 4,350 | 80.6 |
Cells by the depth of logic they need
Each cell is tagged with the round of line logic that settles it. Beyond line logic means only contradiction or search does.
| Depth | Cells | Right |
|---|---|---|
| First pass | 403 | 78.4% |
| Rounds 2-3 | 613 | 16.8% |
| Rounds 4-7 | 332 | 3.6% |
| Round 8 on | 159 | 0.0% |
| Beyond line logic | 93 | 0.0% |
Every puzzle
5 by 5 #1Solved 25 of 25 cells100% sure · 207 tokens · $0.01110 by 10 #1Solved 100 of 100 cells100% sure · 5,099 tokens · $0.07115 by 15 #1Left cells unknown 79 of 225 cells0% sure · 9,381 tokens · $0.10520 by 20 #1Left cells unknown 91 of 400 cells25% sure · 6,368 tokens · $0.08925 by 25 #1Left cells unknown 105 of 625 cells0% sure · 7,055 tokens · $0.087Beyond #1Left cells unknown 31 of 225 cells0% sure · 4,350 tokens · $0.064