Qwen3.5 9B
Alibaba · open weights · released 2026-02-23 · route qwen3.5:9b · Model profile · Chess results · Sudoku results · Mines results · FreeCell results · Starjar results · Nations Royale results · Wildhaven results · Hustle Sim results · Elemental Armory results · Micro Mouse results · Ravelin results · Minecraft results
Results
- Score
- 095%: 0 to 22 · 6 of 36 base puzzles so far
- Puzzles solved
- 0 of 6
- Cells that match the solution
- 1.4%
- Rows and columns whose clue it satisfies
- 4.4%
- Wrong cells / left cells unknown / no grid
- 1 / 0 / 5
- Near misses (three cells or fewer wrong)
- 1
- Average stated confidence
- 98%
- Average confidence when it had not solved it
- 98%
- Sure but wrong (90% or more, unsolved)
- 2
- Calibration (Brier, lower is better)
- 0.951
- API-equivalent cost per solved puzzle
- n/a
- Tokens per puzzle (in / out)
- 2,165 / 2,558
- Reasoning tokens per puzzle
- n/a
- Retries for an unreadable reply
- 6
- API-equivalent cost per puzzle
- n/a
- Seconds per puzzle
- 255.4
- Replies cut off at the length limit
- 83.3%
- Aborted on our side (not counted)
- 0
By tier
| Tier | Needs | Solved | Output tokens | Seconds |
|---|---|---|---|---|
| 5 by 5 | Line logic, a round or two | 0 of 1 | 1,535 | 67.8 |
| 10 by 10 | Line logic, about 3 rounds | 0 of 1 | 3,000 | 363.1 |
| 15 by 15 | Line logic, about 5 rounds | 0 of 1 | 3,000 | 267.2 |
| 20 by 20 | Line logic, about 8 rounds | 0 of 1 | 3,000 | 401.3 |
| 25 by 25 | Line logic, about 11 rounds | 0 of 1 | 1,813 | 164.8 |
| Beyond | Line logic stalls; needs contradiction or search | 0 of 1 | 3,000 | 268.1 |
Cells by the depth of logic they need
Each cell is tagged with the round of line logic that settles it. Beyond line logic means only contradiction or search does.
| Depth | Cells | Right |
|---|---|---|
| First pass | 403 | 3.5% |
| Rounds 2-3 | 613 | 1.5% |
| Rounds 4-7 | 332 | 0.0% |
| Round 8 on | 159 | 0.0% |
| Beyond line logic | 93 | 0.0% |
Every puzzle
5 by 5 #1Wrong cells 23 of 25 cells100% sure · 1,535 tokens · local10 by 10 #1No readable grid 0 of 100 cells3,000 tokens · local15 by 15 #1No readable grid 0 of 225 cells3,000 tokens · local20 by 20 #1No readable grid 0 of 400 cells3,000 tokens · local25 by 25 #1No readable grid 0 of 625 cells95% sure · 1,813 tokens · localBeyond #1No readable grid 0 of 225 cells3,000 tokens · local