Gemma 3 4B
Google · open weights · released 2025-03-12 · route gemma3:4b · Model profile · Chess results
Results
- Score
- 095%: 0 to 16 · 15 of 42 grids so far
- Grids solved
- 0 of 15
- Blank cells filled correctly
- 9.6%
- Wrong cells / empty cells / changed a given / no grid
- 0 / 0 / 13 / 2
- Broke the rules (complete grid repeating a digit)
- 0
- Near misses (three cells or fewer wrong)
- 0
- Average stated confidence
- 96%
- Average confidence when it had not solved it
- 96%
- Sure but wrong (90% or more, unsolved)
- 15
- Calibration (Brier, lower is better)
- 0.913
- API-equivalent cost per grid
- n/a
- API-equivalent cost per solved grid
- n/a
- Seconds per grid
- 20
- Tokens per grid (in / out)
- 390 / 172
- Reasoning tokens per grid
- n/a
- Retries for an unreadable reply
- 2
- Aborted on our side (not counted)
- 0
By tier
| Tier | Needs | Solved | Output tokens | Seconds |
|---|---|---|---|---|
| Cozy | Singles only | 0 of 3 | 148 | 20 |
| Gentle | Scanning | 0 of 2 | 256 | 13 |
| Steady | Locked candidates | 0 of 2 | 176 | 15 |
| Tricky | Hidden pairs and triples | 0 of 2 | 204 | 30 |
| Devious | Wings and fish | 0 of 2 | 139 | 13 |
| Expert | Deep wings and fish | 0 of 2 | 154 | 28 |
| Beyond | No human technique finishes it | 0 of 2 | 139 | 19 |
Cells by the technique they needed
Each blank cell is tagged with the simplest technique that fills it, given everything a solver could fill before it.
| Technique | Cells | Filled correctly |
|---|---|---|
| Last free cell | 169 | 16.0% |
| Scanning | 192 | 12.0% |
| Locked candidates | 88 | 4.5% |
| Hidden pairs and triples | 52 | 13.5% |
| Wings and fish | 63 | 6.3% |
| Deep wings and fish | 54 | 13.0% |
| Search | 81 | 7.4% |
Every answer
Cozy #1Changed a given digit 4 of 50 cells95% sure · 142 tokens · localCozy #2Changed a given digit 6 of 48 cells95% sure · 161 tokens · localCozy #3Changed a given digit 12 of 49 cells95% sure · 140 tokens · localGentle #1No readable grid 0 of 56 cells99% sure · 295 tokens · localGentle #2Changed a given digit 8 of 51 cells95% sure · 217 tokens · localSteady #1Changed a given digit 2 of 53 cells95% sure · 133 tokens · localSteady #2Changed a given digit 5 of 53 cells95% sure · 219 tokens · localTricky #1No readable grid 0 of 55 cells99% sure · 259 tokens · localTricky #2Changed a given digit 6 of 57 cells95% sure · 150 tokens · localDevious #1Changed a given digit 6 of 55 cells95% sure · 132 tokens · localDevious #2Changed a given digit 5 of 55 cells95% sure · 146 tokens · localExpert #1Changed a given digit 7 of 58 cells95% sure · 149 tokens · localExpert #2Changed a given digit 6 of 53 cells95% sure · 158 tokens · localBeyond #1Changed a given digit 7 of 60 cells95% sure · 127 tokens · localBeyond #2Changed a given digit 4 of 57 cells95% sure · 151 tokens · local