New results: Fable 5.2, Muse Wonder, Nemotron 3 Ultra and Nemotron 3.5 Super VL
Added Fable 5.2, Muse Wonder, Nemotron 3 Ultra and Nemotron 3.5 Super VL. Best of them: Fable 5.2 high, 75.8%. Opus 5.5 was run again.
Added
| Model · effort | Score | Tokens per task | Seconds per task | Cost per test |
|---|---|---|---|---|
| Fable 5.2 · high | 75.8% | 798 | 9.9 | $0.0372 |
| Muse Wonder · high | 74.8% | 7,284 | 66.1 | $0.1468 |
| Muse Wonder · medium | 73.9% | 5,352 | 47.7 | $0.1082 |
| Fable 5.2 · medium | 73.3% | 509 | 7.1 | $0.0265 |
| Fable 5.2 · low | 72.5% | 474 | 6.8 | $0.0353 |
| Muse Wonder · low | 68.3% | 3,289 | 29.5 | $0.0669 |
| Nemotron 3 Ultra · medium | 50.0% | 8,496 | 77.5 | $0.0206 |
| Nemotron 3 Ultra · high | 47.8% | 8,710 | 77.8 | $0.0211 |
| Nemotron 3 Ultra · low | 47.8% | 8,902 | 79.5 | $0.0215 |
| Nemotron 3.5 Super VL · off | 26.4% | 5,380 | 24.1 | $0.0027 |
Run again
The page shows the average of all runs; these are the newest run against the average before it.
| Model · effort | Score | Tokens per task |
|---|---|---|
| Opus 5.5 · high | 71.4% → 68.0% | 636 → 552 |
| Opus 5.5 · low | 65.1% → 65.0% | 322 → 319 |
| Opus 5.5 · medium | 67.8% → 68.3% | 503 → 472 |