New results: Muse Ember and Kimi K3.1 Pro
Added Muse Ember and Kimi K3.1 Pro. Best of them: Muse Ember high, 67.2%.
Added
| Model · effort | Score | Tokens per task | Seconds per task | Cost per test |
|---|---|---|---|---|
| Muse Ember · high | 67.2% | 7,614 | 20.7 | $0.0038 |
| Muse Ember · medium | 62.0% | 5,090 | 10.7 | $0.0026 |
| Muse Ember · low | 60.8% | 3,352 | 7.5 | $0.0017 |
| Kimi K3.1 Pro · high | 60.3% | 1,656 | 42.5 | $0.0175 |
| Kimi K3.1 Pro · low | 42.8% | 494 | 6.3 | $0.0058 |
| Kimi K3.1 Pro · medium | 42.8% | 446 | 5.9 | $0.0053 |