Mistral · Devstral
Mistral agentic coding model; API retired 2026-07-31 and replaced by Mistral Medium 3.5 in Vibe.
Leader: Claude Opus 5.5 at 58
Leader: Claude Opus 5.5 at 66.9%
Leader: Claude Mythos 5.1 at 60.9%
Leader: Claude Fable 5.1 at 91.4%
Leader: Fugu at 92.9%
Leader: GPT-6 Astra at 96.1%
Leader: Claude Opus 5.5 at 61.4%
Leader: GPT-5.6 Sol at 32.3%
Leader: Kimi K3 at 88.7%
| Result | Score | Reported by | Source |
|---|---|---|---|
| aime-2025 · AIME 2025; non-reasoning | 36.7% | independent | Artificial Analysis: Devstral 2 ↗ |
| Terminal-Bench Hard (AA) · non-reasoning | 18.9% | independent | Artificial Analysis: Devstral 2 ↗ |
| IFBench · non-reasoning | 38.1% | independent | Artificial Analysis: Devstral 2 ↗ |
| tau2-Bench Banking (AA) · non-reasoning | 10.5% | independent | Artificial Analysis: Devstral 2 ↗ |
| AA-Omniscience Index · non-reasoning | -46.7 index | independent | Artificial Analysis: Devstral 2 ↗ |