DeepSeek · DeepSeek V4
DeepSeek's larger open-weight text MoE (1.6T total / 49B active, 1M context), GA since the 0813 post-training update, for harder coding and agent work.
Leader: Claude Opus 5.5 at 58
Leader: Claude Mythos 5.1 at 60.9%
Leader: Claude Fable 5.1 at 91.4%
Leader: Claude Opus 5.5 at 66.9%
Leader: Claude Opus 5.5 at 1846
Leader: GPT-6 Astra at 96.1%
Leader: Claude Opus 5.5 at 61.4%
Leader: GPT-5.6 Sol at 32.3%
Leader: Kimi K3 at 88.7%
Leader: Claude Fable 5 at 1506
Leader: Claude Opus 5.5 at 1818
| Result | Score | Reported by | Source |
|---|---|---|---|
| DeepSWE | 62.7% | vendor | DeepSeek-V4-Pro-0813 model card (Hugging Face) ↗ |
| Agents' Last Exam | 25.7% | vendor | DeepSeek-V4-Pro-0813 model card (Hugging Face) ↗ |
| Toolathlon-Verified | 74.1% | vendor | DeepSeek-V4-Pro-0813 model card (Hugging Face) ↗ |
| NL2Repo | 61.5 score | vendor | DeepSeek-V4-Pro-0813 model card (Hugging Face) ↗ |
| CyberGym | 83.3% | vendor | DeepSeek-V4-Pro-0813 model card (Hugging Face) ↗ |
| AutomationBench (Public) | 31.8% | vendor | DeepSeek-V4-Pro-0813 model card (Hugging Face) ↗ |