| Rank | Model | Vendor | SWE-bench | Type |
|---|---|---|---|---|
| 🥇 | Claude 4 Opus | Anthropic | 78.3% | Closed |
| 🥈 | GPT-5.5 | OpenAI | 76.1% | Closed |
| 🥉 | o3 | OpenAI | 74.8% | Closed |
| 4 | Gemini 3.1 | 72.5% | Closed | |
| 5 | DeepSeek-V4 | DeepSeek | 70.2% | Open |
| 6 | Claude 4 Sonnet | Anthropic | 68.9% | Closed |
| 7 | ERNIE 5.1 | Baidu | 67.5% | Closed |
| 8 | Qwen3-Max | Alibaba | 66.0% | Closed |
| 9 | GPT-5 | OpenAI | 64.8% | Closed |
| 10 | Gemini 3.0 | 63.2% | Closed | |
| 11 | Kimi-2 | Moonshot | 62.0% | Closed |
| 12 | Llama 4 Maverick | Meta | 60.5% | Open |
| 13 | GLM-5 | Zhipu AI | 59.3% | Closed |
| 14 | Mistral Large 3 | Mistral | 58.0% | Closed |
| 15 | Claude 4 Haiku | Anthropic | 56.5% | Closed |
| 16 | DeepSeek-V3.2 | DeepSeek | 55.0% | Open |
| 17 | Llama 4 Scout | Meta | 53.8% | Open |
| 18 | Yi-3 | 01.AI | 52.5% | Open |
| 19 | Command A | Cohere | 51.0% | Closed |
| 20 | MiniMax-M2.5 | MiniMax | 50.0% | Closed |
Model