# SWE-bench Verified

> SWE-bench Verified results for 1 AI models we list, run by Epoch AI, with each result's setting, date and source.

- Canonical: https://www.anchorterminal.com/benchmarks/swe-bench-verified/
- Markdown: https://www.anchorterminal.com/benchmarks/swe-bench-verified/index.md (~500 tokens)
- Slim: https://www.anchorterminal.com/benchmarks/swe-bench-verified/index.min.md (~430 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/benchmarks/swe-bench-verified/index.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (the key docs and every listing in one file, at most 16 MB, about 4 million tokens: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- MCP: https://www.anchorterminal.com/mcp (the whole catalogue as tools, no key)
- DNS: dig +short TXT <slug>.grade.anchorterminal.com (the grade as a DNS TXT record, for a sandbox with no HTTP where names still resolve; also top., best.<category>. and <a>.vs.<b>. under the zone, and the same under grade.letme.dev)
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)
- Updated: 2026-11-21

A model given a Python repository and a GitHub issue must change the code until the repository's own tests pass. Epoch AI runs 484 of the 500 human-checked issues in its own simple tool-calling scaffold, with no network, after a major scaffold upgrade in February 2026.

- Score: % of issues resolved, higher is better
- Run by: Epoch AI
- Status: Current, newest result 25 June 2026
- Updated: as models are released
- Data: https://epoch.ai/data/benchmark_data.zip (CC BY 4.0, https://epoch.ai/benchmarks/use-this-data), read 2026-11-20
- Method: https://epoch.ai/benchmarks/swe-bench-verified

## Results

1 model we list, each at its best setting, best first.

| # | Model | Score | Range | Who ran it | Setting | Date | Source |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | [DeepSeek V4 Pro](https://www.anchorterminal.com/tools/deepseek-api.md) | 77.6% |  | Independent | effort max | 2026-06-18 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FWUk3f44JhxtAJaSxi6gFZR.eval |

A rank is among the models we list with a result, not a place on the whole leaderboard, and a model offered by several hosts is shown once, on its own listing. These results don't move our grades.

Data: Epoch AI, Capabilities and benchmarking (CC BY 4.0), CC BY 4.0. All benchmarks: https://www.anchorterminal.com/benchmarks/index.md

---

Query this catalogue directly over MCP: https://www.anchorterminal.com/mcp (Streamable HTTP, no key). How: https://www.anchorterminal.com/agents/#mcp
