# SimpleQA Verified

> SimpleQA Verified results for 30 AI models we list, run by Epoch AI, with each result's setting, date and source.

- Canonical: https://www.anchorterminal.com/benchmarks/simpleqa-verified/
- Markdown: https://www.anchorterminal.com/benchmarks/simpleqa-verified/index.md (~3,100 tokens)
- Slim: https://www.anchorterminal.com/benchmarks/simpleqa-verified/index.min.md (~2,980 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/benchmarks/simpleqa-verified/index.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (the key docs and every listing in one file, at most 16 MB, about 4 million tokens: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- MCP: https://www.anchorterminal.com/mcp (the whole catalogue as tools, no key)
- DNS: dig +short TXT <slug>.grade.anchorterminal.com (the grade as a DNS TXT record, for a sandbox with no HTTP where names still resolve; also top., best.<category>. and <a>.vs.<b>. under the zone, and the same under grade.letme.dev)
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)
- Updated: 2026-11-21

1,000 short factual questions with no answer choices, made by Google from OpenAI's SimpleQA. Epoch AI asks the model to guess rather than abstain, has a grader model mark each answer and reports the share answered correctly, not Google's F1 score.

- Score: % of questions correct, higher is better
- Run by: Epoch AI
- Status: Current, newest result 19 November 2026
- Updated: as models are released
- Data: https://epoch.ai/data/benchmark_data.zip (CC BY 4.0, https://epoch.ai/benchmarks/use-this-data), read 2026-11-20
- Method: https://epoch.ai/benchmarks/simple-qa-verified

## Results

30 models we list, each at its best setting, best first.

| # | Model | Score | Range | Who ran it | Setting | Date | Source |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | [Claude Fable 5.2](https://www.anchorterminal.com/tools/claude-fable-5-2.md) | 94.0% |  | Independent | effort max | 2026-11-06 | https://epoch.ai/benchmarks/use-this-data |
| 2 | [GPT-6.2 Astra](https://www.anchorterminal.com/tools/gpt-6-2-astra.md) | 78.5% |  | Independent | effort max | 2026-10-27 | https://epoch.ai/benchmarks/use-this-data |
| 3 | [Gemini 4 Carbon](https://www.anchorterminal.com/tools/gemini-4-carbon.md) | 77.7% |  | Independent | effort high | 2026-11-02 | https://epoch.ai/benchmarks/use-this-data |
| 4 | [Gemini 4 Argon](https://www.anchorterminal.com/tools/gemini-4-argon.md) | 76.0% |  | Independent | effort high | 2026-10-13 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2Fiq4Y9tXpiyLP25yotySxJW.eval |
| 5 | [GPT-6 Astra](https://www.anchorterminal.com/tools/azure-openai.md) | 75.6% |  | Independent | effort max | 2026-08-30 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FPppwnX7EjXx2SeTcFN8Ujn.eval |
| 6 | [Gemini 4 Neon](https://www.anchorterminal.com/tools/gemini-4-neon.md) | 75.2% |  | Independent | effort xhigh | 2026-11-19 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FoNv3qiZwkezTmFHngNKsne.eval |
| 7 | [GPT-6.1 Sol](https://www.anchorterminal.com/tools/openai-api.md) | 73.9% |  | Independent | effort max | 2026-09-29 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdfT5VD7cQug8XW6GQHyJUF.eval |
| 8 | [Gemini 3.1 Pro (preview)](https://www.anchorterminal.com/tools/vertex-ai.md) | 73.5% |  | Independent | effort high | 2026-08-10 | https://epoch.ai/benchmarks/use-this-data |
| 9 | [Claude Opus 5.5](https://www.anchorterminal.com/tools/anthropic-api.md) | 72.2% |  | Independent | effort max | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FCgLfiGcNwMPVzxr8GdNUAK.eval |
| 10 | [Gemini 4 Hydrogen](https://www.anchorterminal.com/tools/gemini-4-hydrogen.md) | 70.9% |  | Independent | effort xhigh | 2026-11-13 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FBTWvEjbekh8TC7kWurJnrR.eval |
| 11 | [Claude Fable 5.1](https://www.anchorterminal.com/tools/anthropic-api.md) | 70.8% |  | Independent | effort max | 2026-09-01 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FExyL3GN8s34tizrXV3VmS3.eval |
| 12 | [Gemini 3.8 Flash](https://www.anchorterminal.com/tools/vertex-ai.md) | 69.7% |  | Independent | effort high | 2026-09-02 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FgZ4bwozTKtpmZTqnqX3a33.eval |
| 13 | [Kimi K3.1 Pro](https://www.anchorterminal.com/tools/kimi-k3-1-pro.md) | 62.2% |  | Independent | effort max | 2026-11-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FHumfsXVh5BZWuTo6Z8Gqnf.eval |
| 14 | [GPT-6 Sol](https://www.anchorterminal.com/tools/azure-openai.md) | 60.7% |  | Independent | effort max | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdonMeEKBZZdqpQsojKWJEm.eval |
| 15 | [GPT-6.1 Terra](https://www.anchorterminal.com/tools/openai-api.md) | 57.3% |  | Independent | effort max | 2026-10-26 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FBixeio8A6SejZtUzFXFSXK.eval |
| 16 | [Muse Spark Open](https://www.anchorterminal.com/tools/muse-spark-open.md) | 56.6% |  | Independent | effort xhigh | 2026-10-15 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdNuxLdV4DWqfSvtTq6NnK8.eval |
| 17 | [Grok 4.7](https://www.anchorterminal.com/tools/xai-api.md) | 56.0% |  | Independent | effort xhigh | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F6izDCw5ygCLZJEKPS8jV5T.eval |
| 18 | [Kimi K3](https://www.anchorterminal.com/tools/kimi-k3.md) | 50.6% |  | Independent | effort max | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FmZLWt2JSYvJyGhMvji7CT8.eval |
| 19 | [DeepSeek V4 Pro](https://www.anchorterminal.com/tools/deepseek-api.md) | 47.0% |  | Independent | effort max | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FSq9xqkVTmFvELpQy9KH5TM.eval |
| 20 | [Claude Sonnet 5.5](https://www.anchorterminal.com/tools/anthropic-api.md) | 46.5% |  | Independent | effort max | 2026-09-29 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FGtJ5yd3ZPQ7HVcm6Q9ssQz.eval |
| 21 | [DeepSeek V4.1 Flash](https://www.anchorterminal.com/tools/deepseek-v4-1-flash.md) | 42.9% |  | Independent | effort max | 2026-10-13 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F3JJ4ChNxMo8CGAh3HrKNrw.eval |
| 22 | [GPT-6 Luna](https://www.anchorterminal.com/tools/azure-openai.md) | 41.4% |  | Independent | effort max | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FHX9sRVWJtZiNvneALnVzs8.eval |
| 23 | [GLM-5.3](https://www.anchorterminal.com/tools/glm-5-3.md) | 41.0% |  | Independent | effort max | 2026-08-28 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FTY8R8FV7zCwByEipkqyg2P.eval |
| 24 | [Inkling](https://www.anchorterminal.com/tools/inkling.md) | 40.3% |  | Independent | effort xhigh | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbpnzC6CCi3hWuKCfqX4KEY.eval |
| 25 | [DeepSeek-V4-Flash-0731](https://www.anchorterminal.com/tools/deepseek-v4-flash-0731.md) | 33.6% |  | Independent | effort max | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FTqFmiGvqozt7TSZYmhgF8m.eval |
| 26 | [Grok 4.3](https://www.anchorterminal.com/tools/xai-api.md) | 33.2% |  | Independent | effort high | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FY39ZRp553ULpUDBV2XrBbc.eval |
| 27 | [Claude Haiku 5.5](https://www.anchorterminal.com/tools/anthropic-api.md) | 23.8% |  | Independent | effort max | 2026-10-09 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FNwnrUMtveqHDYB2Um4ycmA.eval |
| 28 | [Mistral Large 4](https://www.anchorterminal.com/tools/mistral-large-4.md) | 22.4% |  | Independent | effort high | 2026-11-02 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FJYSfRXRddi6hYzpnSD3G7V.eval |
| 29 | [Inkling-Small](https://www.anchorterminal.com/tools/inkling-small.md) | 19.1% |  | Independent | effort xhigh | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FeJfbDKqeg9kNXFoxpeV7HG.eval |
| 30 | [Gemma 4 31B IT](https://www.anchorterminal.com/tools/gemma-4-31b-it.md) | 10.4% |  | Independent |  | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FD5cbXacPnJ8akq2jAtifEQ.eval |

Every setting, 31 rows:

| Model | As named | Score | Who ran it | Setting | Date |
| --- | --- | --- | --- | --- | --- |
| Claude Fable 5.2 | claude-fable-5-2 | 94.0% | Independent | effort max | 2026-11-06 |
| GPT-6.2 Astra | gpt-6.2-astra | 78.5% | Independent | effort max | 2026-10-27 |
| Gemini 4 Carbon | gemini-4-carbon | 77.7% | Independent | effort high | 2026-11-02 |
| Gemini 4 Argon | gemini-4-argon | 76.0% | Independent | effort high | 2026-10-13 |
| GPT-6 Astra | gpt-6-astra | 75.6% | Independent | effort max | 2026-08-30 |
| Gemini 4 Neon | gemini-4-neon | 75.2% | Independent | effort xhigh | 2026-11-19 |
| GPT-6.1 Sol | gpt-6.1-sol | 73.9% | Independent | effort max | 2026-09-29 |
| Gemini 3.1 Pro (preview) | gemini-3.1-pro-preview | 73.5% | Independent | effort high | 2026-08-10 |
| Claude Opus 5.5 | claude-opus-5-5 | 72.2% | Independent | effort max | 2026-09-22 |
| Gemini 4 Hydrogen | gemini-4-hydrogen | 70.9% | Independent | effort xhigh | 2026-11-13 |
| Claude Fable 5.1 | claude-fable-5-1 | 70.8% | Independent | effort max | 2026-09-01 |
| Gemini 3.8 Flash | gemini-3.8-flash | 69.7% | Independent | effort high | 2026-09-02 |
| Kimi K3.1 Pro | kimi-k3.1-pro-together | 62.2% | Independent | effort max | 2026-11-06 |
| GPT-6 Sol | gpt-6-sol | 60.7% | Independent | effort max | 2026-09-22 |
| GPT-6.1 Terra | gpt-6.1-terra | 57.3% | Independent | effort max | 2026-10-26 |
| Muse Spark Open | Muse-Spark-Open-816B-A42B | 56.6% | Independent | effort xhigh | 2026-10-15 |
| Grok 4.7 | grok-4.7 | 56.0% | Independent | effort xhigh | 2026-09-22 |
| Kimi K3 | kimi-k3 | 50.6% | Independent | effort max | 2026-08-27 |
| DeepSeek V4 Pro | deepseek-v4-pro | 47.0% | Independent | effort max | 2026-08-27 |
| Claude Sonnet 5.5 | claude-sonnet-5-5 | 46.5% | Independent | effort max | 2026-09-29 |
| DeepSeek V4.1 Flash | deepseek-v4.1-flash | 42.9% | Independent | effort max | 2026-10-13 |
| DeepSeek V4.1 Flash | deepseek-v4.1-flash-1017 | 42.5% | Independent | effort max | 2026-10-19 |
| GPT-6 Luna | gpt-6-luna | 41.4% | Independent | effort max | 2026-09-22 |
| GLM-5.3 | glm-5.3 | 41.0% | Independent | effort max | 2026-08-28 |
| Inkling | Inkling | 40.3% | Independent | effort xhigh | 2026-08-27 |
| DeepSeek-V4-Flash-0731 | deepseek-v4-flash-0731 | 33.6% | Independent | effort max | 2026-08-27 |
| Grok 4.3 | grok-4.3 | 33.2% | Independent | effort high | 2026-08-27 |
| Claude Haiku 5.5 | claude-haiku-5-5 | 23.8% | Independent | effort max | 2026-10-09 |
| Mistral Large 4 | mistral-large-4-0-oss | 22.4% | Independent | effort high | 2026-11-02 |
| Inkling-Small | inkling-small | 19.1% | Independent | effort xhigh | 2026-08-27 |
| Gemma 4 31B IT | gemma-4-31b-it | 10.4% | Independent |  | 2026-08-27 |

A rank is among the models we list with a result, not a place on the whole leaderboard, and a model offered by several hosts is shown once, on its own listing. These results don't move our grades.

Data: Epoch AI, Capabilities and benchmarking (CC BY 4.0), CC BY 4.0. All benchmarks: https://www.anchorterminal.com/benchmarks/index.md

---

Query this catalogue directly over MCP: https://www.anchorterminal.com/mcp (Streamable HTTP, no key). How: https://www.anchorterminal.com/agents/#mcp
