{
  "data": {
    "area": "reasoning",
    "attribution": "Epoch AI, Capabilities and benchmarking (CC BY 4.0)",
    "cadence": "as models are released",
    "categories": [
      "inference",
      "open-weights"
    ],
    "ceiling": 100,
    "competitor": "",
    "data": "https://epoch.ai/data/benchmark_data.zip",
    "direction": "higher",
    "floor": 0,
    "json": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/index.json",
    "licence": "CC BY 4.0",
    "licenceUrl": "https://epoch.ai/benchmarks/use-this-data",
    "measures": "Multiple-choice questions in biology, chemistry and physics written by PhD-level experts and hard for non-experts to answer even with the web; the Diamond subset is 198 questions. Epoch AI asks zero-shot with chain of thought and scores an answer only in its required format.",
    "method": "https://epoch.ai/benchmarks/gpqa-diamond",
    "models": 45,
    "name": "GPQA Diamond",
    "newest": "2026-11-19",
    "page": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/",
    "read": "2026-11-20",
    "results": 63,
    "runBy": "Epoch AI",
    "saturated": true,
    "slug": "gpqa-diamond",
    "status": "current",
    "unit": "% of questions correct",
    "versions": [
      {
        "rows": [
          {
            "as": "gpt-6.2-astra",
            "date": "2026-10-27",
            "listing": "gpt-6-2-astra",
            "model": "gpt-6-2-astra",
            "name": "GPT-6.2 Astra",
            "of": 45,
            "rank": 1,
            "runBy": "Epoch AI",
            "score": 96.84,
            "setting": {
              "effort": "max"
            },
            "tier": "independent"
          },
          {
            "as": "gemini-4-hydrogen",
            "date": "2026-11-13",
            "listing": "gemini-4-hydrogen",
            "model": "gemini-4-hydrogen",
            "name": "Gemini 4 Hydrogen",
            "of": 45,
            "rank": 2,
            "runBy": "Epoch AI",
            "score": 96.78,
            "setting": {
              "effort": "xhigh"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FXRQWGQeJDNvVcvSYCn247P.eval"
          },
          {
            "as": "gemini-4-carbon",
            "date": "2026-11-02",
            "listing": "gemini-4-carbon",
            "model": "gemini-4-carbon",
            "name": "Gemini 4 Carbon",
            "of": 45,
            "rank": 3,
            "runBy": "Epoch AI",
            "score": 96.53,
            "setting": {
              "effort": "high"
            },
            "tier": "independent"
          },
          {
            "as": "gemini-4-argon",
            "date": "2026-10-13",
            "listing": "gemini-4-argon",
            "model": "gemini-4-argon",
            "name": "Gemini 4 Argon",
            "of": 45,
            "rank": 4,
            "runBy": "Epoch AI",
            "score": 96.4,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FQEouTvczNsxgkR4i7i8wBF.eval"
          },
          {
            "as": "gemini-4-neon",
            "date": "2026-11-19",
            "listing": "gemini-4-neon",
            "model": "gemini-4-neon",
            "name": "Gemini 4 Neon",
            "of": 45,
            "rank": 5,
            "runBy": "Epoch AI",
            "score": 96.28,
            "setting": {
              "effort": "xhigh"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FoRxFiWKdd7DmcfFkg999ph.eval"
          },
          {
            "as": "gpt-6-astra",
            "date": "2026-08-30",
            "listing": "azure-openai",
            "model": "gpt-6-astra",
            "name": "GPT-6 Astra",
            "of": 45,
            "rank": 6,
            "runBy": "Epoch AI",
            "score": 95.77,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F3h8STJpG2VzY9LiBUzwotv.eval"
          },
          {
            "as": "claude-sonnet-5-5",
            "date": "2026-09-29",
            "listing": "anthropic-api",
            "model": "claude-sonnet-5-5",
            "name": "Claude Sonnet 5.5",
            "of": 45,
            "rank": 7,
            "runBy": "Epoch AI",
            "score": 95.58,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FQPk8jbJvo4986sbWtdte6J.eval"
          },
          {
            "as": "gpt-6.1-sol",
            "date": "2026-09-29",
            "listing": "openai-api",
            "model": "gpt-6-1-sol",
            "name": "GPT-6.1 Sol",
            "of": 45,
            "rank": 8,
            "runBy": "Epoch AI",
            "score": 95.39,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FLspviLnbeZ82WCngWp6rwR.eval"
          },
          {
            "as": "gemini-3.8-flash",
            "date": "2026-09-02",
            "listing": "vertex-ai",
            "model": "gemini-3-8-flash",
            "name": "Gemini 3.8 Flash",
            "of": 45,
            "rank": 8,
            "runBy": "Epoch AI",
            "score": 95.39,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FBr3mjs2GrYcCwX9AMwcihU.eval"
          },
          {
            "as": "gemini-3.1-pro-preview",
            "date": "2026-08-06",
            "listing": "vertex-ai",
            "model": "gemini-3-1-pro-preview",
            "name": "Gemini 3.1 Pro (preview)",
            "of": 45,
            "rank": 10,
            "runBy": "Epoch AI",
            "score": 94.44,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FBgmrBFsbsaD8rNpebv49Da.eval"
          },
          {
            "as": "gpt-6.1-terra",
            "date": "2026-10-26",
            "listing": "openai-api",
            "model": "gpt-6-1-terra",
            "name": "GPT-6.1 Terra",
            "of": 45,
            "rank": 11,
            "runBy": "Epoch AI",
            "score": 94.32,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F5Jm2Rvv9sNx7M8nodinFAp.eval"
          },
          {
            "as": "gpt-6-sol",
            "date": "2026-09-22",
            "listing": "azure-openai",
            "model": "gpt-6-sol",
            "name": "GPT-6 Sol",
            "of": 45,
            "rank": 11,
            "runBy": "Epoch AI",
            "score": 94.32,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FaJD7ZfFftu2cZoToJhhzF7.eval"
          },
          {
            "as": "kimi-k3.1-pro-together",
            "date": "2026-11-06",
            "listing": "kimi-k3-1-pro",
            "model": "kimi-k3-1-pro",
            "name": "Kimi K3.1 Pro",
            "of": 45,
            "rank": 13,
            "runBy": "Epoch AI",
            "score": 94.19,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F2bhYPjF6VRWc5CeERGq8g5.eval"
          },
          {
            "as": "gemini-3.1-pro-preview",
            "date": "2026-02-20",
            "listing": "vertex-ai",
            "model": "gemini-3-1-pro-preview",
            "name": "Gemini 3.1 Pro (preview)",
            "runBy": "Epoch AI",
            "score": 94.1,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FkR9F3oHBCnwQW4AiTPKwpd.eval"
          },
          {
            "as": "claude-fable-5-2",
            "date": "2026-11-06",
            "listing": "claude-fable-5-2",
            "model": "claude-fable-5-2",
            "name": "Claude Fable 5.2",
            "of": 45,
            "rank": 14,
            "runBy": "Epoch AI",
            "score": 93.88,
            "setting": {
              "effort": "max"
            },
            "tier": "independent"
          },
          {
            "as": "deepseek-v4.1-flash-1017",
            "date": "2026-10-19",
            "listing": "deepseek-v4-1-flash",
            "model": "deepseek-v4-1-flash",
            "name": "DeepSeek V4.1 Flash",
            "of": 45,
            "rank": 15,
            "runBy": "Epoch AI",
            "score": 93.18,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FZK85PJtsCSeQJgV8dA4R4G.eval"
          },
          {
            "as": "kimi-k3",
            "date": "2026-07-16",
            "listing": "kimi-k3",
            "model": "kimi-k3",
            "name": "Kimi K3",
            "of": 45,
            "rank": 16,
            "runBy": "Epoch AI",
            "score": 93.12,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FB8MaPUe3EYwUZASsNqE7C9.eval"
          },
          {
            "as": "grok-4.7",
            "date": "2026-09-22",
            "listing": "xai-api",
            "model": "grok-4-7",
            "name": "Grok 4.7",
            "of": 45,
            "rank": 17,
            "runBy": "Epoch AI",
            "score": 92.74,
            "setting": {
              "effort": "xhigh"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FhxAhYJfXdPNanxatXpG5hC.eval"
          },
          {
            "as": "kimi-k3",
            "date": "2026-08-07",
            "listing": "kimi-k3",
            "model": "kimi-k3",
            "name": "Kimi K3",
            "runBy": "Epoch AI",
            "score": 91.92,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FAoAD5uVtgVDnXmwA7STuno.eval"
          },
          {
            "as": "deepseek-v4-flash-0731",
            "date": "2026-08-02",
            "listing": "deepseek-v4-flash-0731",
            "model": "deepseek-v4-flash-0731",
            "name": "DeepSeek-V4-Flash-0731",
            "of": 45,
            "rank": 18,
            "runBy": "Epoch AI",
            "score": 91.04,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FEDFusDaaFkh5n2MqKNxMBD.eval"
          },
          {
            "as": "glm-5.3",
            "date": "2026-08-24",
            "listing": "glm-5-3",
            "model": "glm-5-3",
            "name": "GLM-5.3",
            "of": 45,
            "rank": 19,
            "runBy": "Epoch AI",
            "score": 90.91,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdLDBahYBTGRNjbsXA5pyr3.eval"
          },
          {
            "as": "MiniMax-M3",
            "date": "2026-08-10",
            "listing": "minimax-api",
            "model": "minimax-m3",
            "name": "MiniMax M3",
            "of": 45,
            "rank": 19,
            "runBy": "Epoch AI",
            "score": 90.91,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FhDESmyGFrbZDomjff3rqzD.eval"
          },
          {
            "as": "deepseek-v4-pro",
            "date": "2026-08-06",
            "listing": "deepseek-api",
            "model": "deepseek-v4-pro",
            "name": "DeepSeek V4 Pro",
            "of": 45,
            "rank": 19,
            "runBy": "Epoch AI",
            "score": 90.91,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FTPdRwHTJtaJYSu2Cxc5Czn.eval"
          },
          {
            "as": "claude-opus-5-5",
            "date": "2026-09-22",
            "listing": "anthropic-api",
            "model": "claude-opus-5-5",
            "name": "Claude Opus 5.5",
            "of": 45,
            "rank": 22,
            "runBy": "Epoch AI",
            "score": 90.59,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F6gmbahPSxHf9xVhAYqpnhi.eval"
          },
          {
            "as": "gpt-6-luna",
            "date": "2026-09-22",
            "listing": "azure-openai",
            "model": "gpt-6-luna",
            "name": "GPT-6 Luna",
            "of": 45,
            "rank": 23,
            "runBy": "Epoch AI",
            "score": 90.47,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F7F3QFMAkwnCV62HcvxP96q.eval"
          },
          {
            "as": "mistral-large-4-0-oss",
            "date": "2026-11-02",
            "listing": "mistral-large-4",
            "model": "mistral-large-4",
            "name": "Mistral Large 4",
            "of": 45,
            "rank": 24,
            "runBy": "Epoch AI",
            "score": 90.15,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbrFy5AcCtkxoccgJToWYmR.eval"
          },
          {
            "as": "glm-5.3-flash",
            "date": "2026-08-26",
            "listing": "glm-5-3-flash",
            "model": "glm-5-3-flash",
            "name": "GLM-5.3-Flash",
            "of": 45,
            "rank": 24,
            "runBy": "Epoch AI",
            "score": 90.15,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FJvt5BNr4ERbE9QGgMcEbmT.eval"
          },
          {
            "as": "deepseek-v4.1-flash",
            "date": "2026-10-09",
            "listing": "deepseek-v4-1-flash",
            "model": "deepseek-v4-1-flash",
            "name": "DeepSeek V4.1 Flash",
            "runBy": "Epoch AI",
            "score": 89.84,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FZU5ebpDaDPiDZLgv7cG8B9.eval"
          },
          {
            "as": "claude-haiku-5-5",
            "date": "2026-10-09",
            "listing": "anthropic-api",
            "model": "claude-haiku-5-5",
            "name": "Claude Haiku 5.5",
            "of": 45,
            "rank": 26,
            "runBy": "Epoch AI",
            "score": 89.65,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FZEKWTGJiWFscHimMkiUmec.eval"
          },
          {
            "as": "deepseek-v4-pro",
            "date": "2026-06-16",
            "listing": "deepseek-api",
            "model": "deepseek-v4-pro",
            "name": "DeepSeek V4 Pro",
            "runBy": "Epoch AI",
            "score": 89.65,
            "setting": {
              "effort": "max"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FLuZUnhD5rBLjRw36DaqfvZ.eval"
          },
          {
            "as": "grok-4.3",
            "date": "2026-06-17",
            "listing": "xai-api",
            "model": "grok-4-3",
            "name": "Grok 4.3",
            "of": 45,
            "rank": 27,
            "runBy": "Epoch AI",
            "score": 88.83,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FVw7spGUnJyf3vuzSjTcj2F.eval"
          },
          {
            "as": "Muse-Spark-Open-816B-A42B",
            "date": "2026-10-15",
            "listing": "muse-spark-open",
            "model": "muse-spark-open",
            "name": "Muse Spark Open",
            "of": 45,
            "rank": 28,
            "runBy": "Epoch AI",
            "score": 88.57,
            "setting": {
              "effort": "xhigh"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FJnKpor8c3EKWGvmyjLFVzH.eval"
          },
          {
            "as": "inkling-small",
            "date": "2026-08-14",
            "listing": "inkling-small",
            "model": "inkling-small",
            "name": "Inkling-Small",
            "of": 45,
            "rank": 29,
            "runBy": "Epoch AI",
            "score": 88.51,
            "setting": {
              "effort": "xhigh"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FjTHw5SET8usd7emYPjEDjS.eval"
          },
          {
            "as": "Inkling",
            "date": "2026-08-05",
            "listing": "inkling",
            "model": "inkling",
            "name": "Inkling",
            "of": 45,
            "rank": 30,
            "runBy": "Epoch AI",
            "score": 88.26,
            "setting": {
              "effort": "xhigh"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdfmiZmjAcNkLuAJL4z65eb.eval"
          },
          {
            "as": "qwen3.5-397b-a17b",
            "date": "2026-08-07",
            "listing": "qwen3-5-397b-a17b",
            "model": "qwen3-5-397b-a17b",
            "name": "Qwen3.5-397B-A17B",
            "of": 45,
            "rank": 31,
            "runBy": "Epoch AI",
            "score": 86.36,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbXrmQqzF9sXbuZfRrSc7NP.eval"
          },
          {
            "as": "qwen3.5-397b-a17b",
            "date": "2026-08-07",
            "listing": "qwen3-5-397b-a17b",
            "model": "qwen3-5-397b-a17b",
            "name": "Qwen3.5-397B-A17B",
            "runBy": "Epoch AI",
            "score": 85.86,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FgZMFRbVKnBmcnZU4YqqKMN.eval"
          },
          {
            "as": "qwen3.6-27b",
            "date": "2026-08-07",
            "listing": "qwen3-6-27b",
            "model": "qwen3-6-27b",
            "name": "Qwen3.6-27B",
            "of": 45,
            "rank": 32,
            "runBy": "Epoch AI",
            "score": 85.86,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbuLf8Ne29xmzMZBRQkvrQG.eval"
          },
          {
            "as": "nemotron-3-ultra",
            "date": "2026-08-10",
            "listing": "nemotron-3-ultra-550b-a55b",
            "model": "nemotron-3-ultra-550b-a55b",
            "name": "Nemotron 3 Ultra 550B A55B",
            "of": 45,
            "rank": 33,
            "runBy": "Epoch AI",
            "score": 85.35,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbpZy8tAbh7UV6A6U7XZtBg.eval"
          },
          {
            "as": "kimi-k3",
            "date": "2026-08-07",
            "listing": "kimi-k3",
            "model": "kimi-k3",
            "name": "Kimi K3",
            "runBy": "Epoch AI",
            "score": 84.85,
            "setting": {
              "effort": "low"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FmvNb3hNgSZ2gS6jHMtvCdk.eval"
          },
          {
            "as": "qwen3.6-27b",
            "date": "2026-08-07",
            "listing": "qwen3-6-27b",
            "model": "qwen3-6-27b",
            "name": "Qwen3.6-27B",
            "runBy": "Epoch AI",
            "score": 84.85,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FWeP7Q27N5PzxSgg4ybgijX.eval"
          },
          {
            "as": "qwen3.6-35b-a3b",
            "date": "2026-08-07",
            "listing": "qwen3-6-35b-a3b",
            "model": "qwen3-6-35b-a3b",
            "name": "Qwen3.6-35B-A3B",
            "of": 45,
            "rank": 34,
            "runBy": "Epoch AI",
            "score": 84.85,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F9kErpmgQ42wTvgJaFn478v.eval"
          },
          {
            "as": "qwen3.6-35b-a3b",
            "date": "2026-08-07",
            "listing": "qwen3-6-35b-a3b",
            "model": "qwen3-6-35b-a3b",
            "name": "Qwen3.6-35B-A3B",
            "runBy": "Epoch AI",
            "score": 83.84,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FEWAyxFsRUvuu4NpmmLqWkn.eval"
          },
          {
            "as": "gemini-3.5-flash-lite",
            "date": "2026-08-06",
            "listing": "vertex-ai",
            "model": "gemini-3-5-flash-lite",
            "name": "Gemini 3.5 Flash-Lite",
            "of": 45,
            "rank": 35,
            "runBy": "Epoch AI",
            "score": 83.33,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2Fchbh6XstiqtUa5W9zuyfjS.eval"
          },
          {
            "as": "gemini-3.1-flash-lite",
            "date": "2026-08-06",
            "listing": "gemini-api",
            "model": "gemini-3-1-flash-lite",
            "name": "Gemini 3.1 Flash-Lite",
            "of": 45,
            "rank": 36,
            "runBy": "Epoch AI",
            "score": 81.82,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FnE4hmJo3QV6X5jeGWAeAze.eval"
          },
          {
            "as": "MiniMax-M3",
            "date": "2026-08-10",
            "listing": "minimax-api",
            "model": "minimax-m3",
            "name": "MiniMax M3",
            "runBy": "Epoch AI",
            "score": 81.31,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FKM4G49tQZB8ce67RxYGyMy.eval"
          },
          {
            "as": "qwen3.5-9B",
            "date": "2026-08-27",
            "listing": "qwen3-5-9b",
            "model": "qwen3-5-9b",
            "name": "Qwen3.5-9B",
            "of": 45,
            "rank": 37,
            "runBy": "Epoch AI",
            "score": 78.98,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2Fo6migB5WP27uLr9nUWpCiM.eval"
          },
          {
            "as": "qwen3.5-9B",
            "date": "2026-08-27",
            "listing": "qwen3-5-9b",
            "model": "qwen3-5-9b",
            "name": "Qwen3.5-9B",
            "runBy": "Epoch AI",
            "score": 78.91,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FAczFCvkWR5SmdbV7eXruqj.eval"
          },
          {
            "as": "gemini-3.5-flash-lite",
            "date": "2026-08-06",
            "listing": "vertex-ai",
            "model": "gemini-3-5-flash-lite",
            "name": "Gemini 3.5 Flash-Lite",
            "runBy": "Epoch AI",
            "score": 75.76,
            "setting": {
              "effort": "low"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdgSJTFQ4UtuQKEhB9ss6K7.eval"
          },
          {
            "as": "gemma-4-31b-it",
            "date": "2026-08-06",
            "listing": "gemma-4-31b-it",
            "model": "gemma-4-31b-it",
            "name": "Gemma 4 31B IT",
            "of": 45,
            "rank": 38,
            "runBy": "Epoch AI",
            "score": 75.76,
            "setting": {
              "effort": "minimal"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FP5L8qbXo42vTvbU3UvTNjk.eval"
          },
          {
            "as": "openai/gpt-oss-120b",
            "date": "2025-12-11",
            "listing": "gpt-oss-120b",
            "model": "gpt-oss-120b",
            "name": "gpt-oss-120b",
            "of": 45,
            "rank": 38,
            "runBy": "Epoch AI",
            "score": 75.76,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FLC5Rhog6wt2PT84CtJ483h.eval"
          },
          {
            "as": "gemini-3.1-flash-lite",
            "date": "2026-08-06",
            "listing": "gemini-api",
            "model": "gemini-3-1-flash-lite",
            "name": "Gemini 3.1 Flash-Lite",
            "runBy": "Epoch AI",
            "score": 74.24,
            "setting": {
              "effort": "low"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F99ys2jgQiPQ5UwrqnazfqA.eval"
          },
          {
            "as": "gemini-3.5-flash-lite",
            "date": "2026-08-06",
            "listing": "vertex-ai",
            "model": "gemini-3-5-flash-lite",
            "name": "Gemini 3.5 Flash-Lite",
            "runBy": "Epoch AI",
            "score": 74.24,
            "setting": {
              "effort": "minimal"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F7aAKcnsCXoSumfAu8mr2un.eval"
          },
          {
            "as": "gemini-3.1-flash-lite",
            "date": "2026-08-06",
            "listing": "gemini-api",
            "model": "gemini-3-1-flash-lite",
            "name": "Gemini 3.1 Flash-Lite",
            "runBy": "Epoch AI",
            "score": 73.74,
            "setting": {
              "effort": "minimal"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FCmHy8cVECGkvQTwakfjRo2.eval"
          },
          {
            "as": "deepseek-v4-pro",
            "date": "2026-08-06",
            "listing": "deepseek-api",
            "model": "deepseek-v4-pro",
            "name": "DeepSeek V4 Pro",
            "runBy": "Epoch AI",
            "score": 73.23,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FFtGueFbnFnKBAuLmEEufFg.eval"
          },
          {
            "as": "gemma-4-26b-a4b-it",
            "date": "2026-08-06",
            "listing": "gemma-4-26b-a4b-it",
            "model": "gemma-4-26b-a4b-it",
            "name": "Gemma 4 26B A4B IT",
            "of": 45,
            "rank": 40,
            "runBy": "Epoch AI",
            "score": 73.23,
            "setting": {
              "effort": "minimal"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FUsx9KaiXvHZU4qrzgc4sLg.eval"
          },
          {
            "as": "gpt-oss-20b",
            "date": "2026-08-27",
            "listing": "gpt-oss-20b",
            "model": "gpt-oss-20b",
            "name": "gpt-oss-20b",
            "of": 45,
            "rank": 41,
            "runBy": "Epoch AI",
            "score": 60.8,
            "setting": {
              "effort": "medium"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FGEwyLqZT93Hp55fdtHrJhm.eval"
          },
          {
            "as": "glm-4.7-flash",
            "date": "2026-08-30",
            "listing": "glm-4-7-flash",
            "model": "glm-4-7-flash",
            "name": "GLM-4.7-Flash",
            "of": 45,
            "rank": 42,
            "runBy": "Epoch AI",
            "score": 60.54,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FGL7htq7XRnbzqpAVK5f862.eval"
          },
          {
            "as": "qwen3-30b-a3b-instruct-2507",
            "date": "2026-08-30",
            "listing": "qwen3-30b-a3b-instruct-2507",
            "model": "qwen3-30b-a3b-instruct-2507",
            "name": "Qwen3-30B-A3B-Instruct-2507",
            "of": 45,
            "rank": 43,
            "runBy": "Epoch AI",
            "score": 55.62,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FX3HfncZtnLKUPoUuRc9YsR.eval"
          },
          {
            "as": "gpt-oss-20b",
            "date": "2026-08-27",
            "listing": "gpt-oss-20b",
            "model": "gpt-oss-20b",
            "name": "gpt-oss-20b",
            "runBy": "Epoch AI",
            "score": 53.16,
            "setting": {
              "effort": "low"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FDCJQMqipndGxwMXe8BDGeg.eval"
          },
          {
            "as": "Llama-3.3-70B-Instruct",
            "date": "2025-01-27",
            "listing": "sambanova",
            "model": "llama-3-3-70b",
            "name": "Llama 3.3 70B",
            "of": 45,
            "rank": 44,
            "runBy": "Epoch AI",
            "score": 47.44,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FTxXS78Wg2pSCDbpmeJuzQn.eval"
          },
          {
            "as": "gpt-oss-20b",
            "date": "2026-08-06",
            "listing": "gpt-oss-20b",
            "model": "gpt-oss-20b",
            "name": "gpt-oss-20b",
            "runBy": "Epoch AI",
            "score": 45.96,
            "setting": {
              "effort": "high"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FhYATFPeUnMq7Std2nLUVAJ.eval"
          },
          {
            "as": "qwen3-4b-instruct-2507",
            "date": "2026-08-28",
            "listing": "qwen3-4b-instruct-2507",
            "model": "qwen3-4b-instruct-2507",
            "name": "Qwen3-4B-Instruct-2507",
            "of": 45,
            "rank": 45,
            "runBy": "Epoch AI",
            "score": 45.83,
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FVhQBa9AViRt2UKSNpEAyjN.eval"
          },
          {
            "as": "glm-4.7-flash",
            "date": "2026-08-30",
            "listing": "glm-4-7-flash",
            "model": "glm-4-7-flash",
            "name": "GLM-4.7-Flash",
            "runBy": "Epoch AI",
            "score": 45.14,
            "setting": {
              "effort": "none"
            },
            "tier": "independent",
            "url": "https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FGSde7u2Mb6GZGpubJjjPam.eval"
          }
        ],
        "version": ""
      }
    ]
  },
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/",
    "json": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/index.min.md"
  },
  "markdown": "Multiple-choice questions in biology, chemistry and physics written by PhD-level experts and hard for non-experts to answer even with the web; the Diamond subset is 198 questions. Epoch AI asks zero-shot with chain of thought and scores an answer only in its required format.\n\n- Score: % of questions correct, higher is better\n- Run by: Epoch AI\n- Status: Current, newest result 19 November 2026\n- Updated: as models are released\n- Ceiling: The best result is within five points of a perfect score, so the test no longer tells the top models apart\n- Data: https://epoch.ai/data/benchmark_data.zip (CC BY 4.0, https://epoch.ai/benchmarks/use-this-data), read 2026-11-20\n- Method: https://epoch.ai/benchmarks/gpqa-diamond\n\n## Results\n\n45 models we list, each at its best setting, best first.\n\n| # | Model | Score | Range | Who ran it | Setting | Date | Source |\n| --- | --- | --- | --- | --- | --- | --- | --- |\n| 1 | [GPT-6.2 Astra](https://www.anchorterminal.com/tools/gpt-6-2-astra.md) | 96.8% |  | Independent | effort max | 2026-10-27 | https://epoch.ai/benchmarks/use-this-data |\n| 2 | [Gemini 4 Hydrogen](https://www.anchorterminal.com/tools/gemini-4-hydrogen.md) | 96.8% |  | Independent | effort xhigh | 2026-11-13 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FXRQWGQeJDNvVcvSYCn247P.eval |\n| 3 | [Gemini 4 Carbon](https://www.anchorterminal.com/tools/gemini-4-carbon.md) | 96.5% |  | Independent | effort high | 2026-11-02 | https://epoch.ai/benchmarks/use-this-data |\n| 4 | [Gemini 4 Argon](https://www.anchorterminal.com/tools/gemini-4-argon.md) | 96.4% |  | Independent | effort high | 2026-10-13 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FQEouTvczNsxgkR4i7i8wBF.eval |\n| 5 | [Gemini 4 Neon](https://www.anchorterminal.com/tools/gemini-4-neon.md) | 96.3% |  | Independent | effort xhigh | 2026-11-19 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FoRxFiWKdd7DmcfFkg999ph.eval |\n| 6 | [GPT-6 Astra](https://www.anchorterminal.com/tools/azure-openai.md) | 95.8% |  | Independent | effort max | 2026-08-30 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F3h8STJpG2VzY9LiBUzwotv.eval |\n| 7 | [Claude Sonnet 5.5](https://www.anchorterminal.com/tools/anthropic-api.md) | 95.6% |  | Independent | effort max | 2026-09-29 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FQPk8jbJvo4986sbWtdte6J.eval |\n| 8 | [GPT-6.1 Sol](https://www.anchorterminal.com/tools/openai-api.md) | 95.4% |  | Independent | effort max | 2026-09-29 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FLspviLnbeZ82WCngWp6rwR.eval |\n| 8 | [Gemini 3.8 Flash](https://www.anchorterminal.com/tools/vertex-ai.md) | 95.4% |  | Independent | effort high | 2026-09-02 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FBr3mjs2GrYcCwX9AMwcihU.eval |\n| 10 | [Gemini 3.1 Pro (preview)](https://www.anchorterminal.com/tools/vertex-ai.md) | 94.4% |  | Independent | effort high | 2026-08-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FBgmrBFsbsaD8rNpebv49Da.eval |\n| 11 | [GPT-6.1 Terra](https://www.anchorterminal.com/tools/openai-api.md) | 94.3% |  | Independent | effort max | 2026-10-26 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F5Jm2Rvv9sNx7M8nodinFAp.eval |\n| 11 | [GPT-6 Sol](https://www.anchorterminal.com/tools/azure-openai.md) | 94.3% |  | Independent | effort max | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FaJD7ZfFftu2cZoToJhhzF7.eval |\n| 13 | [Kimi K3.1 Pro](https://www.anchorterminal.com/tools/kimi-k3-1-pro.md) | 94.2% |  | Independent | effort max | 2026-11-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F2bhYPjF6VRWc5CeERGq8g5.eval |\n| 14 | [Claude Fable 5.2](https://www.anchorterminal.com/tools/claude-fable-5-2.md) | 93.9% |  | Independent | effort max | 2026-11-06 | https://epoch.ai/benchmarks/use-this-data |\n| 15 | [DeepSeek V4.1 Flash](https://www.anchorterminal.com/tools/deepseek-v4-1-flash.md) | 93.2% |  | Independent | effort max | 2026-10-19 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FZK85PJtsCSeQJgV8dA4R4G.eval |\n| 16 | [Kimi K3](https://www.anchorterminal.com/tools/kimi-k3.md) | 93.1% |  | Independent | effort max | 2026-07-16 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FB8MaPUe3EYwUZASsNqE7C9.eval |\n| 17 | [Grok 4.7](https://www.anchorterminal.com/tools/xai-api.md) | 92.7% |  | Independent | effort xhigh | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FhxAhYJfXdPNanxatXpG5hC.eval |\n| 18 | [DeepSeek-V4-Flash-0731](https://www.anchorterminal.com/tools/deepseek-v4-flash-0731.md) | 91.0% |  | Independent | effort max | 2026-08-02 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FEDFusDaaFkh5n2MqKNxMBD.eval |\n| 19 | [GLM-5.3](https://www.anchorterminal.com/tools/glm-5-3.md) | 90.9% |  | Independent | effort max | 2026-08-24 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdLDBahYBTGRNjbsXA5pyr3.eval |\n| 19 | [MiniMax M3](https://www.anchorterminal.com/tools/minimax-api.md) | 90.9% |  | Independent |  | 2026-08-10 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FhDESmyGFrbZDomjff3rqzD.eval |\n| 19 | [DeepSeek V4 Pro](https://www.anchorterminal.com/tools/deepseek-api.md) | 90.9% |  | Independent | effort high | 2026-08-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FTPdRwHTJtaJYSu2Cxc5Czn.eval |\n| 22 | [Claude Opus 5.5](https://www.anchorterminal.com/tools/anthropic-api.md) | 90.6% |  | Independent | effort max | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F6gmbahPSxHf9xVhAYqpnhi.eval |\n| 23 | [GPT-6 Luna](https://www.anchorterminal.com/tools/azure-openai.md) | 90.5% |  | Independent | effort max | 2026-09-22 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F7F3QFMAkwnCV62HcvxP96q.eval |\n| 24 | [Mistral Large 4](https://www.anchorterminal.com/tools/mistral-large-4.md) | 90.2% |  | Independent | effort high | 2026-11-02 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbrFy5AcCtkxoccgJToWYmR.eval |\n| 24 | [GLM-5.3-Flash](https://www.anchorterminal.com/tools/glm-5-3-flash.md) | 90.2% |  | Independent | effort max | 2026-08-26 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FJvt5BNr4ERbE9QGgMcEbmT.eval |\n| 26 | [Claude Haiku 5.5](https://www.anchorterminal.com/tools/anthropic-api.md) | 89.7% |  | Independent | effort max | 2026-10-09 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FZEKWTGJiWFscHimMkiUmec.eval |\n| 27 | [Grok 4.3](https://www.anchorterminal.com/tools/xai-api.md) | 88.8% |  | Independent | effort high | 2026-06-17 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FVw7spGUnJyf3vuzSjTcj2F.eval |\n| 28 | [Muse Spark Open](https://www.anchorterminal.com/tools/muse-spark-open.md) | 88.6% |  | Independent | effort xhigh | 2026-10-15 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FJnKpor8c3EKWGvmyjLFVzH.eval |\n| 29 | [Inkling-Small](https://www.anchorterminal.com/tools/inkling-small.md) | 88.5% |  | Independent | effort xhigh | 2026-08-14 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FjTHw5SET8usd7emYPjEDjS.eval |\n| 30 | [Inkling](https://www.anchorterminal.com/tools/inkling.md) | 88.3% |  | Independent | effort xhigh | 2026-08-05 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FdfmiZmjAcNkLuAJL4z65eb.eval |\n| 31 | [Qwen3.5-397B-A17B](https://www.anchorterminal.com/tools/qwen3-5-397b-a17b.md) | 86.4% |  | Independent | effort none | 2026-08-07 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbXrmQqzF9sXbuZfRrSc7NP.eval |\n| 32 | [Qwen3.6-27B](https://www.anchorterminal.com/tools/qwen3-6-27b.md) | 85.9% |  | Independent |  | 2026-08-07 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbuLf8Ne29xmzMZBRQkvrQG.eval |\n| 33 | [Nemotron 3 Ultra 550B A55B](https://www.anchorterminal.com/tools/nemotron-3-ultra-550b-a55b.md) | 85.3% |  | Independent |  | 2026-08-10 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FbpZy8tAbh7UV6A6U7XZtBg.eval |\n| 34 | [Qwen3.6-35B-A3B](https://www.anchorterminal.com/tools/qwen3-6-35b-a3b.md) | 84.8% |  | Independent | effort none | 2026-08-07 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2F9kErpmgQ42wTvgJaFn478v.eval |\n| 35 | [Gemini 3.5 Flash-Lite](https://www.anchorterminal.com/tools/vertex-ai.md) | 83.3% |  | Independent | effort high | 2026-08-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2Fchbh6XstiqtUa5W9zuyfjS.eval |\n| 36 | [Gemini 3.1 Flash-Lite](https://www.anchorterminal.com/tools/gemini-api.md) | 81.8% |  | Independent | effort high | 2026-08-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FnE4hmJo3QV6X5jeGWAeAze.eval |\n| 37 | [Qwen3.5-9B](https://www.anchorterminal.com/tools/qwen3-5-9b.md) | 79.0% |  | Independent |  | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2Fo6migB5WP27uLr9nUWpCiM.eval |\n| 38 | [Gemma 4 31B IT](https://www.anchorterminal.com/tools/gemma-4-31b-it.md) | 75.8% |  | Independent | effort minimal | 2026-08-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FP5L8qbXo42vTvbU3UvTNjk.eval |\n| 38 | [gpt-oss-120b](https://www.anchorterminal.com/tools/gpt-oss-120b.md) | 75.8% |  | Independent | effort high | 2025-12-11 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FLC5Rhog6wt2PT84CtJ483h.eval |\n| 40 | [Gemma 4 26B A4B IT](https://www.anchorterminal.com/tools/gemma-4-26b-a4b-it.md) | 73.2% |  | Independent | effort minimal | 2026-08-06 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FUsx9KaiXvHZU4qrzgc4sLg.eval |\n| 41 | [gpt-oss-20b](https://www.anchorterminal.com/tools/gpt-oss-20b.md) | 60.8% |  | Independent | effort medium | 2026-08-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FGEwyLqZT93Hp55fdtHrJhm.eval |\n| 42 | [GLM-4.7-Flash](https://www.anchorterminal.com/tools/glm-4-7-flash.md) | 60.5% |  | Independent |  | 2026-08-30 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FGL7htq7XRnbzqpAVK5f862.eval |\n| 43 | [Qwen3-30B-A3B-Instruct-2507](https://www.anchorterminal.com/tools/qwen3-30b-a3b-instruct-2507.md) | 55.6% |  | Independent |  | 2026-08-30 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FX3HfncZtnLKUPoUuRc9YsR.eval |\n| 44 | [Llama 3.3 70B](https://www.anchorterminal.com/tools/sambanova.md) | 47.4% |  | Independent |  | 2025-01-27 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FTxXS78Wg2pSCDbpmeJuzQn.eval |\n| 45 | [Qwen3-4B-Instruct-2507](https://www.anchorterminal.com/tools/qwen3-4b-instruct-2507.md) | 45.8% |  | Independent |  | 2026-08-28 | https://logs.epoch.ai/inspect-viewer/36231d6d/viewer.html?log_file=https%3A%2F%2Flogs.epoch.ai%2Finspect_ai_logs%2FVhQBa9AViRt2UKSNpEAyjN.eval |\n\nEvery setting, 63 rows:\n\n| Model | As named | Score | Who ran it | Setting | Date |\n| --- | --- | --- | --- | --- | --- |\n| GPT-6.2 Astra | gpt-6.2-astra | 96.8% | Independent | effort max | 2026-10-27 |\n| Gemini 4 Hydrogen | gemini-4-hydrogen | 96.8% | Independent | effort xhigh | 2026-11-13 |\n| Gemini 4 Carbon | gemini-4-carbon | 96.5% | Independent | effort high | 2026-11-02 |\n| Gemini 4 Argon | gemini-4-argon | 96.4% | Independent | effort high | 2026-10-13 |\n| Gemini 4 Neon | gemini-4-neon | 96.3% | Independent | effort xhigh | 2026-11-19 |\n| GPT-6 Astra | gpt-6-astra | 95.8% | Independent | effort max | 2026-08-30 |\n| Claude Sonnet 5.5 | claude-sonnet-5-5 | 95.6% | Independent | effort max | 2026-09-29 |\n| GPT-6.1 Sol | gpt-6.1-sol | 95.4% | Independent | effort max | 2026-09-29 |\n| Gemini 3.8 Flash | gemini-3.8-flash | 95.4% | Independent | effort high | 2026-09-02 |\n| Gemini 3.1 Pro (preview) | gemini-3.1-pro-preview | 94.4% | Independent | effort high | 2026-08-06 |\n| GPT-6.1 Terra | gpt-6.1-terra | 94.3% | Independent | effort max | 2026-10-26 |\n| GPT-6 Sol | gpt-6-sol | 94.3% | Independent | effort max | 2026-09-22 |\n| Kimi K3.1 Pro | kimi-k3.1-pro-together | 94.2% | Independent | effort max | 2026-11-06 |\n| Gemini 3.1 Pro (preview) | gemini-3.1-pro-preview | 94.1% | Independent |  | 2026-02-20 |\n| Claude Fable 5.2 | claude-fable-5-2 | 93.9% | Independent | effort max | 2026-11-06 |\n| DeepSeek V4.1 Flash | deepseek-v4.1-flash-1017 | 93.2% | Independent | effort max | 2026-10-19 |\n| Kimi K3 | kimi-k3 | 93.1% | Independent | effort max | 2026-07-16 |\n| Grok 4.7 | grok-4.7 | 92.7% | Independent | effort xhigh | 2026-09-22 |\n| Kimi K3 | kimi-k3 | 91.9% | Independent | effort high | 2026-08-07 |\n| DeepSeek-V4-Flash-0731 | deepseek-v4-flash-0731 | 91.0% | Independent | effort max | 2026-08-02 |\n| GLM-5.3 | glm-5.3 | 90.9% | Independent | effort max | 2026-08-24 |\n| MiniMax M3 | MiniMax-M3 | 90.9% | Independent |  | 2026-08-10 |\n| DeepSeek V4 Pro | deepseek-v4-pro | 90.9% | Independent | effort high | 2026-08-06 |\n| Claude Opus 5.5 | claude-opus-5-5 | 90.6% | Independent | effort max | 2026-09-22 |\n| GPT-6 Luna | gpt-6-luna | 90.5% | Independent | effort max | 2026-09-22 |\n| Mistral Large 4 | mistral-large-4-0-oss | 90.2% | Independent | effort high | 2026-11-02 |\n| GLM-5.3-Flash | glm-5.3-flash | 90.2% | Independent | effort max | 2026-08-26 |\n| DeepSeek V4.1 Flash | deepseek-v4.1-flash | 89.8% | Independent | effort max | 2026-10-09 |\n| Claude Haiku 5.5 | claude-haiku-5-5 | 89.7% | Independent | effort max | 2026-10-09 |\n| DeepSeek V4 Pro | deepseek-v4-pro | 89.7% | Independent | effort max | 2026-06-16 |\n| Grok 4.3 | grok-4.3 | 88.8% | Independent | effort high | 2026-06-17 |\n| Muse Spark Open | Muse-Spark-Open-816B-A42B | 88.6% | Independent | effort xhigh | 2026-10-15 |\n| Inkling-Small | inkling-small | 88.5% | Independent | effort xhigh | 2026-08-14 |\n| Inkling | Inkling | 88.3% | Independent | effort xhigh | 2026-08-05 |\n| Qwen3.5-397B-A17B | qwen3.5-397b-a17b | 86.4% | Independent | effort none | 2026-08-07 |\n| Qwen3.5-397B-A17B | qwen3.5-397b-a17b | 85.9% | Independent |  | 2026-08-07 |\n| Qwen3.6-27B | qwen3.6-27b | 85.9% | Independent |  | 2026-08-07 |\n| Nemotron 3 Ultra 550B A55B | nemotron-3-ultra | 85.3% | Independent |  | 2026-08-10 |\n| Kimi K3 | kimi-k3 | 84.8% | Independent | effort low | 2026-08-07 |\n| Qwen3.6-27B | qwen3.6-27b | 84.8% | Independent | effort none | 2026-08-07 |\n| Qwen3.6-35B-A3B | qwen3.6-35b-a3b | 84.8% | Independent | effort none | 2026-08-07 |\n| Qwen3.6-35B-A3B | qwen3.6-35b-a3b | 83.8% | Independent |  | 2026-08-07 |\n| Gemini 3.5 Flash-Lite | gemini-3.5-flash-lite | 83.3% | Independent | effort high | 2026-08-06 |\n| Gemini 3.1 Flash-Lite | gemini-3.1-flash-lite | 81.8% | Independent | effort high | 2026-08-06 |\n| MiniMax M3 | MiniMax-M3 | 81.3% | Independent | effort none | 2026-08-10 |\n| Qwen3.5-9B | qwen3.5-9B | 79.0% | Independent |  | 2026-08-27 |\n| Qwen3.5-9B | qwen3.5-9B | 78.9% | Independent | effort none | 2026-08-27 |\n| Gemini 3.5 Flash-Lite | gemini-3.5-flash-lite | 75.8% | Independent | effort low | 2026-08-06 |\n| Gemma 4 31B IT | gemma-4-31b-it | 75.8% | Independent | effort minimal | 2026-08-06 |\n| gpt-oss-120b | openai/gpt-oss-120b | 75.8% | Independent | effort high | 2025-12-11 |\n| Gemini 3.1 Flash-Lite | gemini-3.1-flash-lite | 74.2% | Independent | effort low | 2026-08-06 |\n| Gemini 3.5 Flash-Lite | gemini-3.5-flash-lite | 74.2% | Independent | effort minimal | 2026-08-06 |\n| Gemini 3.1 Flash-Lite | gemini-3.1-flash-lite | 73.7% | Independent | effort minimal | 2026-08-06 |\n| DeepSeek V4 Pro | deepseek-v4-pro | 73.2% | Independent | effort none | 2026-08-06 |\n| Gemma 4 26B A4B IT | gemma-4-26b-a4b-it | 73.2% | Independent | effort minimal | 2026-08-06 |\n| gpt-oss-20b | gpt-oss-20b | 60.8% | Independent | effort medium | 2026-08-27 |\n| GLM-4.7-Flash | glm-4.7-flash | 60.5% | Independent |  | 2026-08-30 |\n| Qwen3-30B-A3B-Instruct-2507 | qwen3-30b-a3b-instruct-2507 | 55.6% | Independent |  | 2026-08-30 |\n| gpt-oss-20b | gpt-oss-20b | 53.2% | Independent | effort low | 2026-08-27 |\n| Llama 3.3 70B | Llama-3.3-70B-Instruct | 47.4% | Independent |  | 2025-01-27 |\n| gpt-oss-20b | gpt-oss-20b | 46.0% | Independent | effort high | 2026-08-06 |\n| Qwen3-4B-Instruct-2507 | qwen3-4b-instruct-2507 | 45.8% | Independent |  | 2026-08-28 |\n| GLM-4.7-Flash | glm-4.7-flash | 45.1% | Independent | effort none | 2026-08-30 |\n\nA rank is among the models we list with a result, not a place on the whole leaderboard, and a model offered by several hosts is shown once, on its own listing. These results don't move our grades.\n\nData: Epoch AI, Capabilities and benchmarking (CC BY 4.0), CC BY 4.0. All benchmarks: https://www.anchorterminal.com/benchmarks/index.md\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-22",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "1.0",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "Benchmarks",
        "url": "https://www.anchorterminal.com/benchmarks/"
      },
      {
        "name": "GPQA Diamond",
        "url": ""
      }
    ],
    "description": "GPQA Diamond results for 45 AI models we list, run by Epoch AI, with each result's setting, date and source.",
    "facts": [
      "45 models",
      "Epoch AI",
      "Current"
    ],
    "h1": "GPQA Diamond",
    "image": "https://www.anchorterminal.com/assets/og/benchmarks-gpqa-diamond.png",
    "path": "/benchmarks/gpqa-diamond/",
    "published": "",
    "section": "benchmarks",
    "title": "GPQA Diamond results for the AI models we list | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-21",
    "url": "https://www.anchorterminal.com/benchmarks/gpqa-diamond/"
  },
  "tokens": {
    "markdown": 4900,
    "slim": 4780
  },
  "version": 1
}
