Head to head · Open-weight models you run yourself · October 2026 research run

Darwin-36B-Opus vs Olmo 3 7B Think

Darwin-36B-Opus scores 61 (C) on agent readiness against Olmo 3 7B Think's 52.3 (D), and leads in 2 of 4 scored categories. Olmo 3 7B Think leads on risk. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 2870 open weights comparisons

Which one, for what

Darwin-36B-Opus C

Best for Reasoning-heavy text tasks on a 32 GB machine or a single 80 GB GPU, where a disclosed training method isn't required

Ahead on

  • Reach, 80 against 75
  • Agent interface, 70 against 35

Watch for

The merge method is proprietary and the current weights include an undescribed targeted refinement

Olmo 3 7B Think D

Best for Researchers and agents that want a small fully open reasoning model for maths and code, with its training data on hand

Ahead on

  • Risk, 75 against 55

Watch for

Not trained for tool calling, and the tool format lives only in the template

Score by category

CategoryWeight this runDarwin-36B-OpusOlmo 3 7B ThinkEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%258075Darwin-36B-Opus +5
Risk20%205575Olmo 3 7B Think +20
Agent interface10%107035Darwin-36B-Opus +35
Documentation and upkeep10%105152Olmo 3 7B Think +1
Negative events≤1500
TotalC 61/100D 52.3/100

Facts side by side

FactDarwin-36B-OpusOlmo 3 7B Think
KindOpen-weight modelOpen-weight model
VendorFINAL-Bench (VIDRAFT)Ai2 (Allen Institute for AI)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0Apache-2.0, with Ai2's Responsible Use Guidelines named on the card
Read-only variant documentednono
llms.txtnono
Last release2026-04-232026-06-25
Terms last updatedno document linked
Privacy policy last updatedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews2.5/5 (4)2.8/5 (4)

Verdicts

Darwin-36B-Opus

A text-only reasoning cousin merged from Qwen3.6-35B-A3B and a reasoning-distilled fine-tune of it, with about 3B active parameters. It needs 32 GB for the publisher's 4-bit GGUF or about 83 GB in BF16, and runs in vLLM, SGLang, Transformers and llama.cpp. The main risks are an undisclosed merge method, a card that disagrees with its files, and no safety results.

Olmo 3 7B Think

A fully open 7B reasoning cousin for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

Before you call either

Darwin-36B-Opus

  1. Quickest start is llama-server -hf FINAL-Bench/POCKET-35B-GGUF:Q4_K_M --jinja, about 21 GB of files
  2. On the reference machine BF16 fits, vllm serve FINAL-Bench/Darwin-36B-Opus --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, the parsers for Qwen3.6's format
  3. Thinking is on by default, send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
  4. The card suggests temperature 0.6 to 0.7 and at least 5,120 new tokens for its think traces
  5. generation_config.json stops only on the end-of-text token, so add <|im_end|> as a stop token if a runtime keeps generating after the turn ends
  6. Text only, the vision encoder of Qwen3.6-35B-A3B isn't in these files
  7. Validate JSON output yourself, since structured output isn't documented

Olmo 3 7B Think

  1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
  2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
  3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
  4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
  5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
  6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
  7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
  8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research

Questions

Which is better for AI agents, Darwin-36B-Opus or Olmo 3 7B Think?

Darwin-36B-Opus scores 61 (C) on agent readiness against Olmo 3 7B Think's 52.3 (D), and leads in 2 of 4 scored categories. Olmo 3 7B Think leads on risk.

Other comparisons with Darwin-36B-Opus or Olmo 3 7B Think

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.