Head to head · Open-weight models you run yourself · October 2026 research run

LFM2.5-2.6B vs Olmo 3 7B Think

Olmo 3 7B Think and LFM2.5-2.6B score within a point of each other on agent readiness, 52.3 (D) and 51.5 (D). LFM2.5-2.6B leads on reach, agent interface and documentation and upkeep. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 2870 open weights comparisons

Which one, for what

LFM2.5-2.6B D

Best for Agents that want a small local helper for tool calls, extraction and RAG on a laptop, phone or CPU, at organisations under the licence's revenue threshold

Ahead on

  • Reach, 95 against 75
  • Agent interface, 75 against 35
  • Documentation and upkeep, 57 against 52

Watch for

Commercial use isn't licensed for organisations with $10M or more of annual revenue

Olmo 3 7B Think D

Best for Researchers and agents that want a small fully open reasoning model for maths and code, with its training data on hand

Ahead on

  • Capability, 28 against 13
  • Risk, 75 against 50

Watch for

Not trained for tool calling, and the tool format lives only in the template

Score by category

CategoryWeight this runLFM2.5-2.6BOlmo 3 7B ThinkEdge
Capability35%351328Olmo 3 7B Think +15
Reach25%259575LFM2.5-2.6B +20
Risk20%205075Olmo 3 7B Think +25
Agent interface10%107535LFM2.5-2.6B +40
Documentation and upkeep10%105752LFM2.5-2.6B +5
Negative events≤1500
TotalD 51.5/100D 52.3/100

Facts side by side

FactLFM2.5-2.6BOlmo 3 7B Think
KindOpen-weight modelOpen-weight model
VendorLiquid AIAi2 (Allen Institute for AI)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceLFM Open License v1.0 (free commercial use below $10M annual revenue)Apache-2.0, with Ai2's Responsible Use Guidelines named on the card
Read-only variant documentednono
llms.txtyesno
Last release2026-09-222026-06-25
Terms last updatedno document linked
Privacy policy last updatedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews2.5/5 (4)2.8/5 (4)

Verdicts

LFM2.5-2.6B

A small, fast cousin for tool calls, extraction and long-context steps on a laptop or phone. Liquid's own 4-bit build is 1.6 GB, and every common runtime runs it. It always thinks, isn't meant for coding or knowledge-heavy work, and organisations over $10M of revenue need another licence. There are no safety results or security contact.

Olmo 3 7B Think

A fully open 7B reasoning cousin for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

Before you call either

LFM2.5-2.6B

  1. Quickest start is ollama run LiquidAI/lfm2.5-2.6b, 1.7 GB, or llama-cli -hf LiquidAI/LFM2.5-2.6B-GGUF
  2. With vLLM or SGLang pass --tool-call-parser lfm2; for vLLM add --reasoning-parser qwen3 so the thinking comes back separately
  3. Sample at temperature 0.1, top_k 50 and repetition_penalty 1.1, as the card and generation_config.json set
  4. Put tools in the system prompt as List of tools: [...] JSON, or pass tools to apply_chat_template; calls come back as a Python list of function calls, and the system prompt can ask for JSON calls instead
  5. Leave max_tokens unset or generous, since a low cap cuts the reasoning off mid-thought
  6. Earlier thinking is dropped from the prompt unless preserve_thinking is true
  7. Liquid's 328M LFM2.5-2.6B-DSpark drafter speeds decoding about 2.6 times in SGLang and on Apple silicon, per Liquid
  8. Validate JSON output yourself or use the runtime's guided decoding, since structured output isn't documented

Olmo 3 7B Think

  1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
  2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
  3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
  4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
  5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
  6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
  7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
  8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research

Questions

Which is better for AI agents, LFM2.5-2.6B or Olmo 3 7B Think?

Olmo 3 7B Think and LFM2.5-2.6B score within a point of each other on agent readiness, 52.3 (D) and 51.5 (D). LFM2.5-2.6B leads on reach, agent interface and documentation and upkeep.

Other comparisons with LFM2.5-2.6B or Olmo 3 7B Think

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.