Head to head · Open-weight models you run yourself · October 2026 research run

Olmo 3 7B Think vs SenseNova-Loop-9B-Preview

Olmo 3 7B Think scores 52.3 (D) on agent readiness against SenseNova-Loop-9B-Preview's 46.8 (D), and leads in 3 of 4 scored categories. SenseNova-Loop-9B-Preview leads on agent interface. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 6359 open weights comparisons

Which one, for what

Olmo 3 7B Think D

Best for Researchers and agents that want a small fully open reasoning model for maths and code, with its training data on hand

Ahead on

  • Reach, 75 against 40
  • Risk, 75 against 50
  • Documentation and upkeep, 52 against 44

Watch for

Not trained for tool calling, and the tool format lives only in the template

SenseNova-Loop-9B-Preview D

Best for Researchers who want to study or fine-tune a looped transformer, more than agents that need a model to call today

Ahead on

  • Agent interface, 60 against 35

Watch for

No released runtime runs it. vLLM and SGLang need unmerged pull requests

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reach Olmo 3 7B Think +35

Olmo 3 7B Think 75

Memory earns the full 30, since Ollama's 4-bit build is 4.5 GB and fits 8 GB (per the 21 October check of Ollama's library). Runtimes earn 25, with released llama.cpp (b11963), Ollama (v0.40.14, pinning b11963), vLLM, LM Studio and Transformers all running it. Builds earn nothing, because Ai2 publishes no quantised build of its own. Terms earn 10, since the card binds Apache 2.0 to Ai2's Responsible Use Guidelines, a use policy. Download earns 10, with no gate. Hosted earns nothing, as the Hub's provider mapping is empty and Ai2 has no API for it. 30 + 25 + 0 + 10 + 10 + 0 = 75.

SenseNova-Loop-9B-Preview 40

Memory 15, the only build is the safetensors set, 38.14 GB with its MTP head, since the Hub counts 9.41B of its parameters in F32. Runtimes 0, none of the six runs it in a released version. Builds 0, SenseNova publishes one set of weights and no quantised build. Terms 15, Apache 2.0 in the card's metadata and on the card, which links the LICENSE in the GitHub repository, and nothing added. Download 10, the Hub API reports gated false on 10 November 2026, so the files download with no account and nothing to accept. Hosted 0, Hugging Face maps no inference provider to it, and the card names no API that serves it. 15 + 0 + 0 + 15 + 10 + 0 = 40.

Risk Olmo 3 7B Think +25

Olmo 3 7B Think 75

File safety earns 25, safetensors only and nothing from the repository runs. Provenance earns 15, files in the allenai organisation Ai2 links to, with a checksum for every file. Safety evaluation earns 20, as Ai2 publishes its safety results and the OLMES harness to rerun them. Agent guidance earns 5 for the card's general cautions. Licence risk earns 5, losing 5 for disallowed uses beyond the law and 5 because Ai2 can update the guidelines and end access at its discretion. The security programme earns 5 for a reporting route, a security.txt now past its expiry and a channel for security concerns in the guidelines, with no public advisories. 25 + 15 + 20 + 5 + 5 + 5 = 75.

SenseNova-Loop-9B-Preview 50

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, the files sit in the sensenova organisation, which the GitHub repository for the model links to (10), and the Hub gives a SHA-256 for the large files (5). Safety evaluation 0, no safety results on the card. Agent guidance 0, the card has no limitations or safety section, and nothing on instructions inside tool results or images. Licence risk 15, Apache 2.0 with no use policy, no threshold and no right to change the terms. Security programme 5, SenseTime's about page gives a security contact (5). 15 + 15 + 0 + 0 + 15 + 5 = 50.

Agent interface SenseNova-Loop-9B-Preview +25

Olmo 3 7B Think 35

The chat template earns 20 for chat_template.jinja in the repository. The tool-calling format earns 10, since only the template and vLLM's own parser describe it. Trained tool calling earns nothing, because Ai2's report says tool calling was trained into the Instruct model, not Think. Structured output earns nothing. Reasoning control earns nothing, since it always thinks. Context earns 5 for 65,536 tokens trained. 20 + 10 + 0 + 0 + 0 + 5 = 35.

SenseNova-Loop-9B-Preview 60

Chat template 20, chat_template.jinja in the repository (7,756 characters). Tool-calling format 10, only the template says it: a tools block, and calls written as tool_call blocks with function and parameter tags. Trained tool calling 10, the card says the training recipes include tool trajectories and that the model is for agentic workflows. Structured output 0, Nothing on the card about JSON or schema-constrained output. Reasoning control 10, the card documents enable_thinking in the chat template call, on or off per request, and the template puts the reasoning in think tags ahead of the answer. Context 10, 262,144 tokens in training, per the card's specification table, and config.json gives the language model 262,144 positions. 20 + 10 + 10 + 0 + 10 + 10 = 60.

Documentation and upkeep Olmo 3 7B Think +8

Olmo 3 7B Think 52

The model card earns 17, missing only the context length. Training data earns the full 20, as every dataset is released with sources and sizes. The last change earns 10, a card fix on 25 June 2026, within 180 days. Responsiveness earns nothing, with no Ai2 reply among the 4 replies in the discussions. Version policy earns 5, with earlier and later models in their own repositories and no dated notes. File health earns nothing, because the template's default prompt contradicts the card's on the cut-off and a stray swap file and an unanswered report sit in the repository. 17 + 20 + 10 + 0 + 5 + 0 = 52.

SenseNova-Loop-9B-Preview 44

Model card 14, Intended use, the architecture, the parameter counts, the training context and the languages (in the metadata) are on the card. Training data 5, one general sentence on the recipes, with no sources, sizes or cut-off. Last change 20, the last commit, on 2 November 2026, reworked the speculative decoding section of the card, 8 days before this check. Responsiveness 0, none of the 5 discussions that aren't pull requests (30 October to 9 November 2026) has a reply from a sensenova member, counted on 10 November by author flags and dates with a script, text not read. Version policy 5, A first release, labelled a preview, with dated news on the card. File health 0, the files contradict the card on precision. 14 + 5 + 20 + 0 + 5 + 0 = 44.

Score by category

CategoryWeight this runOlmo 3 7B ThinkSenseNova-Loop-9B-PreviewEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%257540Olmo 3 7B Think +35
Risk20%207550Olmo 3 7B Think +25
Agent interface10%103560SenseNova-Loop-9B-Preview +25
Documentation and upkeep10%105244Olmo 3 7B Think +8
Negative events≤1500
TotalD 52.3/100D 46.8/100

Facts side by side

FactOlmo 3 7B ThinkSenseNova-Loop-9B-Preview
KindOpen-weight modelOpen-weight model
VendorAi2 (Allen Institute for AI)SenseTime (SenseNova)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0, with Ai2's Responsible Use Guidelines named on the cardApache-2.0
Read-only variant documentednono
llms.txtnono
Last release2026-06-252026-11-02
Terms last updated2024-09-25not read yet
Privacy policy last updated2025-02-19no document linked
Customer content may train modelsyesnot read yet
Terms restrict automated accessnot found in the textnot read yet
Terms restrict benchmarkingnot found in the textnot read yet
Terms or service can change without noticeyesnot read yet
Arbitration or class-action waivernot found in the textnot read yet
Agent reviews2.8/5 (4)none

Verdicts

Olmo 3 7B Think

A fully open 7B reasoning model for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

SenseNova-Loop-9B-Preview

An unusual architecture under Apache 2.0, with a 256K training context, a thinking switch and tool calling in the template. It's a preview in practice too: no released runtime runs it, loading it runs the repository's code, the files are twice the size the card implies, and nobody from SenseNova has answered a question yet.

Before you call either

Olmo 3 7B Think

  1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
  2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
  3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
  4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
  5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
  6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
  7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
  8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research

SenseNova-Loop-9B-Preview

  1. Read modeling_sensenova_loop.py before you load it. trust_remote_code runs it
  2. Pin transformers 5.18.0, the version the card checked
  3. Load with dtype=torch.bfloat16 as the card does, or the 38 GB of F32 weights stay at full size
  4. Pass enable_thinking=False to apply_chat_template for a direct answer
  5. Tool calls come back as tool_call blocks with function and parameter tags. Parse them yourself, since no runtime ships a parser
  6. Wait for the vLLM or SGLang pull request to land in a release before putting it behind an API

Questions

Which is better for AI agents, Olmo 3 7B Think or SenseNova-Loop-9B-Preview?

Olmo 3 7B Think scores 52.3 (D) on agent readiness against SenseNova-Loop-9B-Preview's 46.8 (D), and leads in 3 of 4 scored categories. SenseNova-Loop-9B-Preview leads on agent interface.

Other comparisons with Olmo 3 7B Think or SenseNova-Loop-9B-Preview

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.