Head to head · Open-weight models you run yourself · October 2026 research run
Inkling 2 Small vs Mistral Large 4
Inkling 2 Small scores 58.8 (C) on agent readiness against Mistral Large 4's 54.6 (C), and leads in 1 of 4 scored categories. Mistral Large 4 leads on reach, risk and agent interface. Both do open-weight models you run yourself.
Best open-weight models you download and run yourself for AI agents · All 6472 open weights comparisons
Which one, for what
Best for Teams with 512 GB or more of datacentre GPU memory who want Thinking Machines' newest open multimodal agent model and can run a runtime's pre-release image.
No category where it leads by five points or more, and no fact that sets it apart.
Watch for
The smaller checkpoint needs about 472 GB, and Thinking Machines says 500 GB of GPU memory
Best for Operators with an 8-GPU Blackwell or H200 node who want a frontier-sized open model for coding agents and defensive security, with a hosted twin on Mistral's API.
Ahead on
- Reach, 50 against 40
- Risk, 75 against 65
- Agent interface, 95 against 85
Watch for
The smallest 4-bit build needs about 732 GB, so nothing fits a single workstation or a 128 GB machine
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Reach Mistral Large 4 +10
Inkling 2 Small 40
Memory 0 of 30, the smallest build is Thinking Machines' NVFP4 checkpoint at 393.5 GB, about 472 GB with a fifth added, above the 256 GB line. Runtimes 0, no released version of the six runs it; vLLM and SGLang serve it from their own images and Transformers has it on its main branch only. Builds 15, two precisions from the publisher (NVFP4 and MXFP8). Terms 10, Apache 2.0 with a binding acceptable use policy on top, read as a custom licence. Download 10, no gate. Hosted 5, Thinking Machines' own Tinker serves it as beta serverless inference, and Together is live on Hugging Face. 0 + 0 + 15 + 10 + 10 + 5 = 40.
Mistral Large 4 50
Memory scores 0, since the smallest 4-bit build, Mistral's NVFP4, is 610 GB, about 732 GB with a fifth added, far above 256 GB. Runtimes score 10, released Transformers and llama.cpp have the architecture, while vLLM v0.33.0 and SGLang v0.5.23 still lack it, the llama.cpp build Ollama 0.40.14 pins predates it, and LM Studio has no entry. Builds score 15 for Mistral's FP8 and NVFP4 releases. Terms score 10, a modified MIT licence that is free commercially except for Model-as-a-Service businesses. Download scores 10 with no gate, and hosted too scores 5 because Mistral's API serves these weights. 0 + 10 + 15 + 10 + 10 + 5 = 50.
Risk Mistral Large 4 +10
Inkling 2 Small 65
File safety 25, safetensors only and no repository code to run. Provenance 15, the files are in the organisation Thinking Machines links to, with a SHA-256 on every LFS file. Safety evaluation 10, Thinking Machines' own StrongREJECT, FORTRESS, HoneyBench and DistressBench results and described outside red-teaming, but nothing an outside party published or a harness to rerun. Agent guidance 5, the card names safeguards to add but doesn't say what its refusals cover, with nothing on prompt injection. Licence risk 5, 10 off for a use policy that reaches beyond the law and that can change at any time. Security programme 5, a security.txt and a disclosure policy, with public advisories unchecked and scored as absent. 25 + 15 + 10 + 5 + 5 + 5 = 65.
Mistral Large 4 75
File safety scores 25, safetensors only and loaded by Transformers' own code with a Jinja template. Provenance scores 15, Mistral's verified organisation with a hash on every file. Safety evaluation scores 10, refusal and prompt-injection results Mistral ran itself, listed in its 2 November technical report as internal, and red-teaming by outside firms with nothing published. Agent guidance scores 10 for a statement of what the refusals cover and a claim of trained injection resistance, with only general safeguards. Licence risk scores 10, 5 off for the Model-as-a-Service limit. The security programme scores 5 for security.txt with no public advisories. 25 + 15 + 10 + 10 + 10 + 5 = 75.
Agent interface Mistral Large 4 +10
Inkling 2 Small 85
Chat template 20, a Jinja file in the repository. Tool-calling format 25, Thinking Machines' tml-renderers guide shows how tools are declared and how calls come back for this model, and its package ships the parser. Trained tool calling 20, several calls in one turn. Structured output 0, not documented. Reasoning control 10, thinking effort is set per request from none to xhigh, and the reasoning comes back in reasoning_content. Context 10, up to 1M tokens. 20 + 25 + 20 + 0 + 10 + 10 = 85.
Mistral Large 4 95
The chat template is in the repository (20). The card documents how tools are declared and come back and names the parser (25), and the template renders several calls in one turn (20). Strict JSON Schema output is documented with how to ask for it (15). Reasoning effort is budgeted per request with the reasoning returned apart from the answer (10). Context scores 5, because the 1M window comes from YaRN scaling and the technical report gives 40K as the longest pretraining sequence. 20 + 25 + 20 + 15 + 10 + 5 = 95.
Score by category
| Category | Weight this run | Inkling 2 Small | Mistral Large 4 | Edge |
|---|---|---|---|---|
| Capability | 35%pending | pending | pending | not scored in this run |
| Reach | 25%25 | 40 | 50 | Mistral Large 4 +10 |
| Risk | 20%20 | 65 | 75 | Mistral Large 4 +10 |
| Agent interface | 10%10 | 85 | 95 | Mistral Large 4 +10 |
| Documentation and upkeep | 10%10 | 67 | 64 | Inkling 2 Small +3 |
| Negative events | ≤15 | 0 | 0 | |
| Total | C 58.8/100 | C 54.6/100 |
Facts side by side
| Fact | Inkling 2 Small | Mistral Large 4 |
|---|---|---|
| Kind | Open-weight model | Open-weight model |
| Vendor | Thinking Machines Lab | Mistral AI |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | ||
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | Apache-2.0 | Mistral Ecosystem Open-Weight License (modified MIT) |
| Read-only variant documented | no | no |
| llms.txt | no | no |
| Last release | 2026-11-12 | 2026-10-29 |
| Terms last updated | no document linked | no document linked |
| Privacy policy last updated | no document linked | no document linked |
How the scores have moved
Mistral Large 4
No score change since it was listed.
Verdicts
Inkling 2 Small
Thinking Machines' newest open model, a 594B mixture-of-experts generalist with images in, several tool calls a turn and per-request thinking effort. The NVFP4 checkpoint needs about 472 GB, and no released runtime runs it yet, so today that means vLLM's or SGLang's own images, or Tinker and Together hosted. The use policy binds on download and can change.
Mistral Large 4
A 1T-parameter mixture-of-experts model from Mistral for coding agents and defensive security, with strict JSON Schema output, parallel tool calls and three reasoning efforts. It needs a multi-GPU server, about 732 GB for the smallest 4-bit build, and no released vLLM or SGLang loads it. The licence bars Model-as-a-Service businesses without a separate deal.
Before you call either
Inkling 2 Small
- No released runtime runs it yet. Serve the NVFP4 checkpoint from SGLang's dev-inkling-2-small image with the cookbook's recipe for your hardware, or from vLLM's vllm/vllm-openai:inkling-2-small image
- In vLLM pass
--reasoning-parser inkling --enable-auto-tool-choice --tool-call-parser inkling. In SGLang the tool-call parser isinkling2and the reasoning parserinkling - Transformers' main branch loads only thinkingmachines/Inkling-2-Small-MXFP8, the 622.8 GB checkpoint, and no release has the code yet
- Pass
reasoning_effortas none, minimal, low, medium, high (the default), xhigh or max, or a number from 0 to 0.99 - Effort none conditions the model toward no reasoning but doesn't forbid it, and higher effort needs a larger max_tokens
- Tool call arguments must reach the template as an object, not a JSON string, or it raises an error
- Images should be 40 to 4096 px a side. The model takes no audio, and the template raises an error for an audio part
- Use guided decoding or validate JSON yourself, since structured output isn't documented
- Without the hardware, call it on Tinker's OpenAI-compatible endpoint with a Tinker key, at $0.30 input and $1.00 output per million tokens as read on 6 November 2026
- Read the Model Acceptable Use Policy before deploying, it binds on download and bars some uses that are legal
Mistral Large 4
- Serve the NVFP4 build on Blackwell with
vllm/vllm-openai:mistral-large-4 --model mistralai/Mistral-Large-4-1T-A52B-NVFP4 --tensor-parallel-size 8 --kv-cache-dtype fp8_ds_mla --tool-call-parser mistral --reasoning-parser mistral --enable-auto-tool-choice; released vLLM doesn't load it - On H200 use the FP8 build with tensor parallelism of 16 or 8 by 2 pipelines, per vLLM's recipe
- Pass
reasoning_effortlow, medium or high (default high); any other value makes the template raise an error, and there is no off switch - Read the reasoning from
message.reasoning;max_completion_tokenscounts reasoning tokens too - Use temperature 1.0 and top_p 0.95 at every effort, per the card
- Ask for JSON with
response_formattype json_schema and strict true; the template passes the schema to the model - The template rejects a tool message straight after a user message and a conversation that doesn't start with a user or system message
- Add
--speculative-config '{"method": "dspark", "num_speculative_tokens": 3}'to use the embedded draft head - If you'll offer it to others as a hosted model, read the licence first; Model-as-a-Service use needs Mistral's commercial licence
Questions
Which is better for AI agents, Inkling 2 Small or Mistral Large 4?
Inkling 2 Small scores 58.8 (C) on agent readiness against Mistral Large 4's 54.6 (C), and leads in 1 of 4 scored categories. Mistral Large 4 leads on reach, risk and agent interface.
Other comparisons with Inkling 2 Small or Mistral Large 4
- Agents-A1-4B vs Inkling 2 Small
- Agents-A1-4B vs Mistral Large 4
- Apertus v1.5 8B vs Inkling 2 Small
- Apertus v1.5 8B vs Mistral Large 4
- Apodex-1.1-mini vs Inkling 2 Small
- Apodex-1.1-mini vs Mistral Large 4
- Arete-27B vs Inkling 2 Small
- Arete-27B vs Mistral Large 4
- BigBang-v1 vs Inkling 2 Small
- BigBang-v1 vs Mistral Large 4
- Carbon-X vs Inkling 2 Small
- Carbon-X vs Mistral Large 4
- Cola2 vs Inkling 2 Small
- Cola2 vs Mistral Large 4
- Cosmos-Reason2-2B vs Inkling 2 Small
- Cosmos-Reason2-2B vs Mistral Large 4
- Darwin-36B-Opus vs Inkling 2 Small
- Darwin-36B-Opus vs Mistral Large 4
- DeepSeek-V3.2 vs Inkling 2 Small
- DeepSeek-V3.2 vs Mistral Large 4
- DeepSeek V4.1 Flash vs Inkling 2 Small
- DeepSeek V4.1 Flash vs Mistral Large 4
- DeepSeek-V4-Flash-0731 vs Inkling 2 Small
- DeepSeek-V4-Flash-0731 vs Mistral Large 4
- Devstral Small 2 vs Inkling 2 Small
- Devstral Small 2 vs Mistral Large 4
- DiffusionGemma 26B A4B IT vs Inkling 2 Small
- DiffusionGemma 26B A4B IT vs Mistral Large 4
- EXAONE 4.5 33B vs Inkling 2 Small
- EXAONE 4.5 33B vs Mistral Large 4
- Gemma 4 12B IT vs Inkling 2 Small
- Gemma 4 12B IT vs Mistral Large 4
- Gemma 4 26B A4B IT vs Inkling 2 Small
- Gemma 4 26B A4B IT vs Mistral Large 4
- Gemma 4 31B IT vs Inkling 2 Small
- Gemma 4 31B IT vs Mistral Large 4
- Gemma 4 E2B IT vs Inkling 2 Small
- Gemma 4 E2B IT vs Mistral Large 4
- Gemma 4 E4B IT vs Inkling 2 Small
- Gemma 4 E4B IT vs Mistral Large 4
- GLM-4.5-Air vs Inkling 2 Small
- GLM-4.5-Air vs Mistral Large 4
- GLM-4.7-Flash vs Inkling 2 Small
- GLM-4.7-Flash vs Mistral Large 4
- GLM-5.3-Flash vs Inkling 2 Small
- GLM-5.3-Flash vs Mistral Large 4
- GLM-5.3 vs Inkling 2 Small
- GLM-5.3 vs Mistral Large 4
- gpt-oss-120b vs Inkling 2 Small
- gpt-oss-120b vs Mistral Large 4
- gpt-oss-20b vs Inkling 2 Small
- gpt-oss-20b vs Mistral Large 4
- Granite 4.2 30B vs Inkling 2 Small
- Granite 4.2 30B vs Mistral Large 4
- Granite 4.2 3B vs Inkling 2 Small
- Granite 4.2 3B vs Mistral Large 4
- Granite 4.2 8B vs Inkling 2 Small
- Granite 4.2 8B vs Mistral Large 4
- Hy-Memory-30B-A3B vs Inkling 2 Small
- Hy-Memory-30B-A3B vs Mistral Large 4
- Hy3 vs Inkling 2 Small
- Hy3 vs Mistral Large 4
- Inkling 2 Small vs Inkling-Small
- Inkling 2 Small vs InternVL3.5-GPT-OSS-20B-A4B-Preview
- Inkling 2 Small vs Kimi K3
- Inkling 2 Small vs Kimi K3.1 Pro
- Inkling 2 Small vs Kolibri-1
- Inkling 2 Small vs Kronos
- Inkling 2 Small vs Laguna M.1
- Inkling 2 Small vs Laguna S 2.1
- Inkling 2 Small vs Laguna XS 2.1
- Inkling 2 Small vs LBS-27B
- Inkling 2 Small vs LFM2.5-2.6B
- Inkling 2 Small vs LFM3-1.7B
- Inkling 2 Small vs LFM3-Audio-2B
- Inkling 2 Small vs LFM3-Omni-2B
- Inkling 2 Small vs LFM3-VL-2B
- Inkling 2 Small vs Ling-3.0-tiny
- Inkling 2 Small vs Ling-3.1-flash-1019
- Inkling 2 Small vs LongCat-2.5
- Inkling 2 Small vs MiMo-V2.6 Distill Qwen 9B
- Inkling 2 Small vs MiMo-V2.6-Flash-RL
- Inkling 2 Small vs MiniCPM-o 4.5
- Inkling 2 Small vs MiniCPM-V 4.7 1B
- Inkling 2 Small vs MiniCPM-V 4.7 35B-A3B
- Inkling 2 Small vs MiniCPM5-2B
- Inkling 2 Small vs MiniMax-M2.5
- Inkling 2 Small vs MiniMax-M2.7
- Inkling 2 Small vs MiniMax-M3.1-Flash
- Inkling 2 Small vs Muse Glimmer 30B
- Inkling 2 Small vs Nanbeige4.2-3B
- Inkling 2 Small vs Nanbeige4.3-33B
- Inkling 2 Small vs NVIDIA Nemotron 3.5 Bolt E4B 4GB
- Inkling 2 Small vs Nemotron 3.5 Lightning 30B A3B
- Inkling 2 Small vs Nemotron 3 Nano 30B A3B
- Inkling 2 Small vs Nemotron 3 Nano 4B
- Inkling 2 Small vs Nemotron 3 Nano Omni 30B A3B Reasoning
- Inkling 2 Small vs Nemotron 3 Super 120B A12B
- Inkling 2 Small vs Nemotron 3 Ultra 550B A55B
- Inkling 2 Small vs North Mini Code 1.0
- Inkling 2 Small vs occamy-1.0
- Inkling 2 Small vs Olmo 3 7B Think
- Inkling 2 Small vs Ornith-1.5-122B
- Inkling 2 Small vs Ornith-1.5-35B-A3B
- Inkling 2 Small vs Ornith-1.5-397B
- Inkling 2 Small vs Ornith-1.5-9B
- Inkling 2 Small vs OTel-2.0-LLM-31B-IT
- Inkling 2 Small vs Qwen-AgentWorld-35B-A3B
- Inkling 2 Small vs Qwen3-30B-A3B-Instruct-2507
- Inkling 2 Small vs Qwen3-4B-Instruct-2507
- Inkling 2 Small vs Qwen3.5-0.8B
- Inkling 2 Small vs Qwen3.5-122B-A10B
- Inkling 2 Small vs Qwen3.5-2B
- Inkling 2 Small vs Qwen3.5-397B-A17B
- Inkling 2 Small vs Qwen3.5-4B
- Inkling 2 Small vs Qwen3.5-9B
- Inkling 2 Small vs Qwen3.6-27B
- Inkling 2 Small vs Qwen3.6-35B-A3B
- Inkling 2 Small vs Qwen3.8-27B
- Inkling 2 Small vs Qwen3.8-Flash-Next
- Inkling 2 Small vs Qwen3-Coder-30B-A3B-Instruct
- Inkling 2 Small vs Qwen3-Coder-Next
- Inkling 2 Small vs Qwen3-Omni-30B-A3B-Instruct
- Inkling 2 Small vs Qwen3-VL-2B-Instruct
- Inkling 2 Small vs Qwen3-VL-30B-A3B-Instruct
- Inkling 2 Small vs Qwen3-VL-32B-Instruct
- Inkling 2 Small vs Qwen3-VL-4B-Instruct
- Inkling 2 Small vs Qwen3-VL-8B-Instruct
- Inkling 2 Small vs Qwopus3.8-27B-Flash-V2
- Inkling 2 Small vs Recursive Flint
- Inkling 2 Small vs Ripple-65B Preview
- Inkling 2 Small vs SenseNova-Loop-9B-Preview
- Inkling 2 Small vs SmolLM3-3B
- Inkling 2 Small vs Spark-X2.6-4B
- Inkling 2 Small vs Step 3.7 Flash
- Inkling 2 Small vs Swift 1.5 Qwen3.8-27B
- Inkling 2 Small vs Swift 1.5 Qwen3.8-Flash-Next
- Inkling 2 Small vs ThinkingCap (Qwen3.8 27B)
- Inkling 2 Small vs Baidu Unlimited-OCR-2
- Inkling 2 Small vs WeVisOne-VL-2B
- Inkling 2 Small vs WeVisOne-VL-4B
- Inkling 2 Small vs ZAYA1-8B
- Inkling-Small vs Mistral Large 4
- Inkling vs Inkling 2 Small
- Inkling vs Mistral Large 4
- InternVL3.5-GPT-OSS-20B-A4B-Preview vs Mistral Large 4
- Kimi K3.1 Pro vs Mistral Large 4
- Kimi K3 vs Mistral Large 4
- Kolibri-1 vs Mistral Large 4
- Kronos vs Mistral Large 4
- Laguna M.1 vs Mistral Large 4
- Laguna S 2.1 vs Mistral Large 4
- Laguna XS 2.1 vs Mistral Large 4
- LBS-27B vs Mistral Large 4
- LFM2.5-2.6B vs Mistral Large 4
- LFM3-1.7B vs Mistral Large 4
- LFM3-Audio-2B vs Mistral Large 4
- LFM3-Omni-2B vs Mistral Large 4
- LFM3-VL-2B vs Mistral Large 4
- Ling-3.0-tiny vs Mistral Large 4
- Ling-3.1-flash-1019 vs Mistral Large 4
- LongCat-2.5 vs Mistral Large 4
- MiMo-V2.6 Distill Qwen 9B vs Mistral Large 4
- MiMo-V2.6-Flash-RL vs Mistral Large 4
- MiniCPM-o 4.5 vs Mistral Large 4
- MiniCPM-V 4.7 1B vs Mistral Large 4
- MiniCPM-V 4.7 35B-A3B vs Mistral Large 4
- MiniCPM5-2B vs Mistral Large 4
- MiniMax-M2.5 vs Mistral Large 4
- MiniMax-M2.7 vs Mistral Large 4
- MiniMax-M3.1-Flash vs Mistral Large 4
- Mistral Large 4 vs Muse Glimmer 30B
- Mistral Large 4 vs Nanbeige4.2-3B
- Mistral Large 4 vs Nanbeige4.3-33B
- Mistral Large 4 vs NVIDIA Nemotron 3.5 Bolt E4B 4GB
- Mistral Large 4 vs Nemotron 3.5 Lightning 30B A3B
- Mistral Large 4 vs Nemotron 3 Nano 30B A3B
- Mistral Large 4 vs Nemotron 3 Nano 4B
- Mistral Large 4 vs Nemotron 3 Nano Omni 30B A3B Reasoning
- Mistral Large 4 vs Nemotron 3 Super 120B A12B
- Mistral Large 4 vs Nemotron 3 Ultra 550B A55B
- Mistral Large 4 vs North Mini Code 1.0
- Mistral Large 4 vs occamy-1.0
- Mistral Large 4 vs Olmo 3 7B Think
- Mistral Large 4 vs Ornith-1.5-122B
- Mistral Large 4 vs Ornith-1.5-35B-A3B
- Mistral Large 4 vs Ornith-1.5-397B
- Mistral Large 4 vs Ornith-1.5-9B
- Mistral Large 4 vs OTel-2.0-LLM-31B-IT
- Mistral Large 4 vs Qwen-AgentWorld-35B-A3B
- Mistral Large 4 vs Qwen3-30B-A3B-Instruct-2507
- Mistral Large 4 vs Qwen3-4B-Instruct-2507
- Mistral Large 4 vs Qwen3.5-0.8B
- Mistral Large 4 vs Qwen3.5-122B-A10B
- Mistral Large 4 vs Qwen3.5-2B
- Mistral Large 4 vs Qwen3.5-397B-A17B
- Mistral Large 4 vs Qwen3.5-4B
- Mistral Large 4 vs Qwen3.5-9B
- Mistral Large 4 vs Qwen3.6-27B
- Mistral Large 4 vs Qwen3.6-35B-A3B
- Mistral Large 4 vs Qwen3.8-27B
- Mistral Large 4 vs Qwen3.8-Flash-Next
- Mistral Large 4 vs Qwen3-Coder-30B-A3B-Instruct
- Mistral Large 4 vs Qwen3-Coder-Next
- Mistral Large 4 vs Qwen3-Omni-30B-A3B-Instruct
- Mistral Large 4 vs Qwen3-VL-2B-Instruct
- Mistral Large 4 vs Qwen3-VL-30B-A3B-Instruct
- Mistral Large 4 vs Qwen3-VL-32B-Instruct
- Mistral Large 4 vs Qwen3-VL-4B-Instruct
- Mistral Large 4 vs Qwen3-VL-8B-Instruct
- Mistral Large 4 vs Qwopus3.8-27B-Flash-V2
- Mistral Large 4 vs Recursive Flint
- Mistral Large 4 vs Ripple-65B Preview
- Mistral Large 4 vs SenseNova-Loop-9B-Preview
- Mistral Large 4 vs SmolLM3-3B
- Mistral Large 4 vs Spark-X2.6-4B
- Mistral Large 4 vs Step 3.7 Flash
- Mistral Large 4 vs Swift 1.5 Qwen3.8-27B
- Mistral Large 4 vs Swift 1.5 Qwen3.8-Flash-Next
- Mistral Large 4 vs ThinkingCap (Qwen3.8 27B)
- Mistral Large 4 vs Baidu Unlimited-OCR-2
- Mistral Large 4 vs WeVisOne-VL-2B
- Mistral Large 4 vs WeVisOne-VL-4B
- Mistral Large 4 vs ZAYA1-8B
Machine-readable
- This page as Markdown
/compare/inkling-2-small-vs-mistral-large-4.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/inkling-2-small.json·/api/v1/tools/mistral-large-4.json - From a terminal
anchor compare inkling-2-small mistral-large-4(the CLI) - Over MCP
compare_tools {"a": "inkling-2-small", "b": "mistral-large-4"}at/mcp, no key