Head to head · Open-weight models you run yourself · October 2026 research run
Inkling 2 Small vs LFM3-1.7B
LFM3-1.7B scores 61 (C) on agent readiness against Inkling 2 Small's 58.8 (C), and leads in 2 of 4 scored categories. Inkling 2 Small leads on risk. Both do open-weight models you run yourself.
Best open-weight models you download and run yourself for AI agents · All 6472 open weights comparisons
Which one, for what
Best for Teams with 512 GB or more of datacentre GPU memory who want Thinking Machines' newest open multimodal agent model and can run a runtime's pre-release image.
Ahead on
- Risk, 65 against 40
Watch for
The smaller checkpoint needs about 472 GB, and Thinking Machines says 500 GB of GPU memory
Best for Agents on a laptop, phone or small server that need tool calling and a long context from a model under 2 GB at 4 bits
Ahead on
- Reach, 85 against 40
- Agent interface, 100 against 85
Watch for
vLLM and SGLang have no released support, though the card lists both
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Reach LFM3-1.7B +45
Inkling 2 Small 40
Memory 0 of 30, the smallest build is Thinking Machines' NVFP4 checkpoint at 393.5 GB, about 472 GB with a fifth added, above the 256 GB line. Runtimes 0, no released version of the six runs it; vLLM and SGLang serve it from their own images and Transformers has it on its main branch only. Builds 15, two precisions from the publisher (NVFP4 and MXFP8). Terms 10, Apache 2.0 with a binding acceptable use policy on top, read as a custom licence. Download 10, no gate. Hosted 5, Thinking Machines' own Tinker serves it as beta serverless inference, and Together is live on Hugging Face. 0 + 0 + 15 + 10 + 10 + 5 = 40.
LFM3-1.7B 85
Memory 30, Liquid's Q4_K_M GGUF is 1.10 GB, and 1.10 GB × 1.2 = 1.3 GB, which fits 8 GB, well inside the 16 GB line. Runtimes 15, Released llama.cpp has the lfm3 architecture (src/models/lfm3.cpp at b12242), Ollama's library has an lfm3 entry, and LM Studio's catalogue runs the architecture (its liquid/lfm3-vl-2b entry; lmstudio-community publishes a GGUF of this model). Builds 15, Liquid's GGUF repository holds Q4_0, Q4_K_M, Q8_0, F16 and BF16 files, and Liquid publishes 4-bit and 8-bit MLX builds and an ONNX repository, all in the LiquidAI organisation. Terms 10, the LFM Open License v1.0, a custom licence that lets anyone use it commercially for free below a threshold of $10M annual revenue. Download 10, the Hub API reports gated false for the model and its GGUF, MLX and ONNX repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, Liquid's own API lists lfm3-1.7b among its models, so the publisher hosts it. 30 + 15 + 15 + 10 + 10 + 5 = 85.
Risk Inkling 2 Small +25
Inkling 2 Small 65
File safety 25, safetensors only and no repository code to run. Provenance 15, the files are in the organisation Thinking Machines links to, with a SHA-256 on every LFS file. Safety evaluation 10, Thinking Machines' own StrongREJECT, FORTRESS, HoneyBench and DistressBench results and described outside red-teaming, but nothing an outside party published or a harness to rerun. Agent guidance 5, the card names safeguards to add but doesn't say what its refusals cover, with nothing on prompt injection. Licence risk 5, 10 off for a use policy that reaches beyond the law and that can change at any time. Security programme 5, a security.txt and a disclosure policy, with public advisories unchecked and scored as absent. 25 + 15 + 10 + 5 + 5 + 5 = 65.
LFM3-1.7B 40
File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, files in the LiquidAI organisation, which Liquid's docs page for the model and its blog post link to (10). Safety evaluation 0, no safety results on the card or in Liquid's blog post for the LFM3 family, neither of which mentions safety testing. Agent guidance 0, Nothing on prompt injection, an instruction hierarchy, what refusals cover or safeguards to add. Licence risk 10, 15 less 5 for the $10M annual revenue threshold on commercial use. Security programme 0, no way to report a flaw found. 15 + 15 + 0 + 0 + 10 + 0 = 40.
Agent interface LFM3-1.7B +15
Inkling 2 Small 85
Chat template 20, a Jinja file in the repository. Tool-calling format 25, Thinking Machines' tml-renderers guide shows how tools are declared and how calls come back for this model, and its package ships the parser. Trained tool calling 20, several calls in one turn. Structured output 0, not documented. Reasoning control 10, thinking effort is set per request from none to xhigh, and the reasoning comes back in reasoning_content. Context 10, up to 1M tokens. 20 + 25 + 20 + 0 + 10 + 10 = 85.
LFM3-1.7B 100
Chat template 20, chat_template.jinja in the repository (12,129 characters), with roles, tools, deferred tools, tool results and the thinking switch. Tool-calling format 25, the card and Liquid's tool-use page document tools passed through tools= in apply_chat_template, calls returned as XML and results sent back as tool messages. Trained tool calling 20, the template loops over every entry in an assistant turn's tool_calls, so several calls fit in one turn, and the card says the model was trained on tool calls and agentic traces and with reinforcement learning inside agent harnesses. Structured output 15, Liquid's API guide documents response_format with a JSON Schema, with lfm3-1.7b as the model in its examples, and says the schema is checked before generation starts. Reasoning control 10, the card documents enable_thinking=False in the chat template to turn reasoning off per request, with reasoning on by default inside think tags, and preserve_thinking for earlier turns. Context 10, 256K tokens per the card, which says the mid-training stage extended the context window to 256K, and max_position_embeddings 262144 in config.json. 20 + 25 + 20 + 15 + 10 + 10 = 100.
Score by category
| Category | Weight this run | Inkling 2 Small | LFM3-1.7B | Edge |
|---|---|---|---|---|
| Capability | 35%pending | pending | pending | not scored in this run |
| Reach | 25%25 | 40 | 85 | LFM3-1.7B +45 |
| Risk | 20%20 | 65 | 40 | Inkling 2 Small +25 |
| Agent interface | 10%10 | 85 | 100 | LFM3-1.7B +15 |
| Documentation and upkeep | 10%10 | 67 | 67 | even |
| Negative events | ≤15 | 0 | 0 | |
| Total | C 58.8/100 | C 61/100 |
Facts side by side
| Fact | Inkling 2 Small | LFM3-1.7B |
|---|---|---|
| Kind | Open-weight model | Open-weight model |
| Vendor | Thinking Machines Lab | Liquid AI |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | ||
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | Apache-2.0 | LFM Open License v1.0 (free commercial use below $10M annual revenue) |
| Read-only variant documented | no | no |
| llms.txt | no | yes |
| Last release | 2026-11-12 | 2026-11-09 |
| Terms last updated | no document linked | no document linked |
| Privacy policy last updated | no document linked | no document linked |
How the scores have moved
LFM3-1.7B
No score change since it was listed.
Verdicts
Inkling 2 Small
Thinking Machines' newest open model, a 594B mixture-of-experts generalist with images in, several tool calls a turn and per-request thinking effort. The NVFP4 checkpoint needs about 472 GB, and no released runtime runs it yet, so today that means vLLM's or SGLang's own images, or Tinker and Together hosted. The use policy binds on download and can change.
LFM3-1.7B
A 1.73B model that fits an 8 GB machine with room to spare, with a documented tool-call format, deferred tools, a thinking switch and a 256K context. It runs today in llama.cpp, Ollama and LM Studio only, loads in Transformers through repository code, and has no safety results, security contact or data sources.
Before you call either
Inkling 2 Small
- No released runtime runs it yet. Serve the NVFP4 checkpoint from SGLang's dev-inkling-2-small image with the cookbook's recipe for your hardware, or from vLLM's vllm/vllm-openai:inkling-2-small image
- In vLLM pass
--reasoning-parser inkling --enable-auto-tool-choice --tool-call-parser inkling. In SGLang the tool-call parser isinkling2and the reasoning parserinkling - Transformers' main branch loads only thinkingmachines/Inkling-2-Small-MXFP8, the 622.8 GB checkpoint, and no release has the code yet
- Pass
reasoning_effortas none, minimal, low, medium, high (the default), xhigh or max, or a number from 0 to 0.99 - Effort none conditions the model toward no reasoning but doesn't forbid it, and higher effort needs a larger max_tokens
- Tool call arguments must reach the template as an object, not a JSON string, or it raises an error
- Images should be 40 to 4096 px a side. The model takes no audio, and the template raises an error for an audio part
- Use guided decoding or validate JSON yourself, since structured output isn't documented
- Without the hardware, call it on Tinker's OpenAI-compatible endpoint with a Tinker key, at $0.30 input and $1.00 output per million tokens as read on 6 November 2026
- Read the Model Acceptable Use Policy before deploying, it binds on download and bars some uses that are legal
LFM3-1.7B
- Start it with
llama-server -hf LiquidAI/LFM3-1.7B-GGUF:Q4_K_M --jinjaorollama run lfm3 - Use temperature 0.1, top_k 50 and repetition penalty 1.1 for chat, tools and agents, per the card
- Pass
enable_thinking=Falsefor direct answers, and expect it to reason anyway on hard tasks - For a large tool catalogue mark tools
defer_loadingand give it a search tool - Don't plan on vLLM or SGLang until a release carries LFM3
- Liquid doesn't recommend it for agentic coding or complex multi-step reasoning
Questions
Which is better for AI agents, Inkling 2 Small or LFM3-1.7B?
LFM3-1.7B scores 61 (C) on agent readiness against Inkling 2 Small's 58.8 (C), and leads in 2 of 4 scored categories. Inkling 2 Small leads on risk.
Other comparisons with Inkling 2 Small or LFM3-1.7B
- Agents-A1-4B vs Inkling 2 Small
- Agents-A1-4B vs LFM3-1.7B
- Apertus v1.5 8B vs Inkling 2 Small
- Apertus v1.5 8B vs LFM3-1.7B
- Apodex-1.1-mini vs Inkling 2 Small
- Apodex-1.1-mini vs LFM3-1.7B
- Arete-27B vs Inkling 2 Small
- Arete-27B vs LFM3-1.7B
- BigBang-v1 vs Inkling 2 Small
- BigBang-v1 vs LFM3-1.7B
- Carbon-X vs Inkling 2 Small
- Carbon-X vs LFM3-1.7B
- Cola2 vs Inkling 2 Small
- Cola2 vs LFM3-1.7B
- Cosmos-Reason2-2B vs Inkling 2 Small
- Cosmos-Reason2-2B vs LFM3-1.7B
- Darwin-36B-Opus vs Inkling 2 Small
- Darwin-36B-Opus vs LFM3-1.7B
- DeepSeek-V3.2 vs Inkling 2 Small
- DeepSeek-V3.2 vs LFM3-1.7B
- DeepSeek V4.1 Flash vs Inkling 2 Small
- DeepSeek V4.1 Flash vs LFM3-1.7B
- DeepSeek-V4-Flash-0731 vs Inkling 2 Small
- DeepSeek-V4-Flash-0731 vs LFM3-1.7B
- Devstral Small 2 vs Inkling 2 Small
- Devstral Small 2 vs LFM3-1.7B
- DiffusionGemma 26B A4B IT vs Inkling 2 Small
- DiffusionGemma 26B A4B IT vs LFM3-1.7B
- EXAONE 4.5 33B vs Inkling 2 Small
- EXAONE 4.5 33B vs LFM3-1.7B
- Gemma 4 12B IT vs Inkling 2 Small
- Gemma 4 12B IT vs LFM3-1.7B
- Gemma 4 26B A4B IT vs Inkling 2 Small
- Gemma 4 26B A4B IT vs LFM3-1.7B
- Gemma 4 31B IT vs Inkling 2 Small
- Gemma 4 31B IT vs LFM3-1.7B
- Gemma 4 E2B IT vs Inkling 2 Small
- Gemma 4 E2B IT vs LFM3-1.7B
- Gemma 4 E4B IT vs Inkling 2 Small
- Gemma 4 E4B IT vs LFM3-1.7B
- GLM-4.5-Air vs Inkling 2 Small
- GLM-4.5-Air vs LFM3-1.7B
- GLM-4.7-Flash vs Inkling 2 Small
- GLM-4.7-Flash vs LFM3-1.7B
- GLM-5.3-Flash vs Inkling 2 Small
- GLM-5.3-Flash vs LFM3-1.7B
- GLM-5.3 vs Inkling 2 Small
- GLM-5.3 vs LFM3-1.7B
- gpt-oss-120b vs Inkling 2 Small
- gpt-oss-120b vs LFM3-1.7B
- gpt-oss-20b vs Inkling 2 Small
- gpt-oss-20b vs LFM3-1.7B
- Granite 4.2 30B vs Inkling 2 Small
- Granite 4.2 30B vs LFM3-1.7B
- Granite 4.2 3B vs Inkling 2 Small
- Granite 4.2 3B vs LFM3-1.7B
- Granite 4.2 8B vs Inkling 2 Small
- Granite 4.2 8B vs LFM3-1.7B
- Hy-Memory-30B-A3B vs Inkling 2 Small
- Hy-Memory-30B-A3B vs LFM3-1.7B
- Hy3 vs Inkling 2 Small
- Hy3 vs LFM3-1.7B
- Inkling 2 Small vs Inkling-Small
- Inkling 2 Small vs InternVL3.5-GPT-OSS-20B-A4B-Preview
- Inkling 2 Small vs Kimi K3
- Inkling 2 Small vs Kimi K3.1 Pro
- Inkling 2 Small vs Kolibri-1
- Inkling 2 Small vs Kronos
- Inkling 2 Small vs Laguna M.1
- Inkling 2 Small vs Laguna S 2.1
- Inkling 2 Small vs Laguna XS 2.1
- Inkling 2 Small vs LBS-27B
- Inkling 2 Small vs LFM2.5-2.6B
- Inkling 2 Small vs LFM3-Audio-2B
- Inkling 2 Small vs LFM3-Omni-2B
- Inkling 2 Small vs LFM3-VL-2B
- Inkling 2 Small vs Ling-3.0-tiny
- Inkling 2 Small vs Ling-3.1-flash-1019
- Inkling 2 Small vs LongCat-2.5
- Inkling 2 Small vs MiMo-V2.6 Distill Qwen 9B
- Inkling 2 Small vs MiMo-V2.6-Flash-RL
- Inkling 2 Small vs MiniCPM-o 4.5
- Inkling 2 Small vs MiniCPM-V 4.7 1B
- Inkling 2 Small vs MiniCPM-V 4.7 35B-A3B
- Inkling 2 Small vs MiniCPM5-2B
- Inkling 2 Small vs MiniMax-M2.5
- Inkling 2 Small vs MiniMax-M2.7
- Inkling 2 Small vs MiniMax-M3.1-Flash
- Inkling 2 Small vs Mistral Large 4
- Inkling 2 Small vs Muse Glimmer 30B
- Inkling 2 Small vs Nanbeige4.2-3B
- Inkling 2 Small vs Nanbeige4.3-33B
- Inkling 2 Small vs NVIDIA Nemotron 3.5 Bolt E4B 4GB
- Inkling 2 Small vs Nemotron 3.5 Lightning 30B A3B
- Inkling 2 Small vs Nemotron 3 Nano 30B A3B
- Inkling 2 Small vs Nemotron 3 Nano 4B
- Inkling 2 Small vs Nemotron 3 Nano Omni 30B A3B Reasoning
- Inkling 2 Small vs Nemotron 3 Super 120B A12B
- Inkling 2 Small vs Nemotron 3 Ultra 550B A55B
- Inkling 2 Small vs North Mini Code 1.0
- Inkling 2 Small vs occamy-1.0
- Inkling 2 Small vs Olmo 3 7B Think
- Inkling 2 Small vs Ornith-1.5-122B
- Inkling 2 Small vs Ornith-1.5-35B-A3B
- Inkling 2 Small vs Ornith-1.5-397B
- Inkling 2 Small vs Ornith-1.5-9B
- Inkling 2 Small vs OTel-2.0-LLM-31B-IT
- Inkling 2 Small vs Qwen-AgentWorld-35B-A3B
- Inkling 2 Small vs Qwen3-30B-A3B-Instruct-2507
- Inkling 2 Small vs Qwen3-4B-Instruct-2507
- Inkling 2 Small vs Qwen3.5-0.8B
- Inkling 2 Small vs Qwen3.5-122B-A10B
- Inkling 2 Small vs Qwen3.5-2B
- Inkling 2 Small vs Qwen3.5-397B-A17B
- Inkling 2 Small vs Qwen3.5-4B
- Inkling 2 Small vs Qwen3.5-9B
- Inkling 2 Small vs Qwen3.6-27B
- Inkling 2 Small vs Qwen3.6-35B-A3B
- Inkling 2 Small vs Qwen3.8-27B
- Inkling 2 Small vs Qwen3.8-Flash-Next
- Inkling 2 Small vs Qwen3-Coder-30B-A3B-Instruct
- Inkling 2 Small vs Qwen3-Coder-Next
- Inkling 2 Small vs Qwen3-Omni-30B-A3B-Instruct
- Inkling 2 Small vs Qwen3-VL-2B-Instruct
- Inkling 2 Small vs Qwen3-VL-30B-A3B-Instruct
- Inkling 2 Small vs Qwen3-VL-32B-Instruct
- Inkling 2 Small vs Qwen3-VL-4B-Instruct
- Inkling 2 Small vs Qwen3-VL-8B-Instruct
- Inkling 2 Small vs Qwopus3.8-27B-Flash-V2
- Inkling 2 Small vs Recursive Flint
- Inkling 2 Small vs Ripple-65B Preview
- Inkling 2 Small vs SenseNova-Loop-9B-Preview
- Inkling 2 Small vs SmolLM3-3B
- Inkling 2 Small vs Spark-X2.6-4B
- Inkling 2 Small vs Step 3.7 Flash
- Inkling 2 Small vs Swift 1.5 Qwen3.8-27B
- Inkling 2 Small vs Swift 1.5 Qwen3.8-Flash-Next
- Inkling 2 Small vs ThinkingCap (Qwen3.8 27B)
- Inkling 2 Small vs Baidu Unlimited-OCR-2
- Inkling 2 Small vs WeVisOne-VL-2B
- Inkling 2 Small vs WeVisOne-VL-4B
- Inkling 2 Small vs ZAYA1-8B
- Inkling-Small vs LFM3-1.7B
- Inkling vs Inkling 2 Small
- Inkling vs LFM3-1.7B
- InternVL3.5-GPT-OSS-20B-A4B-Preview vs LFM3-1.7B
- Kimi K3.1 Pro vs LFM3-1.7B
- Kimi K3 vs LFM3-1.7B
- Kolibri-1 vs LFM3-1.7B
- Kronos vs LFM3-1.7B
- Laguna M.1 vs LFM3-1.7B
- Laguna S 2.1 vs LFM3-1.7B
- Laguna XS 2.1 vs LFM3-1.7B
- LBS-27B vs LFM3-1.7B
- LFM2.5-2.6B vs LFM3-1.7B
- LFM3-1.7B vs LFM3-Audio-2B
- LFM3-1.7B vs LFM3-Omni-2B
- LFM3-1.7B vs LFM3-VL-2B
- LFM3-1.7B vs Ling-3.0-tiny
- LFM3-1.7B vs Ling-3.1-flash-1019
- LFM3-1.7B vs LongCat-2.5
- LFM3-1.7B vs MiMo-V2.6 Distill Qwen 9B
- LFM3-1.7B vs MiMo-V2.6-Flash-RL
- LFM3-1.7B vs MiniCPM-o 4.5
- LFM3-1.7B vs MiniCPM-V 4.7 1B
- LFM3-1.7B vs MiniCPM-V 4.7 35B-A3B
- LFM3-1.7B vs MiniCPM5-2B
- LFM3-1.7B vs MiniMax-M2.5
- LFM3-1.7B vs MiniMax-M2.7
- LFM3-1.7B vs MiniMax-M3.1-Flash
- LFM3-1.7B vs Mistral Large 4
- LFM3-1.7B vs Muse Glimmer 30B
- LFM3-1.7B vs Nanbeige4.2-3B
- LFM3-1.7B vs Nanbeige4.3-33B
- LFM3-1.7B vs NVIDIA Nemotron 3.5 Bolt E4B 4GB
- LFM3-1.7B vs Nemotron 3.5 Lightning 30B A3B
- LFM3-1.7B vs Nemotron 3 Nano 30B A3B
- LFM3-1.7B vs Nemotron 3 Nano 4B
- LFM3-1.7B vs Nemotron 3 Nano Omni 30B A3B Reasoning
- LFM3-1.7B vs Nemotron 3 Super 120B A12B
- LFM3-1.7B vs Nemotron 3 Ultra 550B A55B
- LFM3-1.7B vs North Mini Code 1.0
- LFM3-1.7B vs occamy-1.0
- LFM3-1.7B vs Olmo 3 7B Think
- LFM3-1.7B vs Ornith-1.5-122B
- LFM3-1.7B vs Ornith-1.5-35B-A3B
- LFM3-1.7B vs Ornith-1.5-397B
- LFM3-1.7B vs Ornith-1.5-9B
- LFM3-1.7B vs OTel-2.0-LLM-31B-IT
- LFM3-1.7B vs Qwen-AgentWorld-35B-A3B
- LFM3-1.7B vs Qwen3-30B-A3B-Instruct-2507
- LFM3-1.7B vs Qwen3-4B-Instruct-2507
- LFM3-1.7B vs Qwen3.5-0.8B
- LFM3-1.7B vs Qwen3.5-122B-A10B
- LFM3-1.7B vs Qwen3.5-2B
- LFM3-1.7B vs Qwen3.5-397B-A17B
- LFM3-1.7B vs Qwen3.5-4B
- LFM3-1.7B vs Qwen3.5-9B
- LFM3-1.7B vs Qwen3.6-27B
- LFM3-1.7B vs Qwen3.6-35B-A3B
- LFM3-1.7B vs Qwen3.8-27B
- LFM3-1.7B vs Qwen3.8-Flash-Next
- LFM3-1.7B vs Qwen3-Coder-30B-A3B-Instruct
- LFM3-1.7B vs Qwen3-Coder-Next
- LFM3-1.7B vs Qwen3-Omni-30B-A3B-Instruct
- LFM3-1.7B vs Qwen3-VL-2B-Instruct
- LFM3-1.7B vs Qwen3-VL-30B-A3B-Instruct
- LFM3-1.7B vs Qwen3-VL-32B-Instruct
- LFM3-1.7B vs Qwen3-VL-4B-Instruct
- LFM3-1.7B vs Qwen3-VL-8B-Instruct
- LFM3-1.7B vs Qwopus3.8-27B-Flash-V2
- LFM3-1.7B vs Recursive Flint
- LFM3-1.7B vs Ripple-65B Preview
- LFM3-1.7B vs SenseNova-Loop-9B-Preview
- LFM3-1.7B vs SmolLM3-3B
- LFM3-1.7B vs Spark-X2.6-4B
- LFM3-1.7B vs Step 3.7 Flash
- LFM3-1.7B vs Swift 1.5 Qwen3.8-27B
- LFM3-1.7B vs Swift 1.5 Qwen3.8-Flash-Next
- LFM3-1.7B vs ThinkingCap (Qwen3.8 27B)
- LFM3-1.7B vs Baidu Unlimited-OCR-2
- LFM3-1.7B vs WeVisOne-VL-2B
- LFM3-1.7B vs WeVisOne-VL-4B
- LFM3-1.7B vs ZAYA1-8B
Machine-readable
- This page as Markdown
/compare/inkling-2-small-vs-lfm3-1-7b.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/inkling-2-small.json·/api/v1/tools/lfm3-1-7b.json - From a terminal
anchor compare inkling-2-small lfm3-1-7b(the CLI) - Over MCP
compare_tools {"a": "inkling-2-small", "b": "lfm3-1-7b"}at/mcp, no key