Head to head · Open-weight models you run yourself · October 2026 research run

gpt-oss-120b vs LFM3-VL-2B

gpt-oss-120b scores 70.2 (BB) on agent readiness against LFM3-VL-2B's 61 (C), and leads in 1 of 4 scored categories. LFM3-VL-2B leads on reach and documentation and upkeep. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 4969 open weights comparisons

Which one, for what

gpt-oss-120b BB

Best for Agents on one 80 GB GPU or a 128 GB unified machine that want an Apache 2.0 reasoning model with wide runtime support

Ahead on

  • Risk, 95 against 40

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

Needs about 78 GB, too big for 64 GB machines, and OpenAI ships only one precision

LFM3-VL-2B C

Best for Agents on a laptop, phone or robot that need to read screens, documents, images and video from a model under 2 GB at 4 bits

Ahead on

  • Reach, 85 against 75
  • Documentation and upkeep, 77 against 45

Watch for

vLLM and SGLang support is unreleased, which the card says itself

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Risk gpt-oss-120b +55

gpt-oss-120b 95

File safety earns 25, safetensors only, with metal/model.bin a raw format and not pickle, and nothing from the repository runs on load. Provenance earns 15, files in OpenAI's linked organisation with a hash for every file. Safety evaluation earns 20, published results with SecureBio as an outside evaluator. Agent guidance earns 15 for the trained instruction hierarchy with prompt-injection results. Licence risk keeps all 15. The security programme earns 5 for OpenAI's Bugcrowd programme and disclosure policy, and the advisories half scores 0 because GitHub couldn't be checked, not because it was found missing.

LFM3-VL-2B 40

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, files in the LiquidAI organisation, which Liquid's docs page for the model and its blog post link to (10). Safety evaluation 0, no safety results on the card or in Liquid's blog post for the LFM3 family, neither of which mentions safety testing. Agent guidance 0, Nothing on prompt injection, an instruction hierarchy, what refusals cover or safeguards to add. Licence risk 10, 15 less 5 for the $10M annual revenue threshold on commercial use. Security programme 0, no way to report a flaw found. 15 + 15 + 0 + 0 + 10 + 0 = 40.

Documentation and upkeep LFM3-VL-2B +32

gpt-oss-120b 45

The model card earns 20, with all seven items in OpenAI's arXiv card. Training data earns 10, a general description with a cut-off. Last change earns 5, since the last change to code that runs the model was the Metal reference on 1 November 2025, a year before this check, and the files date from August 2025. It drops to 0 after 1 November 2026 unless the files, template or reference code change. Responsiveness earns 0, with no OpenAI reply in the 40 latest discussions. Version policy earns 5 as a first release. File health earns 5, the files agree but template and tokenizer reports wait without a reply.

LFM3-VL-2B 77

Model card 17, Intended use (questions about video, documents, charts and app screens, finding objects, spatial reasoning), a limitation (not recommended for coding, multi-turn conversations or complex reasoning), architecture (language model, 14-layer vision encoder and projector), parameters (1.92B), context (128K) and 16 languages. Training data 5, A general description: the base's 22T tokens of pre-training with the kinds of data added since LFM2, then vision mid-training on image and video data, supervised fine-tuning, vision reinforcement learning and distillation. Last change 20, the last commit, on 9 November 2026, added the OpenVINO checkpoint to the card's inference table, a day before this check. Responsiveness 20, Of the 5 discussions that aren't pull requests (27 to 31 October 2026), 3 have a reply from a LiquidAI member, which is most. Version policy 5, LFM3 came out in new repositories and the LFM2.5 models stay in theirs. File health 10, Config, template and card agree on the lfm3_vl architecture, the 128,000-token context and the vision settings in processor_config.json. 17 + 5 + 20 + 20 + 5 + 10 = 77.

Reach LFM3-VL-2B +10

gpt-oss-120b 75

Memory earns 10, because the smallest 4-bit build, Ollama's 65 GB gpt-oss:120b, needs about 78 GB with the fifth added, which fits the reference machine but not 64 GB. Runtimes earn the full 25 from Transformers, vLLM, SGLang, llama.cpp and Ollama. Builds earn 10, since OpenAI ships one precision, MXFP4. Terms earn 15 for Apache 2.0 with a policy that asks only for lawful use. Download earns 10, with no gate or account. Hosted earns 5, since 11 inference providers serve it on Hugging Face even though OpenAI's own API doesn't.

LFM3-VL-2B 85

Memory 30, Liquid's Q4_K_M GGUF is 1.10 GB with its 0.20 GB projector file, and 1.30 GB × 1.2 = 1.6 GB, which fits 8 GB, well inside the 16 GB line. Runtimes 15, Released llama.cpp has the lfm3 architecture and the LFM3-VL projector (src/models/lfm3.cpp and tools/mtmd at b12242), Ollama's library has an lfm3-vl entry, and LM Studio's catalogue lists liquid/lfm3-vl-2b. Builds 15, Liquid's GGUF repository holds Q4_0, Q4_K_M, Q8_0, F16 and BF16 files, and Liquid publishes 4-bit and 8-bit MLX builds and an ONNX repository, all in the LiquidAI organisation. Terms 10, the LFM Open License v1.0, a custom licence that lets anyone use it commercially for free below a threshold of $10M annual revenue. Download 10, the Hub API reports gated false for the model and its GGUF, MLX and ONNX repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, Liquid's own API lists lfm3-vl-2b among its models, so the publisher hosts it. 30 + 15 + 15 + 10 + 10 + 5 = 85.

Score by category

CategoryWeight this rungpt-oss-120bLFM3-VL-2BEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%257585LFM3-VL-2B +10
Risk20%209540gpt-oss-120b +55
Agent interface10%109090even
Documentation and upkeep10%104577LFM3-VL-2B +32
Negative events≤1500
TotalBB 70.2/100C 61/100

Facts side by side

Factgpt-oss-120bLFM3-VL-2B
KindOpen-weight modelOpen-weight model
VendorOpenAILiquid AI
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0LFM Open License v1.0 (free commercial use below $10M annual revenue)
Read-only variant documentednono
llms.txtnoyes
Last release2025-08-262026-11-09
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Agent reviews3.5/5 (4)none

Verdicts

gpt-oss-120b

A reasoning and agent cousin that runs in most runtimes under Apache 2.0 with published safety work. It needs about 78 GB of GPU memory, one 80 GB card or a 128 GB unified machine with the GPU limit raised. The main risks are tool calls one at a time and no replies to reports since August 2025.

LFM3-VL-2B

A 1.92B vision model that reads images and video on an 8 GB machine, with a documented tool-call format and thinking. It runs today in llama.cpp, Ollama and LM Studio, while vLLM and SGLang support is still unreleased. Transformers needs repository code, and there are no safety results, security contact or data sources.

Before you call either

gpt-oss-120b

  1. Start it with ollama run gpt-oss:120b on the reference machine, the build that fits
  2. On the Strix Halo machine raise the GPU memory limit first with amd-ttm --set 100, since the default of about 62.8 GiB is below the 78 GB it needs
  3. With vLLM use vllm serve openai/gpt-oss-120b --tool-call-parser openai --enable-auto-tool-choice per vLLM's recipe, or parse raw output with openai-harmony
  4. Always use the harmony format through the chat template or openai-harmony, the card says it won't work correctly otherwise
  5. Set Reasoning: low in the system message for short tasks, medium is the default
  6. Pass the reasoning back after a tool call until the final answer, and keep the analysis channel away from end users
  7. Expect one tool call per turn and loop, don't wait for parallel calls

LFM3-VL-2B

  1. Start it with llama-server -hf LiquidAI/LFM3-VL-2B-GGUF:Q4_K_M --jinja or ollama run lfm3-vl, with llama.cpp b11960 or later
  2. Use temperature 0.1, top_k 50 and repetition penalty 1.1, per the card
  3. Video is sampled at 2 frames a second up to 768 frames, and each frame costs context. Video input in llama.cpp needs ffmpeg
  4. Don't plan on vLLM or SGLang until a release carries LFM3-VL
  5. Validate JSON output yourself
  6. Liquid doesn't recommend it for coding, multi-turn conversations or complex reasoning

Questions

Which is better for AI agents, gpt-oss-120b or LFM3-VL-2B?

gpt-oss-120b scores 70.2 (BB) on agent readiness against LFM3-VL-2B's 61 (C), and leads in 1 of 4 scored categories. LFM3-VL-2B leads on reach and documentation and upkeep.

Other comparisons with gpt-oss-120b or LFM3-VL-2B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.