gpt-oss-20b vs LFM3-Omni-2B

gpt-oss-20b 85

File safety earns 25, since the weights are safetensors and metal/model.bin is OpenAI's own raw Metal format rather than pickle, and nothing in the repository runs as code (a judgement call on the .bin name). Provenance earns 15, files in OpenAI's own organisation and a checksum on every file. Safety evaluation earns 10, because the published safety results for this size are OpenAI's own, and the outside review covered gpt-oss-120b. Agent guidance earns 15 for an instruction hierarchy the model was trained to follow, with prompt-injection results, though OpenAI reports it trails o4-mini there. Licence risk keeps 15, with nothing to deduct under Apache 2.0. The security programme earns 5 for OpenAI's security.txt with a Bugcrowd contact. Public advisories for the gpt-oss code couldn't be checked, so that half scores as absent.

LFM3-Omni-2B 40

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, files in the LiquidAI organisation, which Liquid's docs page for the model and its blog post link to (10). Safety evaluation 0, no safety results on the card or in Liquid's blog post for the LFM3 family, neither of which mentions safety testing. Agent guidance 0, Nothing on prompt injection, an instruction hierarchy, what refusals cover or safeguards to add. Licence risk 10, 15 less 5 for the $10M annual revenue threshold on commercial use. Security programme 0, no way to report a flaw found. 15 + 15 + 0 + 0 + 10 + 0 = 40.

gpt-oss-20b 90

The chat template earns 20, a Jinja file in the repository. The tool-calling format earns 25, since OpenAI's harmony guide says how functions are declared and how calls come back, and OpenAI ships the openai-harmony parser. Trained tool calling earns 10, because each call ends the message and waits for its result, so it makes one call at a time. Structured output earns 15 for a JSON Schema given in the developer message, documented in the harmony guide. Reasoning control earns 10, with low, medium or high effort per request and the reasoning on its own channel, though it can't be switched off. Context earns 10 for 131,072 tokens, which OpenAI describes as trained in even though the config reaches it with YaRN.

LFM3-Omni-2B 70

Chat template 20, chat_template.jinja in the repository (13,513 characters), with roles, images, video and audio, tools, deferred tools and tool results. Tool-calling format 25, the card and Liquid's tool-use page document tools passed through tools= in apply_chat_template, calls returned as XML and results sent back as tool messages. Trained tool calling 20, the template loops over every entry in an assistant turn's tool_calls, so several calls fit in one turn, and the card documents tool calling from spoken or written requests. Structured output 0, the card doesn't mention JSON or structured output for this model. Reasoning control 0, the card says this is a non-reasoning model and that enable_thinking=True is not supported, so there is no thinking to turn off or budget. Context 5, 32K tokens of input and output per the card. 20 + 25 + 20 + 0 + 0 + 5 = 70.

gpt-oss-20b 90

Memory earns 25, since OpenAI's own MXFP4 build is 13.76 GB and a fifth on top is 16.5 GB, just past the 16 GB band, and Ollama's 14 GB build lands in the same 24 GB band. Runtimes earn the full 25 from model code in released Transformers, vLLM and SGLang, the architecture in llama.cpp and the model in Ollama's library. Builds earn 10, because OpenAI ships one quantised precision, MXFP4, and the original and metal folders are the same weights for its reference code. Terms earn 15 for Apache 2.0, whose usage policy only asks users to follow the law. Download earns 10, since the repository isn't gated. Hosted earns 5, with five inference providers live for it on its Hugging Face page on 1 November 2026, while OpenAI's own API lists it with no usable rate limit and isn't counted.

LFM3-Omni-2B 80

Memory 30, Liquid's Q4_K_M GGUF is 1.10 GB with its 0.29 GB projector file, and 1.39 GB × 1.2 = 1.7 GB, which fits 8 GB, well inside the 16 GB line. Runtimes 10, Released llama.cpp has the lfm3 architecture with the LFM3 vision and audio projectors and speech output (src/models/lfm3.cpp and tools/mtmd at b12242, with a realtime client example), and Ollama's library has an lfm3-omni entry. Builds 15, Liquid's GGUF repository holds Q4_0, Q4_K_M, Q8_0, F16 and BF16 files, and Liquid publishes 4-bit and 8-bit MLX builds and an ONNX repository, all in the LiquidAI organisation. Terms 10, the LFM Open License v1.0, a custom licence that lets anyone use it commercially for free below a threshold of $10M annual revenue. Download 10, the Hub API reports gated false for the model and its GGUF, MLX and ONNX repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, Liquid's own API lists lfm3-omni-2b among its models, so the publisher hosts it. 30 + 10 + 15 + 10 + 10 + 5 = 80.

gpt-oss-20b 42

The model card earns 17, covering six of the seven points and missing a statement of supported languages. Training data earns 10, a general description with a June 2024 cut-off and no sources or mix. Last change earns 5, because the files haven't changed since August 2025 and the reference code and harmony parser last changed on 1 and 5 November 2025, still within a year on 1 November 2026, while this year's commits only touch the browser tool, CI and a version number. Responsiveness earns 0, with no OpenAI reply to any of the 40 most recent discussions and none at all since August 2025. Version policy earns 5 for a first release kept in its own repository. File health earns 5, since template reports and an install report wait without a reply.

LFM3-Omni-2B 49

Model card 14, Intended use (one on-device model in place of separate speech recognition, vision, language and speech models), architecture, parameters (2.17B), context (32K) and the text and speech languages. Training data 5, the card has no training section. Last change 20, the last commit, on 3 November 2026, changed the card's navigation icons, seven days before this check, and the one before it, on 28 October, documented video frame rate and frame limits. Responsiveness 0, none of the 12 discussions that aren't pull requests (27 October to 9 November 2026) has a reply from a LiquidAI member. Version policy 5, LFM3 came out in new repositories and the LFM2.5 models stay in theirs. File health 5, the card gives a 32K context while config.json gives the language model 128,000 positions and Liquid's API lists 128,000 for the hosted model, so the card and the files don't agree on context. 14 + 5 + 20 + 0 + 5 + 5 = 49.