gpt-oss-20b vs LFM3-1.7B

gpt-oss-20b 85

File safety earns 25, since the weights are safetensors and metal/model.bin is OpenAI's own raw Metal format rather than pickle, and nothing in the repository runs as code (a judgement call on the .bin name). Provenance earns 15, files in OpenAI's own organisation and a checksum on every file. Safety evaluation earns 10, because the published safety results for this size are OpenAI's own, and the outside review covered gpt-oss-120b. Agent guidance earns 15 for an instruction hierarchy the model was trained to follow, with prompt-injection results, though OpenAI reports it trails o4-mini there. Licence risk keeps 15, with nothing to deduct under Apache 2.0. The security programme earns 5 for OpenAI's security.txt with a Bugcrowd contact. Public advisories for the gpt-oss code couldn't be checked, so that half scores as absent.

LFM3-1.7B 40

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, files in the LiquidAI organisation, which Liquid's docs page for the model and its blog post link to (10). Safety evaluation 0, no safety results on the card or in Liquid's blog post for the LFM3 family, neither of which mentions safety testing. Agent guidance 0, Nothing on prompt injection, an instruction hierarchy, what refusals cover or safeguards to add. Licence risk 10, 15 less 5 for the $10M annual revenue threshold on commercial use. Security programme 0, no way to report a flaw found. 15 + 15 + 0 + 0 + 10 + 0 = 40.

gpt-oss-20b 42

The model card earns 17, covering six of the seven points and missing a statement of supported languages. Training data earns 10, a general description with a June 2024 cut-off and no sources or mix. Last change earns 5, because the files haven't changed since August 2025 and the reference code and harmony parser last changed on 1 and 5 November 2025, still within a year on 1 November 2026, while this year's commits only touch the browser tool, CI and a version number. Responsiveness earns 0, with no OpenAI reply to any of the 40 most recent discussions and none at all since August 2025. Version policy earns 5 for a first release kept in its own repository. File health earns 5, since template reports and an install report wait without a reply.

LFM3-1.7B 67

Model card 17, Intended use (local agents, tool calling, structured outputs, fine-tuning), a limitation (not recommended for agentic coding or complex multi-step reasoning), architecture (24 layers: 13 gated short convolutions, 5 sliding-window and 6 global attention), parameters (1.73B), context (256K) and 16 languages. Training data 5, A general description: 22T tokens of pre-training in two stages with the kinds of data added since LFM2, 1.75T tokens of supervised fine-tuning, then mixed reinforcement learning, distillation from six specialist teachers and agentic reinforcement learning. Last change 20, the last commit, on 9 November 2026, added the OpenVINO checkpoint to the card's inference table, a day before this check. Responsiveness 10, Of the 22 discussions that aren't pull requests (27 October to 8 November 2026), 7 have a reply from a LiquidAI member, which is some. Version policy 5, LFM3 came out in new repositories and the LFM2.5 models stay in theirs. File health 10, Config, template and card agree on the lfm3 architecture, the 262,144-token context and the thinking switch. 17 + 5 + 20 + 10 + 5 + 10 = 67.

gpt-oss-20b 90

The chat template earns 20, a Jinja file in the repository. The tool-calling format earns 25, since OpenAI's harmony guide says how functions are declared and how calls come back, and OpenAI ships the openai-harmony parser. Trained tool calling earns 10, because each call ends the message and waits for its result, so it makes one call at a time. Structured output earns 15 for a JSON Schema given in the developer message, documented in the harmony guide. Reasoning control earns 10, with low, medium or high effort per request and the reasoning on its own channel, though it can't be switched off. Context earns 10 for 131,072 tokens, which OpenAI describes as trained in even though the config reaches it with YaRN.

LFM3-1.7B 100

Chat template 20, chat_template.jinja in the repository (12,129 characters), with roles, tools, deferred tools, tool results and the thinking switch. Tool-calling format 25, the card and Liquid's tool-use page document tools passed through tools= in apply_chat_template, calls returned as XML and results sent back as tool messages. Trained tool calling 20, the template loops over every entry in an assistant turn's tool_calls, so several calls fit in one turn, and the card says the model was trained on tool calls and agentic traces and with reinforcement learning inside agent harnesses. Structured output 15, Liquid's API guide documents response_format with a JSON Schema, with lfm3-1.7b as the model in its examples, and says the schema is checked before generation starts. Reasoning control 10, the card documents enable_thinking=False in the chat template to turn reasoning off per request, with reasoning on by default inside think tags, and preserve_thinking for earlier turns. Context 10, 256K tokens per the card, which says the mid-training stage extended the context window to 256K, and max_position_embeddings 262144 in config.json. 20 + 25 + 20 + 15 + 10 + 10 = 100.

gpt-oss-20b 90

Memory earns 25, since OpenAI's own MXFP4 build is 13.76 GB and a fifth on top is 16.5 GB, just past the 16 GB band, and Ollama's 14 GB build lands in the same 24 GB band. Runtimes earn the full 25 from model code in released Transformers, vLLM and SGLang, the architecture in llama.cpp and the model in Ollama's library. Builds earn 10, because OpenAI ships one quantised precision, MXFP4, and the original and metal folders are the same weights for its reference code. Terms earn 15 for Apache 2.0, whose usage policy only asks users to follow the law. Download earns 10, since the repository isn't gated. Hosted earns 5, with five inference providers live for it on its Hugging Face page on 1 November 2026, while OpenAI's own API lists it with no usable rate limit and isn't counted.

LFM3-1.7B 85

Memory 30, Liquid's Q4_K_M GGUF is 1.10 GB, and 1.10 GB × 1.2 = 1.3 GB, which fits 8 GB, well inside the 16 GB line. Runtimes 15, Released llama.cpp has the lfm3 architecture (src/models/lfm3.cpp at b12242), Ollama's library has an lfm3 entry, and LM Studio's catalogue runs the architecture (its liquid/lfm3-vl-2b entry; lmstudio-community publishes a GGUF of this model). Builds 15, Liquid's GGUF repository holds Q4_0, Q4_K_M, Q8_0, F16 and BF16 files, and Liquid publishes 4-bit and 8-bit MLX builds and an ONNX repository, all in the LiquidAI organisation. Terms 10, the LFM Open License v1.0, a custom licence that lets anyone use it commercially for free below a threshold of $10M annual revenue. Download 10, the Hub API reports gated false for the model and its GGUF, MLX and ONNX repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, Liquid's own API lists lfm3-1.7b among its models, so the publisher hosts it. 30 + 15 + 15 + 10 + 10 + 5 = 85.