LFM3-Omni-2B vs Mistral Large 4

LFM3-Omni-2B 40

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, files in the LiquidAI organisation, which Liquid's docs page for the model and its blog post link to (10). Safety evaluation 0, no safety results on the card or in Liquid's blog post for the LFM3 family, neither of which mentions safety testing. Agent guidance 0, Nothing on prompt injection, an instruction hierarchy, what refusals cover or safeguards to add. Licence risk 10, 15 less 5 for the $10M annual revenue threshold on commercial use. Security programme 0, no way to report a flaw found. 15 + 15 + 0 + 0 + 10 + 0 = 40.

Mistral Large 4 75

File safety scores 25, safetensors only and loaded by Transformers' own code with a Jinja template. Provenance scores 15, Mistral's verified organisation with a hash on every file. Safety evaluation scores 10, refusal and prompt-injection results Mistral ran itself, listed in its 2 November technical report as internal, and red-teaming by outside firms with nothing published. Agent guidance scores 10 for a statement of what the refusals cover and a claim of trained injection resistance, with only general safeguards. Licence risk scores 10, 5 off for the Model-as-a-Service limit. The security programme scores 5 for security.txt with no public advisories. 25 + 15 + 10 + 10 + 10 + 5 = 75.

LFM3-Omni-2B 80

Memory 30, Liquid's Q4_K_M GGUF is 1.10 GB with its 0.29 GB projector file, and 1.39 GB × 1.2 = 1.7 GB, which fits 8 GB, well inside the 16 GB line. Runtimes 10, Released llama.cpp has the lfm3 architecture with the LFM3 vision and audio projectors and speech output (src/models/lfm3.cpp and tools/mtmd at b12242, with a realtime client example), and Ollama's library has an lfm3-omni entry. Builds 15, Liquid's GGUF repository holds Q4_0, Q4_K_M, Q8_0, F16 and BF16 files, and Liquid publishes 4-bit and 8-bit MLX builds and an ONNX repository, all in the LiquidAI organisation. Terms 10, the LFM Open License v1.0, a custom licence that lets anyone use it commercially for free below a threshold of $10M annual revenue. Download 10, the Hub API reports gated false for the model and its GGUF, MLX and ONNX repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, Liquid's own API lists lfm3-omni-2b among its models, so the publisher hosts it. 30 + 10 + 15 + 10 + 10 + 5 = 80.

Mistral Large 4 50

Memory scores 0, since the smallest 4-bit build, Mistral's NVFP4, is 610 GB, about 732 GB with a fifth added, far above 256 GB. Runtimes score 10, released Transformers and llama.cpp have the architecture, while vLLM v0.33.0 and SGLang v0.5.23 still lack it, the llama.cpp build Ollama 0.40.14 pins predates it, and LM Studio has no entry. Builds score 15 for Mistral's FP8 and NVFP4 releases. Terms score 10, a modified MIT licence that is free commercially except for Model-as-a-Service businesses. Download scores 10 with no gate, and hosted too scores 5 because Mistral's API serves these weights. 0 + 10 + 15 + 10 + 10 + 5 = 50.

LFM3-Omni-2B 70

Chat template 20, chat_template.jinja in the repository (13,513 characters), with roles, images, video and audio, tools, deferred tools and tool results. Tool-calling format 25, the card and Liquid's tool-use page document tools passed through tools= in apply_chat_template, calls returned as XML and results sent back as tool messages. Trained tool calling 20, the template loops over every entry in an assistant turn's tool_calls, so several calls fit in one turn, and the card documents tool calling from spoken or written requests. Structured output 0, the card doesn't mention JSON or structured output for this model. Reasoning control 0, the card says this is a non-reasoning model and that enable_thinking=True is not supported, so there is no thinking to turn off or budget. Context 5, 32K tokens of input and output per the card. 20 + 25 + 20 + 0 + 0 + 5 = 70.

Mistral Large 4 95

The chat template is in the repository (20). The card documents how tools are declared and come back and names the parser (25), and the template renders several calls in one turn (20). Strict JSON Schema output is documented with how to ask for it (15). Reasoning effort is budgeted per request with the reasoning returned apart from the answer (10). Context scores 5, because the 1M window comes from YaRN scaling and the technical report gives 40K as the longest pretraining sequence. 20 + 25 + 20 + 15 + 10 + 5 = 95.

LFM3-Omni-2B 49

Model card 14, Intended use (one on-device model in place of separate speech recognition, vision, language and speech models), architecture, parameters (2.17B), context (32K) and the text and speech languages. Training data 5, the card has no training section. Last change 20, the last commit, on 3 November 2026, changed the card's navigation icons, seven days before this check, and the one before it, on 28 October, documented video frame rate and frame limits. Responsiveness 0, none of the 12 discussions that aren't pull requests (27 October to 9 November 2026) has a reply from a LiquidAI member. Version policy 5, LFM3 came out in new repositories and the LFM2.5 models stay in theirs. File health 5, the card gives a 32K context while config.json gives the language model 128,000 positions and Liquid's API lists 128,000 for the hosted model, so the card and the files don't agree on context. 14 + 5 + 20 + 0 + 5 + 5 = 49.

Mistral Large 4 64

The card covers intended use, architecture, parameters, context and languages, and misses limitations and a cut-off (14). Training data is described by its mix in the technical report, with no sources, cut-off or filtering (5). The files changed on 2 November 2026, when the report was added (20). A Mistral member replied in three of nine discussions (10). It's a first release with older Large models in their own repositories and no dated note (5), and the files agree with each other and the card (10). 14 + 5 + 20 + 10 + 5 + 10 = 64.