LFM3-Omni-2B vs Qwen3-4B-Instruct-2507

LFM3-Omni-2B 49

Model card 14, Intended use (one on-device model in place of separate speech recognition, vision, language and speech models), architecture, parameters (2.17B), context (32K) and the text and speech languages. Training data 5, the card has no training section. Last change 20, the last commit, on 3 November 2026, changed the card's navigation icons, seven days before this check, and the one before it, on 28 October, documented video frame rate and frame limits. Responsiveness 0, none of the 12 discussions that aren't pull requests (27 October to 9 November 2026) has a reply from a LiquidAI member. Version policy 5, LFM3 came out in new repositories and the LFM2.5 models stay in theirs. File health 5, the card gives a 32K context while config.json gives the language model 128,000 positions and Liquid's API lists 128,000 for the hosted model, so the card and the files don't agree on context. 14 + 5 + 20 + 0 + 5 + 5 = 49.

Qwen3-4B-Instruct-2507 26

Model card 11 of 20, intended use, architecture, parameters and context are there, but limitations, named languages and a knowledge cut-off aren't. Training data 5, the cited Qwen3 report describes the data in general terms without a cut-off. Last change 0, the files last changed on 17 September 2025 (Hub lastModified on 4 November), more than a year ago. Responsiveness 0, counted by script on 4 November, Qwen answered none of the 20 questions and reports. Version policy 5, the older Qwen3-4B stays in its own repository without a note. File health 5, the files agree with the card in substance but reports wait without a reply. 11 + 5 + 0 + 0 + 5 + 5 = 26.

LFM3-Omni-2B 40

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, files in the LiquidAI organisation, which Liquid's docs page for the model and its blog post link to (10). Safety evaluation 0, no safety results on the card or in Liquid's blog post for the LFM3 family, neither of which mentions safety testing. Agent guidance 0, Nothing on prompt injection, an instruction hierarchy, what refusals cover or safeguards to add. Licence risk 10, 15 less 5 for the $10M annual revenue threshold on commercial use. Security programme 0, no way to report a flaw found. 15 + 15 + 0 + 0 + 10 + 0 = 40.

Qwen3-4B-Instruct-2507 55

File safety 25, safetensors only and nothing from the repository runs to load it or build prompts. Provenance 15, the files are in the Qwen organisation that Qwen's GitHub links to, with a checksum on every file. Safety evaluation 0, none published. Agent guidance 0, nothing on prompt injection, refusals or safeguards. Licence risk 15, plain Apache 2.0 that hasn't changed. Security programme 0, no security.txt, disclosure policy or security contact for Qwen was found, and Alibaba's group security centre couldn't be checked, so it's scored as absent. Files unchanged on 4 November, and QwenLM/Qwen3 still has no SECURITY.md. 25 + 15 + 0 + 0 + 15 + 0 = 55.

LFM3-Omni-2B 80

Memory 30, Liquid's Q4_K_M GGUF is 1.10 GB with its 0.29 GB projector file, and 1.39 GB × 1.2 = 1.7 GB, which fits 8 GB, well inside the 16 GB line. Runtimes 10, Released llama.cpp has the lfm3 architecture with the LFM3 vision and audio projectors and speech output (src/models/lfm3.cpp and tools/mtmd at b12242, with a realtime client example), and Ollama's library has an lfm3-omni entry. Builds 15, Liquid's GGUF repository holds Q4_0, Q4_K_M, Q8_0, F16 and BF16 files, and Liquid publishes 4-bit and 8-bit MLX builds and an ONNX repository, all in the LiquidAI organisation. Terms 10, the LFM Open License v1.0, a custom licence that lets anyone use it commercially for free below a threshold of $10M annual revenue. Download 10, the Hub API reports gated false for the model and its GGUF, MLX and ONNX repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, Liquid's own API lists lfm3-omni-2b among its models, so the publisher hosts it. 30 + 10 + 15 + 10 + 10 + 5 = 80.

Qwen3-4B-Instruct-2507 90

Memory 30, LM Studio's and Ollama's 4-bit builds are 2.3 to 2.5 GB, about 3 GB with a fifth added, inside 16 GB. Runtimes 25, released Transformers, vLLM, SGLang and llama.cpp run the qwen3 architecture, Ollama's released build pins a llama.cpp that has it, and LM Studio's catalogue carries it. Builds 10 of 15, Alibaba's only quantised build is FP8. Terms 15, Apache 2.0 with nothing added. Download 10, neither repository is gated. Hosted 0, on 4 November 2026 the Hub's provider mapping showed only Featherless AI with status error, Nscale was gone and Alibaba's Model Studio doesn't list it. 30 + 25 + 10 + 15 + 10 + 0 = 90.

LFM3-Omni-2B 70

Chat template 20, chat_template.jinja in the repository (13,513 characters), with roles, images, video and audio, tools, deferred tools and tool results. Tool-calling format 25, the card and Liquid's tool-use page document tools passed through tools= in apply_chat_template, calls returned as XML and results sent back as tool messages. Trained tool calling 20, the template loops over every entry in an assistant turn's tool_calls, so several calls fit in one turn, and the card documents tool calling from spoken or written requests. Structured output 0, the card doesn't mention JSON or structured output for this model. Reasoning control 0, the card says this is a non-reasoning model and that enable_thinking=True is not supported, so there is no thinking to turn off or budget. Context 5, 32K tokens of input and output per the card. 20 + 25 + 20 + 0 + 0 + 5 = 70.

Qwen3-4B-Instruct-2507 75

Chat template 20, a Jinja template in tokenizer_config.json. Tool-calling format 25, Qwen's own Function Calling guide documents the Hermes-style declaration and how calls come back, and names vLLM's hermes parser. Trained tool calling 20, the template allows one or more calls a turn. Structured output 0, not documented for the model, and Qwen's docs only point to vLLM's generic guided decoding. Reasoning control 0, this edition has no thinking. Context 10, 262,144 tokens native. Template and config unchanged on 4 November. 20 + 25 + 20 + 0 + 0 + 10 = 75.