Head to head · Open-weight models you run yourself · October 2026 research run

MiniCPM5-2B vs Step 3.7 Flash

Step 3.7 Flash and MiniCPM5-2B score within a point of each other on agent readiness, 59.8 (C) and 59.7 (C). MiniCPM5-2B leads on reach, risk and documentation and upkeep. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 6359 open weights comparisons

Which one, for what

MiniCPM5-2B C

Best for On-device and laptop agents that want a 2 GB tool-calling helper with long context and open training data

Ahead on

  • Reach, 90 against 70
  • Risk, 55 against 45
  • Documentation and upkeep, 92 against 39

Watch for

OpenBMB documents only a Think mode for the 2B, so every answer starts with reasoning

Step 3.7 Flash C

Best for Teams with a GPU server or a provider account that want an open, long-context agent model with vision

Ahead on

  • Agent interface, 85 against 75

Watch for

About 131 GB to run at 4 bits with images, over a 128 GB machine's share

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Documentation and upkeep MiniCPM5-2B +53

MiniCPM5-2B 92

Model card 17, everything but a knowledge cut-off. Training data 20, all eight training datasets are published on Hugging Face and named per stage with sizes. Last change 15, a template fix on 29 September 2026, 36 days ago, with nothing newer in OpenBMB's MiniCPM5 repositories on Hugging Face (builds last changed 12 September) or its GitHub repository (21 September). Responsiveness 20, OpenBMB members answered 16 of the 23 questions in the discussions, the newest reply on 29 September. Version policy 10, earlier models and checkpoints sit in their own repositories and the GitHub changelog dates each release. File health 10, config, tokenizer, template and card agree and no broken-file report waited on 21 October, though OpenBMB's GGUF, MLX and GPTQ repositories still carry the template from before the 29 September fix.

Step 3.7 Flash 39

Model card 14, Intended use, the architecture, the parameters, the context and the language (in the metadata) are on the card. Training data 0, Nothing on the card about the training data. Last change 10, the last commit, on 3 June 2026, fixed the modelling code, 160 days before this check and within 180. Responsiveness 0, none of the 11 most recent discussions that aren't pull requests (29 May to 24 June 2026) has a reply from a stepfun-ai member, counted on 10 November by author flags and dates with a script, text not read. Version policy 5, Step-3.5-Flash stays in its own repositories and 3.7 came out in new ones, with no dated note on the older cards that we read. File health 10, Config, template and card agree on the architecture and the context, and June commits fixed the modelling code. 14 + 0 + 10 + 0 + 5 + 10 = 39.

Reach MiniCPM5-2B +20

MiniCPM5-2B 90

Memory 30, OpenBMB's own MLX 4-bit build is 1.42 GB and its Q4_K_M GGUF 1.56 GB, about 2 GB with the fifth added. Runtimes 25, the cap, since the model is a stock Llama and vLLM, SGLang, released Transformers, a released llama.cpp and Ollama all run it. Builds 15, OpenBMB ships GGUF at three precisions plus MLX and GPTQ 4-bit. Terms 10, the LICENSE is plain Apache 2.0 but the card prohibits jailbreaking and injection testing and limits use to ethical purposes, which reads as a use policy on top (dated 21 October 2026). Download 10, nothing is gated. Hosted 0, OpenBMB has no API for it, no inference provider is listed on its Hugging Face page and OpenRouter doesn't carry it.

Step 3.7 Flash 70

Memory 5, the smallest build at 4 bits is StepFun's IQ4_XS GGUF, 104.99 GB with the 3.97 GB projector, and 108.96 GB × 1.2 = 130.8 GB, over what the reference machine can give a model and within 256 GB. The IQ3 and Q3 builds are below 4 bits and aren't read. Runtimes 20, Released vLLM 0.33.0, SGLang 0.5.23 and Transformers 5.22.2 have the step3p7 model, and llama.cpp b12242 has the architecture, with StepFun's own GGUF. Four at 5 each, and the card documents all four. Builds 15, StepFun publishes GGUF at five quantised precisions, an FP8 build and an NVFP4 build. Terms 15, Apache 2.0 in the card's metadata and its licence section, an OSI licence with nothing added. Download 10, the Hub API reports gated false for all four repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, StepFun's own API serves it, per the card and our StepFun API listing, and Featherless and DeepInfra are live for it on Hugging Face. 5 + 20 + 15 + 15 + 10 + 5 = 70.

Risk MiniCPM5-2B +10

MiniCPM5-2B 55

File safety 25, safetensors and GGUF only, and the documented way to load it runs no code from the repository. Provenance 15, the openbmb organisation linked from OpenBMB's GitHub, with a SHA-256 for every weight file. Safety evaluation 0, nothing published. Agent guidance 5, the card only cautions that prompts can manipulate the model and that users should add their own safeguards. Licence risk 10, 5 off for the card's use limit beyond the law. Security programme 0, no SECURITY.md, no security.txt and no advisories.

Step 3.7 Flash 45

File safety 15, safetensors and GGUF only, no .bin, .pt or .pth files (25). Provenance 15, the files sit in the stepfun-ai organisation, which the card's StepFun platform and model page belong to (10). Safety evaluation 0, no safety results on the card. Agent guidance 0, the card has no limitations section and gives no guidance on prompt injection, instruction priority, refusals or safeguards. Licence risk 15, Apache 2.0 has no use policy, threshold or change clause. Security programme 0, no way to report a flaw on the card, and our StepFun API listing found no security.txt, bug bounty or disclosure policy. 15 + 15 + 0 + 0 + 15 + 0 = 45.

Agent interface Step 3.7 Flash +10

MiniCPM5-2B 75

Chat template 20, a Jinja file in the repository. Tool-calling format 25, the card and OpenBMB's cookbooks document the XML call format, the tools request and the minicpm5 parser in SGLang and vLLM. Trained tool calling 20, agent SFT on 500K samples and a template that renders several calls in one turn. Structured output 0, nothing documents asking for JSON. Reasoning control 0, a judgement call, because OpenBMB's own cookbooks call Think the only supported mode for the 2B even though the template accepts enable_thinking false. Context 10, 131,072 tokens native with no rope scaling.

Step 3.7 Flash 85

Chat template 20, chat_template.jinja in the repository (5,723 characters). Tool-calling format 25, the card names the parser to use in two runtimes, step3p5 in vLLM (with auto tool choice) and in SGLang, and both ship Step parsers in a release. Trained tool calling 20, the card presents tool orchestration as a main use, with multi-turn results, and the template renders every call in a turn. Structured output 0, Nothing on the card about JSON or schema-constrained output for the weights. Reasoning control 10, the template has a reasoning_effort setting and keeps reasoning_content, and the card names the step3p5 reasoning parser for vLLM and SGLang, which returns the reasoning apart from the answer. Context 10, 256K tokens per the card, and 262,144 positions in config.json. 20 + 25 + 20 + 0 + 10 + 10 = 85.

Score by category

CategoryWeight this runMiniCPM5-2BStep 3.7 FlashEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%259070MiniCPM5-2B +20
Risk20%205545MiniCPM5-2B +10
Agent interface10%107585Step 3.7 Flash +10
Documentation and upkeep10%109239MiniCPM5-2B +53
Negative events≤1500
TotalC 59.7/100C 59.8/100

Facts side by side

FactMiniCPM5-2BStep 3.7 Flash
KindOpen-weight modelOpen-weight model
VendorOpenBMBStepFun
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0Apache-2.0 (metadata and card; no LICENSE file)
Read-only variant documentednono
llms.txtnono
Last release2026-09-292026-06-03
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Agent reviews3/5 (4)none

How the scores have moved

MiniCPM5-2B

Step 3.7 Flash

No score change since it was listed.

Verdicts

MiniCPM5-2B

A 2B dense model for local tool calling and long context, with published training data. OpenBMB's own 4-bit builds are under 1.6 GB, and the model loads in vLLM, SGLang, llama.cpp, Ollama and Transformers. The main risks are always-on thinking, no safety results and use conditions beyond Apache 2.0.

Step 3.7 Flash

A capable open agent model with a clean licence, every kind of build and four released runtimes. Two things hold it back: it's a little too big for a 128 GB machine at 4 bits, whatever the card says, and StepFun has gone quiet on the repository since June. No safety results, limitations or data description.

Before you call either

MiniCPM5-2B

  1. Smallest start is ollama run openbmb/minicpm5-2b (1.6 GB, q4_k_m)
  2. On vLLM 0.29.0 or later run vllm serve openbmb/MiniCPM5-2B --max-model-len 131072 --enable-auto-tool-choice --tool-call-parser minicpm5, or tool calls come back as XML text
  3. On SGLang 0.5.16 or later add --tool-call-parser minicpm5 --reasoning-parser qwen3; SGLang is OpenBMB's recommended backend for tool calls
  4. Tool calls are XML, <function name=...><param name=...>, not Hermes JSON
  5. Sample with temperature 1.0, top_p 0.95 and min_p 0.0; llama.cpp's default min_p 0.05 can loop, and repetition_penalty 1.05 helps if it does
  6. Expect a <think> block before every answer and leave room in max_tokens; enable_thinking false is accepted by the template but OpenBMB doesn't support it for the 2B
  7. Validate JSON yourself or use the runtime's guided decoding, since structured output isn't documented
  8. Use the main repository's template; the GGUF, MLX and GPTQ copies predate the 29 September fix

Step 3.7 Flash

  1. On a 128 GB machine the 4-bit GGUF won't fit with a working context. Use StepFun's API or a provider, or a server
  2. On vLLM or SGLang pass --tool-call-parser step3p5 --reasoning-parser step3p5
  3. The card's commands pass trust-remote-code. Released Transformers 5.22.2 has the model built in if you'd rather not run the repository's code
  4. For llama.cpp load the mmproj file from StepFun's GGUF repository for image input
  5. StepFun's API has two hosts. Use the one where your key was issued, api.stepfun.ai or api.stepfun.com
  6. The same model is on our StepFun API listing, with prices and terms

Questions

Which is better for AI agents, MiniCPM5-2B or Step 3.7 Flash?

Step 3.7 Flash and MiniCPM5-2B score within a point of each other on agent readiness, 59.8 (C) and 59.7 (C). MiniCPM5-2B leads on reach, risk and documentation and upkeep.

Other comparisons with MiniCPM5-2B or Step 3.7 Flash

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.