DeepSeek V4.1 Flash vs MiniCPM5-2B

DeepSeek V4.1 Flash

A large multimodal agent model with a 1M-token context, documented tool calls, JSON Schema output and a reasoning budget, under MIT. It needs about 612 GB of memory across several GPUs in vLLM or SGLang. The main risks are prompts built from DeepSeek's code rather than a template, no published safety results and no answers in its repositories.

MiniCPM5-2B

A tiny dense cousin for local tool calling and long context, with published training data and an active publisher. OpenBMB's own 4-bit builds need about 2 GB, so it runs on a laptop or phone in vLLM, SGLang, llama.cpp, Ollama or Transformers. The main risks are always-on thinking, no safety results and use conditions beyond Apache 2.0.

DeepSeek V4.1 Flash

1. DeepSeek's reference run is its inference folder, convert.py with --model-parallel 8 --expert-dtype fp4, then torchrun --nproc-per-node 8 generate.py --ckpt-path "$SAVE_PATH" --config config.json --interactive
2. In vLLM 0.32.0 the parsers are named deepseek_v41 for both --tool-call-parser and --reasoning-parser. That's vLLM's naming, DeepSeek doesn't document a vLLM command
3. Build prompts with encoding.py or pip install deepseek-recipe, not the September repository's chat_template.jinja, which an open pull request says trails the 16 October encoding
4. Tool calls come back in a DSML calls block with a space before calls, invoke and parameter, unlike V4
5. Set reasoning_effort to 1 to 100, or low, high or max (50, 75, 100), in thinking mode only. Default is 75
6. Sample at temperature 1.0 and top_p 1.0 and allow 256K or more output tokens, as the card recommends
7. Without the hardware, call DeepSeek's API as deepseek-flash, which serves this exact update

MiniCPM5-2B

1. Smallest start is ollama run openbmb/minicpm5-2b (1.6 GB, q4_k_m)
2. On vLLM 0.29.0 or later run vllm serve openbmb/MiniCPM5-2B --max-model-len 131072 --enable-auto-tool-choice --tool-call-parser minicpm5, or tool calls come back as XML text
3. On SGLang 0.5.16 or later add --tool-call-parser minicpm5 --reasoning-parser qwen3; SGLang is OpenBMB's recommended backend for tool calls
4. Tool calls are XML, <function name=...><param name=...>, not Hermes JSON
5. Sample with temperature 1.0, top_p 0.95 and min_p 0.0; llama.cpp's default min_p 0.05 can loop, and repetition_penalty 1.05 helps if it does
6. Expect a <think> block before every answer and leave room in max_tokens; enable_thinking false is accepted by the template but OpenBMB doesn't support it for the 2B
7. Validate JSON yourself or use the runtime's guided decoding, since structured output isn't documented
8. Use the main repository's template; the GGUF, MLX and GPTQ copies predate the 29 September fix