MiniCPM5-2B vs occamy-1.0

MiniCPM5-2B

A tiny dense cousin for local tool calling and long context, with published training data and an active publisher. OpenBMB's own 4-bit builds need about 2 GB, so it runs on a laptop or phone in vLLM, SGLang, llama.cpp, Ollama or Transformers. The main risks are always-on thinking, no safety results and use conditions beyond Apache 2.0.

occamy-1.0

A Qwen3.6-35B-A3B fine-tuned for long agent work with tools, files and code, under plain Apache 2.0, and Accio's 4-bit builds run in about 23 GB. The main gaps are no safety results, agent guidance or security contact, and every benchmark figure is Accio's own.

MiniCPM5-2B

1. Smallest start is ollama run openbmb/minicpm5-2b (1.6 GB, q4_k_m)
2. On vLLM 0.29.0 or later run vllm serve openbmb/MiniCPM5-2B --max-model-len 131072 --enable-auto-tool-choice --tool-call-parser minicpm5, or tool calls come back as XML text
3. On SGLang 0.5.16 or later add --tool-call-parser minicpm5 --reasoning-parser qwen3; SGLang is OpenBMB's recommended backend for tool calls
4. Tool calls are XML, <function name=...><param name=...>, not Hermes JSON
5. Sample with temperature 1.0, top_p 0.95 and min_p 0.0; llama.cpp's default min_p 0.05 can loop, and repetition_penalty 1.05 helps if it does
6. Expect a <think> block before every answer and leave room in max_tokens; enable_thinking false is accepted by the template but OpenBMB doesn't support it for the 2B
7. Validate JSON yourself or use the runtime's guided decoding, since structured output isn't documented
8. Use the main repository's template; the GGUF, MLX and GPTQ copies predate the 29 September fix

occamy-1.0

1. Serve with --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder on vLLM 0.19.0 or SGLang 0.5.10 and later
2. BF16 is 70.2 GB, so on a 128 GB machine run it without the card's 8-way tensor parallelism
3. Keep the whole assistant message, reasoning and tool calls included, in later turns, as the card says
4. Sampling per the card is temperature 1.0, top_p 0.95, top_k 20 and presence_penalty 1.5
5. With the GGUFs, NFC-normalise input text and read TOKENIZER.md, since the files store qwen2 pre-tokenizer metadata
6. The base's MTP layer isn't in this checkpoint, Accio-Lab/occamy-1.0-MTP is an experimental separate head