gpt-oss-20b vs MiniCPM5-2B

gpt-oss-20b

gpt-oss-20b is a cousin for reasoning, coding and single tool calls with structured output, under plain Apache 2.0. It needs about 17 GB with a working context, and five inference providers serve it. The main risks are that it trails o4-mini at keeping system instructions above user ones, and OpenAI hasn't answered a report since August 2025.

MiniCPM5-2B

A tiny dense cousin for local tool calling and long context, with published training data and an active publisher. OpenBMB's own 4-bit builds need about 2 GB, so it runs on a laptop or phone in vLLM, SGLang, llama.cpp, Ollama or Transformers. The main risks are always-on thinking, no safety results and use conditions beyond Apache 2.0.

gpt-oss-20b

1. Start it with ollama run gpt-oss:20b (the build that fits the reference machine), or vllm serve openai/gpt-oss-20b with a current vLLM release rather than the card's pinned vllm==0.10.1+gptoss wheel
2. Use the harmony format through the chat template or openai-harmony; OpenAI says the model doesn't work correctly without it
3. Parse tool calls and reasoning with openai-harmony; calls come on the commentary channel ending in <|call|>, reasoning on the analysis channel
4. Set effort with Reasoning: high (or low, medium) in the system message, or reasoning_effort in the template; medium is the default
5. Ask for JSON by putting a JSON Schema under # Response Formats in the developer message
6. Drop earlier reasoning after a final answer but pass it back after tool calls, and don't show the analysis channel to users
7. Expect one tool call per turn; run several in sequence rather than in parallel

MiniCPM5-2B

1. Smallest start is ollama run openbmb/minicpm5-2b (1.6 GB, q4_k_m)
2. On vLLM 0.29.0 or later run vllm serve openbmb/MiniCPM5-2B --max-model-len 131072 --enable-auto-tool-choice --tool-call-parser minicpm5, or tool calls come back as XML text
3. On SGLang 0.5.16 or later add --tool-call-parser minicpm5 --reasoning-parser qwen3; SGLang is OpenBMB's recommended backend for tool calls
4. Tool calls are XML, <function name=...><param name=...>, not Hermes JSON
5. Sample with temperature 1.0, top_p 0.95 and min_p 0.0; llama.cpp's default min_p 0.05 can loop, and repetition_penalty 1.05 helps if it does
6. Expect a <think> block before every answer and leave room in max_tokens; enable_thinking false is accepted by the template but OpenBMB doesn't support it for the 2B
7. Validate JSON yourself or use the runtime's guided decoding, since structured output isn't documented
8. Use the main repository's template; the GGUF, MLX and GPTQ copies predate the 29 September fix