MiniCPM-o 4.5 vs Olmo 3 7B Think

MiniCPM-o 4.5

A small omni cousin that sees, listens and talks back, with full-duplex speech and voice cloning, in about 7 GB at 4-bit through llama.cpp or Ollama for text and images. Speech output needs OpenBMB's remote code or llama.cpp-omni, and 28 GB of GPU for the full demo. The main risks are repository code and pickle files and no safety results.

Olmo 3 7B Think

A fully open 7B reasoning cousin for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

MiniCPM-o 4.5

1. Quickest start for text and images is ollama run openbmb/minicpm-o4.5, about 6 GB
2. With vLLM 0.16.0 or later pass --trust-remote-code, and send stop_token_ids [151643, 151645] as OpenBMB's guide does
3. vLLM, llama.cpp and Ollama return text only; for speech out use the card's Transformers 4.51.0 code or OpenBMB's llama.cpp-omni
4. In llama.cpp pass both the language GGUF and MiniCPM-o-4_5-vision-F16.gguf with --mmproj, and use --jinja --reasoning-budget 0 to turn thinking off
5. Keep prompts within 40,960 tokens
6. Don't rely on tool calls or JSON output, neither is documented; validate any you get

Olmo 3 7B Think

1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research