Olmo 3 7B Think vs Qwen3-Coder-30B-A3B-Instruct

Olmo 3 7B Think

A fully open 7B reasoning cousin for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

Qwen3-Coder-30B-A3B-Instruct

A fast coding cousin, with 3.3B of 30.5B parameters active per token, for agentic coding tools, repository reading and fill-in-the-middle without a thinking step. It needs about 21 to 23 GB at 4 bits, and several providers host it. The main risk is that it runs commands for agents with no safety results or guidance, and Alibaba doesn't answer users.

Olmo 3 7B Think

1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research

Qwen3-Coder-30B-A3B-Instruct

1. Quickest start is ollama run qwen3-coder:30b, 19 GB
2. On our reference machine use BF16 with vllm serve Qwen/Qwen3-Coder-30B-A3B-Instruct --max-model-len 262144 --enable-auto-tool-choice --tool-call-parser qwen3_coder, 61 GB of weights fits the GPU share
3. Use the qwen3_coder parser in vLLM or SGLang, not hermes, since calls come back as function and parameter blocks rather than JSON
4. Pass tool-call arguments in the history as objects, the template iterates them as a mapping
5. Sampling per the card is temperature 0.7, top_p 0.8, top_k 20 and repetition_penalty 1.05, with up to 65,536 output tokens
6. For code completion use the fill-in-the-middle tokens <|fim_prefix|>, <|fim_suffix|> and <|fim_middle|> from Qwen's README
7. Sandbox the commands and files it touches, since nothing from Alibaba covers prompt injection