GLM-4.5-Air vs Olmo 3 7B Think

GLM-4.5-Air

An English and Chinese cousin for agent, coding and tool-calling work, with switchable thinking and wide runtime support. It needs about 135 GB for Z.ai's FP8 build, two to four H100s by Z.ai's figures, and Z.ai and Novita host it. The main risk is age, with files from August 2025 and no answers from Z.ai since.

Olmo 3 7B Think

A fully open 7B reasoning cousin for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

GLM-4.5-Air

1. Z.ai's FP8 recipe is python3 -m sglang.launch_server --model-path zai-org/GLM-4.5-Air-FP8 --tp-size 4 --tool-call-parser glm45 --reasoning-parser glm45, and 2 H100s are enough below the full 128K context
2. Use the glm45 tool and reasoning parsers for this model, the glm47 parser in Z.ai's current README is for GLM-4.7
3. Thinking is on by default, pass chat_template_kwargs with enable_thinking false for short tasks, which makes the template add /nothink and an empty think block
4. Declare tools in OpenAI style, and the template renders arguments as arg_key and arg_value pairs that the parser turns back into JSON
5. Keep prompts under 128,000 tokens, the tokenizer config's limit, though config.json allows 131,072
6. Validate JSON output yourself or use the runtime's guided decoding, since structured output isn't documented for the weights

Olmo 3 7B Think

1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research