GLM-5.3 vs gpt-oss-20b

GLM-5.3

A large coding and long-horizon agent model with a 1M-token context, several tool calls per turn and three reasoning budgets. Z.ai's smallest build is 756 GB in FP8, so it needs an 8-GPU server, Z.ai's API or a provider. The main risks are no published safety work, no way to report a flaw, and thinking that can't be turned off.

gpt-oss-20b

gpt-oss-20b is a cousin for reasoning, coding and single tool calls with structured output, under plain Apache 2.0. It needs about 17 GB with a working context, and five inference providers serve it. The main risks are that it trails o4-mini at keeping system instructions above user ones, and OpenAI hasn't answered a report since August 2025.

GLM-5.3

1. Start it with vllm serve zai-org/GLM-5.3 --kv-cache-dtype fp8 --tensor-parallel-size 8 --speculative-config.method mtp --speculative-config.num_speculative_tokens 5 --tool-call-parser glm47 --reasoning-parser glm47 --enable-auto-tool-choice --served-model-name glm-5.3 (vLLM 0.28.0 or later, 8xH200 or 8xH20 per vLLM's recipe)
2. Use the glm47 tool-call and reasoning parsers in vLLM or SGLang; SGLang's cookbook says glm45 leaves the calls as plain text
3. Pass chat_template_kwargs: {"reasoning_effort": "low"} for short tasks; anything other than low or high falls back to max
4. Pass clear_thinking: true in chat use, since the template keeps earlier reasoning by default
5. Don't send enable_thinking: false; the template ignores it and always opens a think block
6. Validate JSON output yourself, since structured output is documented only for Z.ai's hosted API
7. No Z.ai build fits a 128 GB machine; the full 1M context needs 8xB200 per vLLM's recipe

gpt-oss-20b

1. Start it with ollama run gpt-oss:20b (the build that fits the reference machine), or vllm serve openai/gpt-oss-20b with a current vLLM release rather than the card's pinned vllm==0.10.1+gptoss wheel
2. Use the harmony format through the chat template or openai-harmony; OpenAI says the model doesn't work correctly without it
3. Parse tool calls and reasoning with openai-harmony; calls come on the commentary channel ending in <|call|>, reasoning on the analysis channel
4. Set effort with Reasoning: high (or low, medium) in the system message, or reasoning_effort in the template; medium is the default
5. Ask for JSON by putting a JSON Schema under # Response Formats in the developer message
6. Drop earlier reasoning after a final answer but pass it back after tool calls, and don't show the analysis channel to users
7. Expect one tool call per turn; run several in sequence rather than in parallel