GLM-5.3-Flash vs Nemotron 3 Nano 4B

GLM-5.3-Flash

An MIT-licensed multimodal agent and coding model with a 1M-token context and several tool calls per turn, served by vLLM, SGLang, llama.cpp and Transformers. Z.ai's smallest build is 328 GB in FP8, so it needs a multi-GPU server. The main risk is that nothing on safety or prompt injection is published and there is no way to report a flaw.

Nemotron 3 Nano 4B

A tiny reasoning cousin with trained tool calls, a thinking switch and 262,144 tokens of context, running in about 4 GB from NVIDIA's own GGUF on almost any machine. The main risks are serving commands that run repository code, no published safety results, a tool format left to the template, and files untouched and questions unanswered since March.

GLM-5.3-Flash

1. Start it with vllm serve zai-org/GLM-5.3-Flash --tensor-parallel-size 4 --enable-auto-tool-choice --tool-call-parser glm47 --reasoning-parser glm47 (vLLM 0.32.0 or later, about 386 GB of GPU memory per vLLM's recipe)
2. Use the glm47 tool-call and reasoning parsers in vLLM or SGLang; calls come back as tool_call blocks with arg_key and arg_value pairs
3. Pass chat_template_kwargs: {"reasoning_effort": "low"} for short tasks; anything other than low or high falls back to max
4. Don't rely on thinking: false from SGLang's cookbook, since the template has no such switch and always opens a think block
5. Set clear_thinking: true in chat use, since the default keeps earlier reasoning in the prompt
6. On a 128 GB machine only third-party low-bit builds come near fitting, none of them from Z.ai

Nemotron 3 Nano 4B

1. Quickest start is ollama run nemotron-3-nano:4b, a 2.8 GB build
2. With llama.cpp use llama-server -hf nvidia/NVIDIA-Nemotron-3-Nano-4B-GGUF --jinja, NVIDIA's own Q4_K_M file
3. With vLLM, download nano_v3_reasoning_parser.py from the repository first and serve with --enable-auto-tool-choice --tool-call-parser qwen3_coder --reasoning-parser-plugin nano_v3_reasoning_parser.py --reasoning-parser nano_v3
4. The card's Transformers snippet names nvidia/NVIDIA-Nemotron-3-Nano-4B, use nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 instead
5. Thinking is on by default. Pass enable_thinking=False to the chat template for short tasks
6. Use temperature 1.0 and top_p 0.95 for reasoning and temperature 0.6 with top_p 0.95 for tool calling, as the card says
7. It's tuned for English only, and validate JSON yourself, since structured output isn't documented