Agents-A1-4B vs GLM-5.3-Flash

Agents-A1-4B

A small agent cousin for search, research and tool-calling loops, with vision and 262,144 tokens of context. It runs in about 4 GB from InternScience's Q4_K_M GGUF, in vLLM, SGLang, Transformers or llama.cpp. The main risks are an undeclared base, no safety results or agent guidance, and a template that adds its own dated system prompt when you send none.

GLM-5.3-Flash

An MIT-licensed multimodal agent and coding model with a 1M-token context and several tool calls per turn, served by vLLM, SGLang, llama.cpp and Transformers. Z.ai's smallest build is 328 GB in FP8, so it needs a multi-GPU server. The main risk is that nothing on safety or prompt injection is published and there is no way to report a flaw.

Agents-A1-4B

1. Quickest start is llama-server -hf InternScience/Agents-A1-4B-Q4_K_M-GGUF --jinja, about 3.4 GB with the vision projector
2. With vLLM use --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, as on the card, and add --language-model-only for text-only work
3. Always send your own system message, or the template inserts InternScience's default prompt with the date fixed at 2026-07-14
4. The card recommends temperature 0.85, top_p 0.95, top_k 20, min_p 0 and presence_penalty 1.1, and there is no generation_config.json to set them
5. Thinking is on by default, send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
6. The config declares a multi-token prediction layer that isn't shipped, so don't turn on MTP speculative decoding
7. Validate JSON output yourself, since structured output isn't documented

GLM-5.3-Flash

1. Start it with vllm serve zai-org/GLM-5.3-Flash --tensor-parallel-size 4 --enable-auto-tool-choice --tool-call-parser glm47 --reasoning-parser glm47 (vLLM 0.32.0 or later, about 386 GB of GPU memory per vLLM's recipe)
2. Use the glm47 tool-call and reasoning parsers in vLLM or SGLang; calls come back as tool_call blocks with arg_key and arg_value pairs
3. Pass chat_template_kwargs: {"reasoning_effort": "low"} for short tasks; anything other than low or high falls back to max
4. Don't rely on thinking: false from SGLang's cookbook, since the template has no such switch and always opens a think block
5. Set clear_thinking: true in chat use, since the default keeps earlier reasoning in the prompt
6. On a 128 GB machine only third-party low-bit builds come near fitting, none of them from Z.ai