Apertus v1.5 8B vs GLM-5.3

Apertus v1.5 8B

A fully open 8B cousin, training data included, for multilingual chat and tool calls with images and audio in. It needs about 22 GB in BF16 and Swiss AI's own vLLM or Transformers fork, since no released runtime supports it. The main risks are a gated download with a policy to pass on and tools that fail with thinking on.

GLM-5.3

A large coding and long-horizon agent model with a 1M-token context, several tool calls per turn and three reasoning budgets. Z.ai's smallest build is 756 GB in FP8, so it needs an 8-GPU server, Z.ai's API or a provider. The main risks are no published safety work, no way to report a flaw, and thinking that can't be turned off.

Apertus v1.5 8B

1. Accept the terms on the card and set HF_TOKEN before downloading
2. Use Swiss AI's Docker image ghcr.io/swiss-ai/vllm_apertus_1.5_release, since stock vLLM and Transformers don't load Apertus1p5ForConditionalGeneration yet
3. Serve with --chat-template-content-format string --enable-auto-tool-choice --tool-call-parser apertus for tools, and leave thinking off when you need tools
4. For thinking, set --reasoning-parser apertus and --default-chat-template-kwargs.enable_thinking true, and budget max tokens generously
5. Audio is resampled to 24 kHz and costs 40 tokens a second, and video must be passed as frames
6. Don't cast the loaded model with .half(), the image and audio tokenizers must stay in F32
7. If you redistribute the weights, the policy says you must pass it on and get the recipient's express assent

GLM-5.3

1. Start it with vllm serve zai-org/GLM-5.3 --kv-cache-dtype fp8 --tensor-parallel-size 8 --speculative-config.method mtp --speculative-config.num_speculative_tokens 5 --tool-call-parser glm47 --reasoning-parser glm47 --enable-auto-tool-choice --served-model-name glm-5.3 (vLLM 0.28.0 or later, 8xH200 or 8xH20 per vLLM's recipe)
2. Use the glm47 tool-call and reasoning parsers in vLLM or SGLang; SGLang's cookbook says glm45 leaves the calls as plain text
3. Pass chat_template_kwargs: {"reasoning_effort": "low"} for short tasks; anything other than low or high falls back to max
4. Pass clear_thinking: true in chat use, since the template keeps earlier reasoning by default
5. Don't send enable_thinking: false; the template ignores it and always opens a think block
6. Validate JSON output yourself, since structured output is documented only for Z.ai's hosted API
7. No Z.ai build fits a 128 GB machine; the full 1M context needs 8xB200 per vLLM's recipe