Qwen3.8-27B vs Qwen3-VL-30B-A3B-Instruct

Qwen3.8-27B

A dense cousin for coding and agent work with image and video input that runs almost anywhere. Ollama's 4-bit build needs about 22 GB, and five providers host it for agents without the hardware. The main risk is that nobody at Alibaba answers, there are no safety results or agent guidance, and the tool format is only in the template.

Qwen3-VL-30B-A3B-Instruct

A mid-sized vision-language cousin for screenshots, documents, charts and video that runs fast for its size, with about 3B active parameters. It needs about 23 GB for Alibaba's Q4_K_M GGUF with its vision file, loads in every major runtime under plain Apache 2.0, and three providers host it. With no published safety work, add guardrails before it drives a GUI.

Qwen3.8-27B

1. Quickest start is ollama run qwen3.8, about 18 GB of files
2. On our reference machine use BF16 with vllm serve Qwen/Qwen3.8-27B --max-model-len 131072 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, since FP8 on gfx1151 isn't documented
3. Use the qwen3_coder tool parser, SGLang's cookbook says the Hermes parser leaves its calls unparsed
4. Thinking is on by default, pass chat_template_kwargs with enable_thinking false for short tasks, and read the reasoning from reasoning_content
5. reasoning_effort takes xhigh (default), medium or low, and any other value makes the template raise an error
6. Sampling per the card is temperature 1.0 and top_p 0.95 when thinking, temperature 0.7, top_p 0.8 and presence_penalty 1.5 without
7. Preserved thinking keeps earlier reasoning in the context unless preserve_thinking is false, which grows long agent sessions
8. Turn on YaRN only beyond 262,144 tokens, the card warns static YaRN can cost quality on short texts
9. Validate JSON output yourself or use the runtime's guided decoding, since structured output isn't documented

Qwen3-VL-30B-A3B-Instruct

1. Start it with llama-server -hf Qwen/Qwen3-VL-30B-A3B-Instruct-GGUF:Q4_K_M --jinja -c 32768, or ollama run qwen3-vl:30b-a3b-instruct
2. In Ollama the plain qwen3-vl:30b tag is the Thinking edition, so name 30b-a3b-instruct
3. With the GGUF, load the mmproj vision file too, or images won't be read
4. Parse tool calls as JSON inside <tool_call> tags, or use SGLang's --tool-call-parser qwen
5. Use the shipped sampling, temperature 0.7, top_p 0.8 and top_k 20, from generation_config.json
6. Validate JSON output yourself, since structured output isn't documented
7. vLLM needs 0.11.0 or later, Transformers 4.57.0 or later and llama.cpp b6907 or later