Qwen3-Coder-Next vs Qwen3-VL-30B-A3B-Instruct

Qwen3-Coder-Next

A fast coding cousin for agent harnesses, with 3B active parameters and tool calling trained across many scaffold formats for Claude Code, Cline or Qwen Code loops. Alibaba's 4-bit GGUF needs about 58 GB, fitting one 64 GB machine, and two providers host it. The main risk is neglect, with no change since February, no replies and no safety results.

Qwen3-VL-30B-A3B-Instruct

A mid-sized vision-language cousin for screenshots, documents, charts and video that runs fast for its size, with about 3B active parameters. It needs about 23 GB for Alibaba's Q4_K_M GGUF with its vision file, loads in every major runtime under plain Apache 2.0, and three providers host it. With no published safety work, add guardrails before it drives a GUI.

Qwen3-Coder-Next

1. Quickest start is ollama run qwen3-coder-next (Q4_K_M, 52 GB of files)
2. On our reference machine Alibaba's Q8_0 GGUF (84.8 GB, about 102 GB in use) also fits, run with llama-server -m Qwen3-Coder-Next-Q8_0/Qwen3-Coder-Next-Q8_0-00001-of-00004.gguf --jinja -ngl 99 -fa on -c 131072
3. Serve with vllm serve Qwen/Qwen3-Coder-Next --enable-auto-tool-choice --tool-call-parser qwen3_coder (vLLM 0.15.0 or later), using the built-in parser rather than the repository's qwen3coder_tool_parser_vllm.py, which fails to import on newer vLLM per discussion 36
4. The card's commands use tensor parallel 2 though the text says 4 GPUs, and it suggests cutting the context to 32,768 if the server fails to start
5. There's no thinking mode, so don't pass enable_thinking or wait for reasoning_content
6. Sampling per the card is temperature 1.0, top_p 0.95 and top_k 40
7. The GGUF card's llama.cpp example path omits the quant from the file name; the real files are named like Qwen3-Coder-Next-Q4_K_M-00001-of-00004.gguf
8. Validate any JSON it returns, since structured output isn't documented

Qwen3-VL-30B-A3B-Instruct

1. Start it with llama-server -hf Qwen/Qwen3-VL-30B-A3B-Instruct-GGUF:Q4_K_M --jinja -c 32768, or ollama run qwen3-vl:30b-a3b-instruct
2. In Ollama the plain qwen3-vl:30b tag is the Thinking edition, so name 30b-a3b-instruct
3. With the GGUF, load the mmproj vision file too, or images won't be read
4. Parse tool calls as JSON inside <tool_call> tags, or use SGLang's --tool-call-parser qwen
5. Use the shipped sampling, temperature 0.7, top_p 0.8 and top_k 20, from generation_config.json
6. Validate JSON output yourself, since structured output isn't documented
7. vLLM needs 0.11.0 or later, Transformers 4.57.0 or later and llama.cpp b6907 or later