Darwin-36B-Opus vs Qwen3-VL-8B-Instruct

Darwin-36B-Opus

A text-only reasoning cousin merged from Qwen3.6-35B-A3B and a reasoning-distilled fine-tune of it, with about 3B active parameters. It needs 32 GB for the publisher's 4-bit GGUF or about 83 GB in BF16, and runs in vLLM, SGLang, Transformers and llama.cpp. The main risks are an undisclosed merge method, a card that disagrees with its files, and no safety results.

Qwen3-VL-8B-Instruct

A small vision-language cousin for reading screenshots, documents, charts and video, in about 6 GB from Alibaba's Q4_K_M GGUF and every major runtime, under plain Apache 2.0. It has no thinking mode and documents tool calls only in the template. The main risk is no published safety work, so add your own guardrails before it drives a GUI.

Darwin-36B-Opus

1. Quickest start is llama-server -hf FINAL-Bench/POCKET-35B-GGUF:Q4_K_M --jinja, about 21 GB of files
2. On the reference machine BF16 fits, vllm serve FINAL-Bench/Darwin-36B-Opus --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, the parsers for Qwen3.6's format
3. Thinking is on by default, send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
4. The card suggests temperature 0.6 to 0.7 and at least 5,120 new tokens for its think traces
5. generation_config.json stops only on the end-of-text token, so add <|im_end|> as a stop token if a runtime keeps generating after the turn ends
6. Text only, the vision encoder of Qwen3.6-35B-A3B isn't in these files
7. Validate JSON output yourself, since structured output isn't documented

Qwen3-VL-8B-Instruct

1. Start it with llama-server -hf Qwen/Qwen3-VL-8B-Instruct-GGUF:Q4_K_M --jinja -c 32768, or ollama run qwen3-vl:8b-instruct
2. In Ollama the plain qwen3-vl:8b tag is the Thinking edition, so name 8b-instruct
3. With the GGUF, load the mmproj vision file too, or images won't be read
4. Parse tool calls as JSON inside <tool_call> tags, or use SGLang's --tool-call-parser qwen
5. Use the card's sampling, temperature=0.7, top_p=0.8, top_k=20, presence_penalty=1.5 for vision and temperature=1.0, top_p=1.0, top_k=40, presence_penalty=2.0 for text
6. Validate JSON output yourself, since structured output isn't documented
7. vLLM needs 0.11.0 or later and Transformers 4.57.0 or later