DeepSeek-V4-Flash-0731 vs Qwen3-VL-30B-A3B-Instruct

DeepSeek-V4-Flash-0731

A long-context agent cousin under MIT with documented tool calls, three reasoning effort levels and support in every major runtime but Ollama. It needs about 190 to 200 GB of memory, though six inference providers serve it. The main risks are prompts built from DeepSeek's Python, no published safety results and no answers in its repository.

Qwen3-VL-30B-A3B-Instruct

A mid-sized vision-language cousin for screenshots, documents, charts and video that runs fast for its size, with about 3B active parameters. It needs about 23 GB for Alibaba's Q4_K_M GGUF with its vision file, loads in every major runtime under plain Apache 2.0, and three providers host it. With no published safety work, add guardrails before it drives a GUI.

DeepSeek-V4-Flash-0731

1. vllm serve deepseek-ai/DeepSeek-V4-Flash-0731 --trust-remote-code --kv-cache-dtype fp8 --block-size 256 --data-parallel-size 4 --enable-expert-parallel --moe-backend deep_gemm_mega_moe --attention-config '{"use_fp4_indexer_cache": true}' --speculative-config '{"method":"dspark","num_speculative_tokens":7,"draft_sample_method":"greedy"}' --tokenizer-mode deepseek_v4 --tool-call-parser deepseek_v4 --enable-auto-tool-choice --reasoning-parser deepseek_v4 (the card's 4x GB300 example plus the parser flags from vLLM's recipe)
2. Build prompts with encoding_dsv4.py, deepseek-recipe's V4 encoder or vLLM's --tokenizer-mode deepseek_v4, since the repository has no Jinja template
3. Tool calls come back in a DSML tool_calls block with invoke elements, string parameters carry string="true" and JSON values string="false"
4. Set temperature 1.0 and top_p 0.95 for agent work, and allow up to 384K output tokens at reasoning effort high or max
5. Without the hardware, call it through a Hugging Face inference provider (Together, DeepInfra, Novita, Baseten, Scaleway, Featherless), not DeepSeek's API, where deepseek-v4-flash now means V4.1 Flash
6. LM Studio's library build is a 156.4 GB MXFP4 GGUF and LM Studio states 156 GB minimum system memory

Qwen3-VL-30B-A3B-Instruct

1. Start it with llama-server -hf Qwen/Qwen3-VL-30B-A3B-Instruct-GGUF:Q4_K_M --jinja -c 32768, or ollama run qwen3-vl:30b-a3b-instruct
2. In Ollama the plain qwen3-vl:30b tag is the Thinking edition, so name 30b-a3b-instruct
3. With the GGUF, load the mmproj vision file too, or images won't be read
4. Parse tool calls as JSON inside <tool_call> tags, or use SGLang's --tool-call-parser qwen
5. Use the shipped sampling, temperature 0.7, top_p 0.8 and top_k 20, from generation_config.json
6. Validate JSON output yourself, since structured output isn't documented
7. vLLM needs 0.11.0 or later, Transformers 4.57.0 or later and llama.cpp b6907 or later