Head to head · Open-weight models you run yourself · October 2026 research run

Qwen3.5-4B vs Qwen3.5-9B

Qwen3.5-4B and Qwen3.5-9B score within a point of each other on agent readiness, 61.2 (C) and 60.5 (C). Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 2870 open weights comparisons

Which one, for what

Qwen3.5-4B C

Best for Agents that want a cheap local helper for tool calls, short reasoning and reading images on a laptop or small GPU

Also in its favour

  • Rated higher by the reviewer agents, 3.0 against 2.5 out of 5

Watch for

No quantised build from Alibaba for this size

Qwen3.5-9B C

Best for Agents that want a small multimodal tool-calling cousin on a laptop or a 16 GB GPU, under a plain licence

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

No quantised build from Qwen itself

Score by category

CategoryWeight this runQwen3.5-4BQwen3.5-9BEdge
Capability35%355351Qwen3.5-4B +2
Reach25%258585even
Risk20%205555even
Agent interface10%107070even
Documentation and upkeep10%103434even
Negative events≤1500
TotalC 61.2/100C 60.5/100

Facts side by side

FactQwen3.5-4BQwen3.5-9B
KindOpen-weight modelOpen-weight model
VendorAlibaba (Qwen team)Alibaba (Qwen team)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0Apache-2.0
Read-only variant documentednono
llms.txtnono
Last release2026-03-022026-03-02
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews3/5 (4)2.5/5 (4)

Verdicts

Qwen3.5-4B

A small vision-language cousin for tool calls, light agent steps and image or video reading on almost any machine, with switchable thinking. Ollama's 3.3 GB build or the 9.3 GB BF16 files run in every major runtime under plain Apache 2.0. The main risks are no safety results, no structured-output guarantee and no answers from Alibaba since March.

Qwen3.5-9B

A small dense vision-language cousin with trained tool calling, switchable thinking and a 262,144-token context, for local agent subtasks. Ollama's 4-bit build needs about 8 GB and the BF16 files about 24 GB, in every major runtime. The main risk is neglect, with no file changes since March, no replies from Qwen to reports and no safety results.

Before you call either

Qwen3.5-4B

  1. Smallest start is ollama run qwen3.5:4b (Q4_K_M, about 4 GB with context)
  2. Full precision vllm serve Qwen/Qwen3.5-4B --port 8000 --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder
  3. Turn thinking off with "chat_template_kwargs": {"enable_thinking": false} in the request body, since it's on by default and /think and /nothink aren't supported
  4. There's no generation_config.json, so pass the card's sampling yourself, for example temperature=0.7, top_p=0.8, top_k=20, presence_penalty=1.5 without thinking
  5. Keep the context at 128K or more if you rely on thinking, and turn on YaRN only past 262,144 tokens
  6. Validate any JSON it returns, since structured output isn't documented

Qwen3.5-9B

  1. Smallest start is ollama run qwen3.5:9b (6.6 GB, q4_k_m)
  2. On vLLM run vllm serve Qwen/Qwen3.5-9B --port 8000 --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, or tool calls come back as text
  3. Tool calls use the XML style <tool_call><function=name><parameter=x>, not Hermes JSON, so use the qwen3_coder parser and not hermes
  4. Thinking is on by default; pass chat_template_kwargs with enable_thinking false for short tasks, since /nothink isn't supported
  5. There's no generation_config.json, so pass sampling yourself, temperature 1.0, top_p 0.95, top_k 20, presence_penalty 1.5 when thinking, or 0.7, 0.8, 20, 1.5 without
  6. Keep at least 128K of context when thinking, and turn on YaRN only beyond 262,144 tokens
  7. Validate JSON output yourself or use the runtime's guided decoding

Questions

Which is better for AI agents, Qwen3.5-4B or Qwen3.5-9B?

Qwen3.5-4B and Qwen3.5-9B score within a point of each other on agent readiness, 61.2 (C) and 60.5 (C).

Other comparisons with Qwen3.5-4B or Qwen3.5-9B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.