Cosmos-Reason2-2B vs Qwen3.5-9B

Cosmos-Reason2-2B

A small local cousin for reasoning over video and images in robotics, driving and warehouse scenes, returning points, boxes and timed events as JSON. The 4.9 GB file runs in Transformers or vLLM, though NVIDIA asks for 24 GB of GPU memory. Development has moved to Cosmos 3, and the gated licence is revocable.

Qwen3.5-9B

A small dense vision-language cousin with trained tool calling, switchable thinking and a 262,144-token context, for local agent subtasks. Ollama's 4-bit build needs about 8 GB and the BF16 files about 24 GB, in every major runtime. The main risk is neglect, with no file changes since March, no replies from Qwen to reports and no safety results.

Cosmos-Reason2-2B

1. Accept the licence on the Hugging Face card with a signed-in account and set HF_TOKEN before downloading
2. Serve it with vllm serve nvidia/Cosmos-Reason2-2B --max-model-len 16384 --media-io-kwargs '{"video": {"num_frames": -1}}' --reasoning-parser qwen3, keeping max-model-len between 8,192 and 16,384 as NVIDIA advises
3. For local video or images, make a folder for them (mkdir -p media) and pass --allowed-local-media-path "$(pwd)/media", so the server can read only that folder, not everything under the directory you start it from
4. Sample video at 4 fps and allow at least 4,096 output tokens so the reasoning isn't cut off
5. For reasoning, add the card's instruction to answer with a think block and then the answer; leave it out for a direct reply
6. Use NVIDIA's prompt files (prompts/*.yaml in nvidia-cosmos/cosmos-reason2) when you want JSON boxes, events or trajectories, and validate the JSON yourself
7. Check its plans before a robot acts on them, since NVIDIA's own safety card warns of collision and manipulation risks

Qwen3.5-9B

1. Smallest start is ollama run qwen3.5:9b (6.6 GB, q4_k_m)
2. On vLLM run vllm serve Qwen/Qwen3.5-9B --port 8000 --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, or tool calls come back as text
3. Tool calls use the XML style <tool_call><function=name><parameter=x>, not Hermes JSON, so use the qwen3_coder parser and not hermes
4. Thinking is on by default; pass chat_template_kwargs with enable_thinking false for short tasks, since /nothink isn't supported
5. There's no generation_config.json, so pass sampling yourself, temperature 1.0, top_p 0.95, top_k 20, presence_penalty 1.5 when thinking, or 0.7, 0.8, 20, 1.5 without
6. Keep at least 128K of context when thinking, and turn on YaRN only beyond 262,144 tokens
7. Validate JSON output yourself or use the runtime's guided decoding