DeepSeek-V3.2 vs Ornith-1.5-9B

DeepSeek-V3.2

DeepSeek-V3.2 is an MIT-licensed reasoning model trained for parallel tool calls, with thinking chosen per request, for long agent work. It needs about 690 GB of FP8 files, eight 80 GB GPUs in vLLM's recipe and prompts built from DeepSeek's Python. The main risk is neglect, with no file changes since December 2025 and no safety evaluation.

Ornith-1.5-9B

A small coding and terminal-agent cousin with thinking on by default, XML tool calls that vLLM and SGLang parse, and 262,144 tokens of context. Ornith's own 4-bit builds run in under 8 GB in most local runtimes. The main risk is an absent publisher, with no licence file, no safety results, files replaced without a note and no replies.

DeepSeek-V3.2

1. Start it with vLLM's recipe, vllm serve deepseek-ai/DeepSeek-V3.2 --tensor-parallel-size 8 --tokenizer-mode deepseek_v32 --enable-auto-tool-choice --tool-call-parser deepseek_v32 --reasoning-parser deepseek_v3
2. It doesn't fit the 107.4 GB reference machine at any qualifying build, so call DeepInfra (deepseek-ai/DeepSeek-V3.2) or SambaNova (DeepSeek-V3.2) instead
3. Outside vLLM, build prompts with encoding/encoding_dsv32.py and wrap parse_message_from_completion_text in error handling, since DeepSeek says it handles well-formed output only
4. Pick thinking or chat with thinking_mode, and read the reasoning from reasoning_content
5. Send developer messages only for search-agent prompts, the only use DeepSeek gives that role
6. Use temperature 1.0 and top_p 0.95 and keep prompts within 128K tokens

Ornith-1.5-9B

1. Start it with ollama run ornith-1.5:9b, or llama-server -hf ornith-ai/Ornith-1.5-9B-GGUF with the Q4_K_M file
2. In vLLM pass --enable-auto-tool-choice --tool-call-parser qwen3_xml --reasoning-parser qwen3, and in SGLang --tool-call-parser qwen3_coder --reasoning-parser qwen3, so tool calls and reasoning come back parsed
3. Thinking is on by default. Send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
4. Pin which template your runtime loads, since chat_template.jinja keeps earlier reasoning and the tokenizer_config.json template drops it
5. Use temperature 0.6, top_p 0.95, top_k 20 for coding and temperature 1.0 with presence_penalty 1.5 for general tasks, per the card
6. Pin a revision when you download, since Ornith has replaced files in place, and add mmproj-Ornith-1.5-9B-BF16.gguf (0.9 GB) for image input in llama.cpp
7. Validate JSON output yourself, since structured output isn't documented