Laguna XS 2.1 vs Nemotron 3 Nano 4B

Laguna XS 2.1

A small coding and agent cousin with 3B active parameters, so it's quick on modest hardware. Poolside's 4-bit GGUF, also Ollama's default, needs about 24 GB, and every major runtime runs it. The main risks are that nobody at Poolside answers its discussions, there are no safety results, and the SGLang route runs repository code.

Nemotron 3 Nano 4B

A tiny reasoning cousin with trained tool calls, a thinking switch and 262,144 tokens of context, running in about 4 GB from NVIDIA's own GGUF on almost any machine. The main risks are serving commands that run repository code, no published safety results, a tool format left to the template, and files untouched and questions unanswered since March.

Laguna XS 2.1

1. Quickest start is ollama run laguna-xs-2.1, 20 GB of files, the same Q4_K_M as Poolside's GGUF
2. On our reference machine use llama-server -hf poolside/Laguna-XS-2.1-GGUF:Q4_K_M --jinja -c 131072, from a llama.cpp release with the laguna architecture (b11772 has it), or BF16 with vLLM (66.9 GB)
3. With vLLM use --tool-call-parser poolside_v1 --reasoning-parser poolside_v1 --enable-auto-tool-choice, on a build with vllm-project/vllm#47311, or --tool-call-parser glm47 on older builds
4. Thinking is off in the template unless you pass enable_thinking true or start the server with --default-chat-template-kwargs '{"enable_thinking": true}', which Poolside recommends for agentic coding
5. Pass earlier reasoning back as reasoning_content in the history, since the card says reasoning may stop in later steps if it's dropped
6. Sampling per the card is temperature 1.0 and top_k 20
7. The card warns that Ollama on Apple Silicon may return empty output until llama.cpp#25389 ships
8. Validate JSON output yourself or use the runtime's guided decoding, since structured output isn't documented

Nemotron 3 Nano 4B

1. Quickest start is ollama run nemotron-3-nano:4b, a 2.8 GB build
2. With llama.cpp use llama-server -hf nvidia/NVIDIA-Nemotron-3-Nano-4B-GGUF --jinja, NVIDIA's own Q4_K_M file
3. With vLLM, download nano_v3_reasoning_parser.py from the repository first and serve with --enable-auto-tool-choice --tool-call-parser qwen3_coder --reasoning-parser-plugin nano_v3_reasoning_parser.py --reasoning-parser nano_v3
4. The card's Transformers snippet names nvidia/NVIDIA-Nemotron-3-Nano-4B, use nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 instead
5. Thinking is on by default. Pass enable_thinking=False to the chat template for short tasks
6. Use temperature 1.0 and top_p 0.95 for reasoning and temperature 0.6 with top_p 0.95 for tool calling, as the card says
7. It's tuned for English only, and validate JSON yourself, since structured output isn't documented