NVIDIA Nemotron 3.5 Bolt E4B 4GB vs Swift 1.5 Qwen3.8-27B

NVIDIA Nemotron 3.5 Bolt E4B 4GB

A small cousin for voice and device assistants, game characters and robot interfaces, trained for multi-turn tool calls, instruction hierarchy and short spoken replies, with thinking switchable per request. NVIDIA's Q4_K_M GGUF needs about 8 GB, and Ollama and LM Studio carry it. Context is 64K, half the Gemma 4 base, and NVIDIA publishes no safety results.

Swift 1.5 Qwen3.8-27B

A Qwen3.8-27B cousin post-trained to think in fewer tokens, for coding and agent work with images in, that fits a 24 GB machine with UkisAI's own 4-bit builds. Commercial use is free only below US$1M revenue. The main risks are that nobody at UkisAI answers its discussions, and that the shorter thinking rests on UkisAI's own benchmarks.

NVIDIA Nemotron 3.5 Bolt E4B 4GB

1. Quickest start is ollama run nemotron-3.5-bolt:e4b, about 8 GB of files, and set num_ctx to 65536 or less, since NVIDIA supports 64K
2. With NVIDIA's GGUF use llama-server -m Nemotron-3.5-Bolt-E4B-Q4_K_M.gguf -c 65536 -ngl 999 --jinja, and add --reasoning on --reasoning-budget <tokens> to cap thinking
3. With vLLM 0.31.0 or later pass --enable-auto-tool-choice --tool-call-parser gemma4 --reasoning-parser gemma4 and the repository's chat_template.jinja
4. Pass enable_thinking explicitly in chat_template_kwargs, since the template defaults to off whatever the card says, and set skip_special_tokens false as the card's examples do
5. Use temperature=1.0 and top_p=0.95 in both modes, as the card says
6. Set conversational_mode true for spoken replies, which appends a brevity instruction to the system prompt
7. Answer a slow tool at once with a pending tool message, then send the result later as a user message starting TOOL RESULT, as the card's asynchronous pattern says
8. Keep persistent rules in the system prompt and send state updates as separate user or system messages in order, per the card's prompting guidelines

Swift 1.5 Qwen3.8-27B

1. Quickest start is llama-server -hf ukisai/Swift-1.5-Qwen3.8-27B-GGUF:Q4_K_M --jinja, about 18.4 GB with the vision projector
2. On our reference machine BF16 fits, vllm serve ukisai/Swift-1.5-Qwen3.8-27b --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder
3. The template is Qwen3.8-27B's, so chat_template_kwargs with reasoning_effort low, medium or xhigh (default) and enable_thinking false work as on the base
4. UkisAI benchmarked it at temperature 1.0, top_p 0.95, top_k 20 and presence_penalty 0, which is a reasonable starting point
5. The MLX 4-bit build needs UkisAI's patched MLX-LM and has no image or video chat
6. Check the licence before commercial use, it stops at US$1M gross annual revenue including affiliates
7. MTP self-speculative decoding is available with the base's head, flags on the card