Qwen3-30B-A3B-Instruct-2507 vs Swift 1.5 Qwen3.8-27B

Qwen3-30B-A3B-Instruct-2507

A quick general-purpose cousin, with 3.3B of 30.5B parameters active per token, for instruction following, tool calling and long documents without a thinking step. It needs about 21 to 23 GB at 4 bits, and several providers host it. The main risk is neglect, with no file changes in over a year, no answers from Alibaba and no safety results.

Swift 1.5 Qwen3.8-27B

A Qwen3.8-27B cousin post-trained to think in fewer tokens, for coding and agent work with images in, that fits a 24 GB machine with UkisAI's own 4-bit builds. Commercial use is free only below US$1M revenue. The main risks are that nobody at UkisAI answers its discussions, and that the shorter thinking rests on UkisAI's own benchmarks.

Qwen3-30B-A3B-Instruct-2507

1. Quickest start is ollama run qwen3:30b-instruct, 19 GB. Plain qwen3:30b and qwen3:30b-a3b are the Thinking-2507 edition, not this one
2. On our reference machine use BF16 with vllm serve Qwen/Qwen3-30B-A3B-Instruct-2507 --max-model-len 262144 --enable-auto-tool-choice --tool-call-parser hermes, 61 GB of weights fits the GPU share
3. Use the hermes parser in vLLM or qwen25 in SGLang, the template emits JSON inside tool_call tags
4. Don't pass enable_thinking, this edition never thinks and the card says the flag isn't needed
5. Sampling per the card is temperature 0.7, top_p 0.8, top_k 20 and min_p 0, with presence_penalty up to 2 against repetition
6. Leave config.json as it is unless you need more than 262,144 tokens, the 1M mode swaps in config_1m.json and runs one sequence at a time
7. Validate JSON yourself or use the runtime's guided decoding, since structured output isn't documented

Swift 1.5 Qwen3.8-27B

1. Quickest start is llama-server -hf ukisai/Swift-1.5-Qwen3.8-27B-GGUF:Q4_K_M --jinja, about 18.4 GB with the vision projector
2. On our reference machine BF16 fits, vllm serve ukisai/Swift-1.5-Qwen3.8-27b --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder
3. The template is Qwen3.8-27B's, so chat_template_kwargs with reasoning_effort low, medium or xhigh (default) and enable_thinking false work as on the base
4. UkisAI benchmarked it at temperature 1.0, top_p 0.95, top_k 20 and presence_penalty 0, which is a reasonable starting point
5. The MLX 4-bit build needs UkisAI's patched MLX-LM and has no image or video chat
6. Check the licence before commercial use, it stops at US$1M gross annual revenue including affiliates
7. MTP self-speculative decoding is available with the base's head, flags on the card