gpt-oss-20b vs Swift 1.5 Qwen3.8-Flash-Next

gpt-oss-20b

gpt-oss-20b is a cousin for reasoning, coding and single tool calls with structured output, under plain Apache 2.0. It needs about 17 GB with a working context, and five inference providers serve it. The main risks are that it trails o4-mini at keeping system instructions above user ones, and OpenAI hasn't answered a report since August 2025.

Swift 1.5 Qwen3.8-Flash-Next

A large mixture-of-experts cousin, Qwen3.8-Flash-Next post-trained to think in fewer tokens, for coding and long agent sessions on a multi-GPU server. Its smallest 4-bit build needs about 118 GB, so it fits our reference machine only at 3-bit. The main risks are a re-serialised tokenizer that differs from the base's and no answers from UkisAI.

gpt-oss-20b

1. Start it with ollama run gpt-oss:20b (the build that fits the reference machine), or vllm serve openai/gpt-oss-20b with a current vLLM release rather than the card's pinned vllm==0.10.1+gptoss wheel
2. Use the harmony format through the chat template or openai-harmony; OpenAI says the model doesn't work correctly without it
3. Parse tool calls and reasoning with openai-harmony; calls come on the commentary channel ending in <|call|>, reasoning on the analysis channel
4. Set effort with Reasoning: high (or low, medium) in the system message, or reasoning_effort in the template; medium is the default
5. Ask for JSON by putting a JSON Schema under # Response Formats in the developer message
6. Drop earlier reasoning after a final answer but pass it back after tool calls, and don't show the analysis channel to users
7. Expect one tool call per turn; run several in sequence rather than in parallel

Swift 1.5 Qwen3.8-Flash-Next

1. On a multi-GPU node use vllm serve ukisai/Swift1.5-Qwen3.8-Flash-Next --tensor-parallel-size 8 --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, the parser the base's recipes and the card's SGLang command use
2. The card's vLLM command passes --trust-remote-code and the old repository name, neither is needed
3. On our reference machine only UkisAI's GSQ-RCO IQ3_S GGUF (84.7 GB with the projector) fits, below 4-bit
4. Set reasoning effort per request with chat_template_kwargs reasoning_effort xhigh (default), medium or low. UkisAI's own runs lose about 2.5 points at medium and low
5. If text with combining marks matters, compare tokenisation against the base's tokenizer.json before trusting outputs
6. Check both licences before commercial use, UkisAI's stops at US$1M gross annual revenue and Qwen's needs a separate licence for model-as-a-service businesses