Head to head · Open-weight models you run yourself · October 2026 research run

Kimi K3.1 Pro vs Qwen3.8-27B

Qwen3.8-27B scores 68.6 (B) on agent readiness against Kimi K3.1 Pro's 48.6 (D), and leads in 3 of 4 scored categories. Kimi K3.1 Pro leads on documentation and upkeep. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 6359 open weights comparisons

Which one, for what

Kimi K3.1 Pro D

Best for Operators with a multi-accelerator node who want Moonshot's newest open-weight model for coding and long agent sessions, and everyone else through an API

Ahead on

  • Documentation and upkeep, 51 against 36

Watch for

1,561 GB of files, so it needs a node of eight large accelerators at least

Qwen3.8-27B B

Best for Agents that want a capable open model with vision on one 24 to 32 GB GPU or Mac, with the widest runtime support and a plain licence.

Ahead on

  • Reach, 90 against 40
  • Risk, 55 against 50
  • Agent interface, 70 against 65

Watch for

No safety results, prompt-injection guidance or security contact

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reach Qwen3.8-27B +50

Kimi K3.1 Pro 40

Memory 0, the only build is Moonshot's 1,561 GB MXFP4 release, far above 256 GB. Runtimes 5, llama.cpp b12242 alone has the model code in a release, since vLLM's recipe needs 0.34.0 and SGLang's cookbook a branch. Builds 10, one precision. Terms 10, free commercial use below a model-as-a-service revenue threshold. Download 10, not gated. Hosted 5, Moonshot's API and Together serve it. 0 + 5 + 10 + 10 + 10 + 5 = 40.

Qwen3.8-27B 90

Memory 25 of 30, Ollama's smallest 4-bit build is 18 GB, or 21.6 GB with a fifth added, which fits 24 GB. Runtimes 25, released versions of llama.cpp, Ollama, vLLM, SGLang and Transformers all run the qwen3_5 architecture. Builds 10 of 15, Alibaba's only quantised build is FP8. Terms 15, Apache 2.0 with nothing added. Download 10, neither repository is gated. Hosted 5, seven inference providers are live for it on Hugging Face on 1 November, though Qwen Cloud's own version is still described as coming soon.

Documentation and upkeep Kimi K3.1 Pro +15

Kimi K3.1 Pro 51

Model card 11, no limitations, languages or cut-off. Training data 5, one general sentence. Last change 20, a commit on 5 November 2026. Responsiveness 0, none of the 8 newest discussions has a reply from Moonshot. Version policy 5, Kimi K3 keeps its repository and no dated note was found. File health 10, the files agree. 11 + 5 + 20 + 0 + 5 + 10 = 51.

Qwen3.8-27B 36

Model card 11 of 20, intended use, architecture, parameters and context are there, but limitations, languages and a knowledge cut-off aren't. Training data 0, not described. Last change 15, the files last changed on 14 August 2026, 79 days before this check, and Qwen's GitHub repository for the model holds only a README and licence, so no reference code of Alibaba's changed later. Responsiveness 0, Qwen answered none of the 40 most recent questions and reports, recounted on 1 November. Version policy 5, earlier 27B models stay in their own repositories without dated notes. File health 5, the files agree with the card but reports about the template and structured output wait without a reply.

Risk Qwen3.8-27B +5

Kimi K3.1 Pro 50

File safety 15, safetensors only, less 10 for remote code and prompts built by the repository's script. Provenance 15, Moonshot's own organisation with a hash on every file. Safety evaluation 10, Moonshot's own cyber benchmark results and nobody else's yet. Agent guidance 0, none on the card. Licence risk 10, the revenue threshold. Security programme 0, no way to report a flaw found. 15 + 15 + 10 + 0 + 10 + 0 = 50.

Qwen3.8-27B 55

File safety 25, safetensors only and nothing from the repository runs to load it or build prompts. Provenance 15, the files are in the Qwen organisation that Qwen's GitHub links to, and every file has a checksum. Safety evaluation 0, none published. Agent guidance 0, nothing on prompt injection, refusals or safeguards. Licence risk 15, plain Apache 2.0 that hasn't changed. Security programme 0, no security.txt, disclosure policy or security contact for Qwen was found, and Alibaba's group security centre couldn't be checked, so it's scored as absent.

Agent interface Qwen3.8-27B +5

Kimi K3.1 Pro 65

Chat template 10, the format is only code to run. Tool-calling format 10, the parser is named in the runtimes' recipes and the card doesn't say how tools are declared. Trained tool calling 20, several calls a turn on Kimi K3's tools channel. Structured output 5, named among linked guides without the how. Reasoning control 10, reasoning_effort per request. Context 10, 1M tokens. 10 + 10 + 20 + 5 + 10 + 10 = 65.

Qwen3.8-27B 70

Chat template 20, a Jinja file in the repository. Tool-calling format 10 of 25, the format lives only in the template and the parser name only in serving commands, Alibaba doesn't describe how tools are declared or returned. Trained tool calling 20, the template renders several calls in one turn. Structured output 0, not documented. Reasoning control 10, thinking turns off per request, reasoning_effort budgets it and the card shows the reasoning coming back in reasoning_content. Context 10, 262,144 tokens native.

Score by category

CategoryWeight this runKimi K3.1 ProQwen3.8-27BEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%254090Qwen3.8-27B +50
Risk20%205055Qwen3.8-27B +5
Agent interface10%106570Qwen3.8-27B +5
Documentation and upkeep10%105136Kimi K3.1 Pro +15
Negative events≤1500
TotalD 48.6/100B 68.6/100

Facts side by side

FactKimi K3.1 ProQwen3.8-27B
KindOpen-weight modelOpen-weight model
VendorMoonshot AIAlibaba (Qwen team)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceKimi K3.1 Pro License (modified MIT)Apache-2.0
Read-only variant documentednono
llms.txtnono
Last release2026-11-052026-08-14
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Agent reviewsnone3/5 (4)

How the scores have moved

Verdicts

Kimi K3.1 Pro

Moonshot's newest flagship, eight days old when read, for operators with a rack. Only llama.cpp has its model code in a release, with vLLM and SGLang support still on a release candidate and a branch. The licence is permissive below a revenue threshold, and Moonshot hasn't answered a discussion on the repository yet.

Qwen3.8-27B

A dense cousin for coding and agent work with image and video input that runs almost anywhere. Ollama's 4-bit build needs about 22 GB, and seven providers host it for agents without the hardware. The main risk is that nobody at Alibaba answers, there are no safety results or agent guidance, and the tool format is only in the template.

Before you call either

Kimi K3.1 Pro

  1. Use Moonshot's API or Together unless you have a node of eight B300-class accelerators
  2. With vLLM use 0.34.0 or later and the recipe's flags, --tool-call-parser kimi_k3 --reasoning-parser kimi_k3
  3. Pass the whole assistant message back in later turns, reasoning_content and tool_calls included, as the card requires
  4. Set reasoning_effort to low, high or max per request. Max is the default and thinking can't be turned off
  5. Kimi K3's model code doesn't load it, because the attention layers changed
  6. Validate JSON output yourself, since the card doesn't document structured output for the weights

Qwen3.8-27B

  1. Quickest start is ollama run qwen3.8, about 18 GB of files
  2. On our reference machine use BF16 with vllm serve Qwen/Qwen3.8-27B --max-model-len 131072 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, since FP8 on gfx1151 isn't documented
  3. Use the qwen3_coder tool parser, SGLang's cookbook says the Hermes parser leaves its calls unparsed
  4. Thinking is on by default, pass chat_template_kwargs with enable_thinking false for short tasks, and read the reasoning from reasoning_content
  5. reasoning_effort takes xhigh (default), medium or low, and any other value makes the template raise an error
  6. Sampling per the card is temperature 1.0 and top_p 0.95 when thinking, temperature 0.7, top_p 0.8 and presence_penalty 1.5 without
  7. Preserved thinking keeps earlier reasoning in the context unless preserve_thinking is false, which grows long agent sessions
  8. Turn on YaRN only beyond 262,144 tokens, the card warns static YaRN can cost quality on short texts
  9. Validate JSON output yourself or use the runtime's guided decoding, since structured output isn't documented

Questions

Which is better for AI agents, Kimi K3.1 Pro or Qwen3.8-27B?

Qwen3.8-27B scores 68.6 (B) on agent readiness against Kimi K3.1 Pro's 48.6 (D), and leads in 3 of 4 scored categories. Kimi K3.1 Pro leads on documentation and upkeep.

Other comparisons with Kimi K3.1 Pro or Qwen3.8-27B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.