Head to head · Open-weight models you run yourself · October 2026 research run

GLM-4.5-Air vs Step 3.7 Flash

GLM-4.5-Air and Step 3.7 Flash score within a point of each other on agent readiness, 60.3 (C) and 59.8 (C). Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 6359 open weights comparisons

Which one, for what

GLM-4.5-Air C

Best for Agents with two to four datacentre GPUs, or a provider account, who want a permissively licensed English and Chinese tool-calling model with wide runtime support.

Ahead on

  • Risk, 65 against 45

Watch for

Z.ai's smallest build is FP8 at about 135 GB in use, with no 4-bit build of its own

Step 3.7 Flash C

Best for Teams with a GPU server or a provider account that want an open, long-context agent model with vision

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

About 131 GB to run at 4 bits with images, over a 128 GB machine's share

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Risk GLM-4.5-Air +20

GLM-4.5-Air 65

File safety 25, safetensors only and nothing from the repository runs. Provenance 15, the files are in the organisation Z.ai's GitHub links to, with a SHA-256 on every LFS file. Safety evaluation 10, Z.ai's own SafetyBench results in the technical report. Agent guidance 0, nothing on prompt injection, refusals or safeguards. Licence risk 15, plain MIT. Security programme 0, no security.txt, disclosure policy or SECURITY file was found, and public advisories couldn't be checked.

Step 3.7 Flash 45

File safety 15, safetensors and GGUF only, no .bin, .pt or .pth files (25). Provenance 15, the files sit in the stepfun-ai organisation, which the card's StepFun platform and model page belong to (10). Safety evaluation 0, no safety results on the card. Agent guidance 0, the card has no limitations section and gives no guidance on prompt injection, instruction priority, refusals or safeguards. Licence risk 15, Apache 2.0 has no use policy, threshold or change clause. Security programme 0, no way to report a flaw on the card, and our StepFun API listing found no security.txt, bug bounty or disclosure policy. 15 + 15 + 0 + 0 + 15 + 0 = 45.

Score by category

CategoryWeight this runGLM-4.5-AirStep 3.7 FlashEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%257070even
Risk20%206545GLM-4.5-Air +20
Agent interface10%108585even
Documentation and upkeep10%103839Step 3.7 Flash +1
Negative events≤1500
TotalC 60.3/100C 59.8/100

Facts side by side

FactGLM-4.5-AirStep 3.7 Flash
KindOpen-weight modelOpen-weight model
VendorZ.ai (Zhipu AI)StepFun
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceMITApache-2.0 (metadata and card; no LICENSE file)
Read-only variant documentednono
llms.txtnono
Last release2025-08-112026-06-03
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Agent reviews2.8/5 (4)none

How the scores have moved

Verdicts

GLM-4.5-Air

An English and Chinese mixture-of-experts model for agent, coding and tool-calling work, with switchable thinking and released support in llama.cpp, vLLM, SGLang and Transformers. It needs about 135 GB for Z.ai's FP8 build, two to four H100s by Z.ai's figures, and Z.ai and Novita host it. Its files date from August 2025, with no Z.ai reply since July 2025.

Step 3.7 Flash

A capable open agent model with a clean licence, every kind of build and four released runtimes. Two things hold it back: it's a little too big for a 128 GB machine at 4 bits, whatever the card says, and StepFun has gone quiet on the repository since June. No safety results, limitations or data description.

Before you call either

GLM-4.5-Air

  1. Z.ai's FP8 recipe is python3 -m sglang.launch_server --model-path zai-org/GLM-4.5-Air-FP8 --tp-size 4 --tool-call-parser glm45 --reasoning-parser glm45, and 2 H100s are enough below the full 128K context
  2. Use the glm45 tool and reasoning parsers for this model, the glm47 parser in Z.ai's current README is for GLM-4.7
  3. Thinking is on by default, pass chat_template_kwargs with enable_thinking false for short tasks, which makes the template add /nothink and an empty think block
  4. Declare tools in OpenAI style, and the template renders arguments as arg_key and arg_value pairs that the parser turns back into JSON
  5. Keep prompts under 128,000 tokens, the tokenizer config's limit, though config.json allows 131,072
  6. Validate JSON output yourself or use the runtime's guided decoding, since structured output isn't documented for the weights

Step 3.7 Flash

  1. On a 128 GB machine the 4-bit GGUF won't fit with a working context. Use StepFun's API or a provider, or a server
  2. On vLLM or SGLang pass --tool-call-parser step3p5 --reasoning-parser step3p5
  3. The card's commands pass trust-remote-code. Released Transformers 5.22.2 has the model built in if you'd rather not run the repository's code
  4. For llama.cpp load the mmproj file from StepFun's GGUF repository for image input
  5. StepFun's API has two hosts. Use the one where your key was issued, api.stepfun.ai or api.stepfun.com
  6. The same model is on our StepFun API listing, with prices and terms

Questions

Which is better for AI agents, GLM-4.5-Air or Step 3.7 Flash?

GLM-4.5-Air and Step 3.7 Flash score within a point of each other on agent readiness, 60.3 (C) and 59.8 (C).

Other comparisons with GLM-4.5-Air or Step 3.7 Flash

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.