Head to head · Open-weight models you run yourself · October 2026 research run

GLM-4.7-Flash vs Nemotron 3 Super 120B A12B

Nemotron 3 Super 120B A12B scores 66.2 (B) on agent readiness against GLM-4.7-Flash's 63 (B), and leads in 3 of 5 scored categories. GLM-4.7-Flash leads on capability and reach. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 2870 open weights comparisons

Which one, for what

GLM-4.7-Flash B

Best for Agents and developers who want a small, permissively licensed tool-calling model on one 24 to 32 GB GPU or Mac, in almost any runtime

Ahead on

  • Capability, 59 against 54
  • Reach, 80 against 75

Watch for

No change to the files since 29 January 2026 and no zai-org reply on discussions since 31 January

Nemotron 3 Super 120B A12B B

Best for Agents on a 128 GB unified machine or Blackwell GPUs that want a long-context, tool-calling reasoning model with documented training data

Ahead on

  • Risk, 65 against 55
  • Agent interface, 90 against 85
  • Documentation and upkeep, 65 against 28

Watch for

The card's serving commands pass --trust-remote-code

Score by category

CategoryWeight this runGLM-4.7-FlashNemotron 3 Super 120B A12BEdge
Capability35%355954GLM-4.7-Flash +5
Reach25%258075GLM-4.7-Flash +5
Risk20%205565Nemotron 3 Super 120B A12B +10
Agent interface10%108590Nemotron 3 Super 120B A12B +5
Documentation and upkeep10%102865Nemotron 3 Super 120B A12B +37
Negative events≤1500
TotalB 63/100B 66.2/100

Facts side by side

FactGLM-4.7-FlashNemotron 3 Super 120B A12B
KindOpen-weight modelOpen-weight model
VendorZ.ai (Zhipu AI)NVIDIA
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceMITNVIDIA Nemotron Open Model License
Read-only variant documentednono
llms.txtnono
Last release2026-01-292026-03-11
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews2.8/5 (4)2.8/5 (4)

Verdicts

GLM-4.7-Flash

A small MIT-licensed mixture-of-experts model with about 3B active parameters, for local agent and coding work with several tool calls per turn and optional thinking. It runs in Ollama at about 23 GB and in nearly every common runtime. The main risk is neglect, with no changes or replies since early February and no safety results.

Nemotron 3 Super 120B A12B

A long-context agent cousin with trained parallel tool calls, a reasoning switch and a full account of its training data, under a free commercial licence. It needs about 100 GB of GPU memory, a 128 GB unified machine or Blackwell hardware for NVIDIA's NVFP4. The main risks are serving commands that run repository code and no published safety results.

Before you call either

GLM-4.7-Flash

  1. On our reference machine start it with vllm serve zai-org/GLM-4.7-Flash --max-model-len 65536 --tool-call-parser glm47 --reasoning-parser glm45 --enable-auto-tool-choice --served-model-name glm-4.7-flash
  2. Or run ollama run glm-4.7-flash for the 19 GB q4_K_M build
  3. Without the glm47 and glm45 parsers, tool calls and reasoning come back as plain text
  4. Use a released vLLM (0.32.0 or later) or SGLang (0.5.22 or later); the card's nightly and pull-request builds date from January 2026
  5. Pass chat_template_kwargs: {"enable_thinking": false} for short tasks, since thinking is on by default
  6. Set clear_thinking: false to keep earlier reasoning in multi-turn agent work, as Z.ai does for τ²-Bench and Terminal Bench
  7. Set the context length yourself, since config.json allows 202,752 tokens and tokenizer_config.json says 128,000

Nemotron 3 Super 120B A12B

  1. On the reference machine start it with ollama run nemotron-3-super, the 87 GB q4_K_M build, the only one that fits (about 104 GB with the margin)
  2. Raise the Strix Halo GPU memory limit first with amd-ttm --set 100, since the default of about 62.8 GiB is far below what it needs
  3. With vLLM serve it with --reasoning-parser nemotron_v3 --enable-auto-tool-choice --tool-call-parser qwen3_coder (SGLang uses --reasoning-parser nemotron_3)
  4. Use temperature=1.0 and top_p=0.95 for every task, as the card says
  5. Thinking is on by default. Pass enable_thinking: false or low_effort: true in chat_template_kwargs for short tasks
  6. For coding agents pass force_nonempty_content: true in chat_template_kwargs, so a cut-off reasoning trace still returns content
  7. Raise context past 262,144 only with the card's flags (VLLM_ALLOW_LONG_MAX_MODEL_LEN=1, --max-model-len 1048576)

Questions

Which is better for AI agents, GLM-4.7-Flash or Nemotron 3 Super 120B A12B?

Nemotron 3 Super 120B A12B scores 66.2 (B) on agent readiness against GLM-4.7-Flash's 63 (B), and leads in 3 of 5 scored categories. GLM-4.7-Flash leads on capability and reach.

Other comparisons with GLM-4.7-Flash or Nemotron 3 Super 120B A12B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.