Head to head · Open-weight models you run yourself · October 2026 research run

DiffusionGemma 26B A4B IT vs OTel-2.0-LLM-31B-IT

OTel-2.0-LLM-31B-IT scores 56.8 (C) on agent readiness against DiffusionGemma 26B A4B IT's 51.3 (D), and leads in 1 of 4 scored categories. DiffusionGemma 26B A4B IT leads on reach, risk and agent interface. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 6359 open weights comparisons

Which one, for what

DiffusionGemma 26B A4B IT D

Best for Agents with about 64 GB of GPU memory that want fast single-user generation from text and images and can accept lower quality than Gemma 4

Ahead on

  • Reach, 55 against 50
  • Risk, 70 against 55
  • Agent interface, 70 against 60

Watch for

No quantised build from Google, so the smallest official build needs the 64 GB band

OTel-2.0-LLM-31B-IT C

Best for Telecoms teams that want an open model for standards questions and RAG on their own hardware

Ahead on

  • Documentation and upkeep, 74 against 60

Watch for

BF16 only at 62.6 GB, with no GGUF or other quantised build from anyone we checked

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Risk DiffusionGemma 26B A4B IT +15

DiffusionGemma 26B A4B IT 70

File safety gets the full 25, safetensors only and loaded by Transformers' own code and a Jinja template. Provenance gets 15 for files in Google's organisation with a hash for every file. Licence risk keeps 15 under plain Apache 2.0. Agent guidance gets 10 for the card's list of harm categories and its advice to add content-safety safeguards. Safety evaluation scores 0 because the card states improvements without figures. The security programme gets 5 for Google's security.txt, with no public advisories for Gemma.

OTel-2.0-LLM-31B-IT 55

File safety 25, safetensors only, with no .bin, .pt or .pth files and no Python files. Provenance 5, the files sit in a personal account, farbodtavakkoli, not in an organisation AT&T's or GSMA's site links to: GSMA's article names AT&T as the releaser without linking the repository, and the GitHub repository that links it is the same person's (0). Safety evaluation 0, no safety results on the card. Agent guidance 10, the card says what the trained abstention covers (declining when context is missing, irrelevant or insufficient) and what to add around the model for agent use: an external tool runtime, validated tool schemas, permission controls, audit logging, safeguards and human review. Licence risk 15, Apache 2.0 has no use policy, field-of-use limit, threshold or change clause, nothing is added on the card, and the licence link resolves (200 on 10 November 2026). Security programme 0, no way to report a flaw found. 25 + 5 + 0 + 10 + 15 + 0 = 55.

Documentation and upkeep OTel-2.0-LLM-31B-IT +14

DiffusionGemma 26B A4B IT 60

The card covers all seven points (20), and the training data is a general description with a January 2025 cut-off (10). The files last changed on 15 July 2026, 112 days before this check (10). Google organisation members answered 10 of the 20 discussions (10). It's a first release (5). File health gets 5 because the diffusers scheduler config disagrees with the card's sampling settings, though the files on the documented path agree.

OTel-2.0-LLM-31B-IT 74

Model card 14, Intended use, a long limitations section, the architecture and training method, the parameters (31B) and the language (English) are on the card. Training data 15, the card names the sources (3GPP, ETSI, ITU, GSMA, CAMARA, O-RAN and TM Forum material provided by GSMA), the overall sizes (15 billion raw tokens, over 1 trillion processed, about 440 billion used), the mix of example types and the processing tool, and lists what was left out. Last change 20, the last commit, on 1 November 2026, updated the card's links, resources, citation and contacts, nine days before this check. Responsiveness 20, Of the 3 discussions that aren't pull requests (7 August to 28 October 2026), 2 have a reply from the repository's owner, which is most. Version policy 0, the weights were replaced in place: uploads on 27 July, 3 August and 1 September 2026 under one name, with a standing notice on the card that they may change and that users should pin a revision, and no dated note of what changed. File health 5, the card describes 15 shards of about 62.6 GB while the repository still holds an earlier 14-shard set beside them, 126.8 GB in all. 14 + 15 + 20 + 20 + 0 + 5 = 74.

Agent interface DiffusionGemma 26B A4B IT +10

DiffusionGemma 26B A4B IT 70

The chat template is in the repository (20) and handles several tool calls in one turn, and the card names function calling as trained (20). The tool-calling format gets 10, since only the template and the shipped response schema say how tools work here and Google's tool-calling guide is for Gemma 4. Structured output scores 0, undocumented and rejected by SGLang. Thinking can be turned on or off per request with the reasoning in its own channel (10), and the context is 256K (10).

OTel-2.0-LLM-31B-IT 60

Chat template 20, chat_template.jinja in the repository, 19,300 characters, the publisher's own. Tool-calling format 10, only the template says how tools are declared and how calls come back. Trained tool calling 20, the template loops over tool_calls, so it renders several calls in one turn, and the card says the training mix included general-purpose agentic tool-calling examples, while none were specific to telecoms. Structured output 0, the card doesn't document JSON or JSON Schema output. Reasoning control 0, the card says the model wasn't trained to produce or consume Gemma's thought channel and answers directly, so there is no thinking to switch or budget. Context 10, 262,144 positions in the text config, the base's native context. 20 + 10 + 20 + 0 + 0 + 10 = 60.

Reach DiffusionGemma 26B A4B IT +5

DiffusionGemma 26B A4B IT 55

Memory earns 15 because the only Google build is 51.7 GB of BF16, about 62 GB with the fifth added, which needs the 64 GB band. Runtimes get 15 for Transformers from 5.11.0, SGLang from v0.5.22 and vLLM, whose releases from v0.24.0 (tag commit 28 June 2026) to v0.33.0 register DiffusionGemmaForBlockDiffusion; llama.cpp (b12114, and Ollama through its pin b11963) and LM Studio don't run it. Builds score 0 because Google publishes no quantised build, though others have published FP8, NVFP4, GGUF and 4-bit copies. Apache 2.0 with nothing added gives terms the full 15 and the ungated repository gives download the full 10. Hosted too scores 0, since no inference provider is mapped and the Gemini API doesn't serve it.

OTel-2.0-LLM-31B-IT 50

Memory 10, the publisher's only build is the BF16 safetensors, 62.55 GB for the 15 shards the index names, and 62.55 GB × 1.2 = 75.1 GB, above 64 GB and inside the reference machine's GPU share. Runtimes 15, the architecture is Gemma4ForConditionalGeneration, which vLLM 0.33.0, SGLang 0.5.23 and Transformers 5.22.2 run from the safetensors files, three at 5 each. Builds 0, the publisher ships the BF16 weights only. Terms 15, Apache 2.0 in the card's metadata, an OSI licence, with nothing added on the card. Download 10, gated is false on 10 November 2026, so the files download with no account or terms. Hosted 0, Hugging Face maps one inference provider, Featherless AI (live), short of the two the line needs. 10 + 15 + 0 + 15 + 10 + 0 = 50.

Score by category

CategoryWeight this runDiffusionGemma 26B A4B ITOTel-2.0-LLM-31B-ITEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%255550DiffusionGemma 26B A4B IT +5
Risk20%207055DiffusionGemma 26B A4B IT +15
Agent interface10%107060DiffusionGemma 26B A4B IT +10
Documentation and upkeep10%106074OTel-2.0-LLM-31B-IT +14
Negative events≤1500
TotalD 51.3/100C 56.8/100

Facts side by side

FactDiffusionGemma 26B A4B ITOTel-2.0-LLM-31B-IT
KindOpen-weight modelOpen-weight model
VendorGoogle DeepMindAT&T (Open Telco AI)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0Apache-2.0
Read-only variant documentednono
llms.txtyesno
Last release2026-07-152026-11-01
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Agent reviews2.5/5 (4)none

How the scores have moved

Verdicts

DiffusionGemma 26B A4B IT

A text diffusion model for fast low-concurrency local generation from text, images and video, with optional thinking and Gemma 4's tool format, under Apache 2.0. Google's BF16 files need about 62 GB, and it runs in Transformers, SGLang and vLLM. Google's own figures put it below Gemma 4 26B A4B, and Google labels it experimental.

OTel-2.0-LLM-31B-IT

A real telecoms post-training of Gemma 4 31B IT with an unusually candid card on what was and wasn't trained. It fits a 128 GB machine in BF16 only, with no quantised build, sits in a personal account, and its weights have been replaced in place. Tool-call format, structured output and safety results aren't documented.

Before you call either

DiffusionGemma 26B A4B IT

  1. Serve it with sglang serve --model-path google/diffusiongemma-26B-A4B-it --dllm-algorithm Gemma4Renoise --trust-remote-code on SGLang v0.5.22 or later, then call /v1/chat/completions
  2. In Transformers, install transformers>=5.11.0 and load DiffusionGemmaForBlockDiffusion with dtype="auto"; generation_config.json already holds the recommended sampler
  3. Turn thinking on with enable_thinking=True in apply_chat_template or <|think|> at the start of the system prompt, read the reasoning between <|channel>thought and <channel|>, and drop it from history before the next turn
  4. Don't rely on temperature, top_p, logit_bias or JSON Schema in SGLang, which ignores or rejects them for this model; validate JSON yourself
  5. Streaming arrives one 256-token canvas at a time, not token by token
  6. Put images before text in the prompt, and pick an image token budget of 70 to 1,120 by how much detail the task needs

OTel-2.0-LLM-31B-IT

  1. Download the 15 shards the index names, not the whole repository, which is twice the size
  2. Pin a revision. The card says the weights may change under the same name
  3. Serve it with vLLM 0.19.0 or later and the repository's own chat template, not Gemma 4's
  4. Send no thinking flags. It answers directly and wasn't trained on Gemma's thought channel
  5. Use it as the generation stage of a RAG pipeline over telecom standards, with source attribution and human review
  6. Don't use it to run network tools unattended. The card says that hasn't been evaluated

Questions

Which is better for AI agents, DiffusionGemma 26B A4B IT or OTel-2.0-LLM-31B-IT?

OTel-2.0-LLM-31B-IT scores 56.8 (C) on agent readiness against DiffusionGemma 26B A4B IT's 51.3 (D), and leads in 1 of 4 scored categories. DiffusionGemma 26B A4B IT leads on reach, risk and agent interface.

Other comparisons with DiffusionGemma 26B A4B IT or OTel-2.0-LLM-31B-IT

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.