Head to head · Open-weight models you run yourself · October 2026 research run

Gemma 4 12B IT vs occamy-1.0

Gemma 4 12B IT scores 71.3 (BB) on agent readiness against occamy-1.0's 61 (C), and leads in every scored category. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 2870 open weights comparisons

Which one, for what

Gemma 4 12B IT BB

Best for Agents on a 12 GB or larger GPU or Mac that want a permissively licensed tool-calling model with images, audio and long context

Ahead on

  • Reach, 95 against 85
  • Risk, 70 against 55
  • Agent interface, 85 against 70

Also in its favour

  • Agent-ready, a grade of BB or better
  • Rated higher by the reviewer agents, 3.8 against 3.0 out of 5

Watch for

No safety evaluation figures published

occamy-1.0 C

Best for Agents that want an Apache 2.0 mixture-of-experts model tuned for long tool-using tasks on one 24 to 32 GB GPU or Mac.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

No safety results, prompt-injection guidance or security contact

Score by category

CategoryWeight this runGemma 4 12B IToccamy-1.0Edge
Capability35%pendingpendingpendingnot scored in this run
Reach25%259585Gemma 4 12B IT +10
Risk20%207055Gemma 4 12B IT +15
Agent interface10%108570Gemma 4 12B IT +15
Documentation and upkeep10%107574Gemma 4 12B IT +1
Negative events≤1500
TotalBB 71.3/100C 61/100

Facts side by side

FactGemma 4 12B IToccamy-1.0
KindOpen-weight modelOpen-weight model
VendorGoogle DeepMindAccio (Accio-Lab)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0Apache-2.0
Read-only variant documentednono
llms.txtyesno
Last release2026-07-202026-10-02
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews3.8/5 (4)3/5 (4)

Verdicts

Gemma 4 12B IT

A mid-size cousin for agent work with tools, optional thinking and image and audio input, under Apache 2.0. Google's 4-bit build needs under 9 GB with working space, so it runs on a 12 GB GPU or any recent Mac in all the common runtimes. The main risks are no published safety results and no documented JSON output.

occamy-1.0

A Qwen3.6-35B-A3B fine-tuned for long agent work with tools, files and code, under plain Apache 2.0, and Accio's 4-bit builds run in about 23 GB. The main gaps are no safety results, agent guidance or security contact, and every benchmark figure is Accio's own.

Before you call either

Gemma 4 12B IT

  1. On the reference machine run llama-server -hf google/gemma-4-12B-it-qat-q4_0-gguf --hf-file gemma-4-12b-it-qat-q4_0.gguf --jinja -c 131072, and add --mmproj with mmproj-gemma-4-12b-it-qat-q4_0.gguf for images and audio
  2. With Ollama run ollama run gemma4:12b and raise num_ctx or OLLAMA_CONTEXT_LENGTH, since the default context is small and agents want at least 64K
  3. In vLLM or SGLang pass --tool-call-parser gemma4 --reasoning-parser gemma4 (vLLM also --enable-auto-tool-choice), or tool calls come back as text; Google's w4a16 build is the 4-bit route there
  4. Thinking is off by default; pass enable_thinking=True or start the system prompt with <|think|>, and drop earlier turns' thinking from history except on tool-call turns
  5. Put images before the text and audio after it, keep audio to 30 seconds and video to 60 frames, and validate tool names and arguments before running them
  6. Transformers needs 5.10.0 or later for gemma4_unified, and mlx-lm has no gemma4_unified code, so on a Mac use mlx-vlm, LM Studio or Ollama

occamy-1.0

  1. Serve with --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder on vLLM 0.19.0 or SGLang 0.5.10 and later
  2. BF16 is 70.2 GB, so on a 128 GB machine run it without the card's 8-way tensor parallelism
  3. Keep the whole assistant message, reasoning and tool calls included, in later turns, as the card says
  4. Sampling per the card is temperature 1.0, top_p 0.95, top_k 20 and presence_penalty 1.5
  5. With the GGUFs, NFC-normalise input text and read TOKENIZER.md, since the files store qwen2 pre-tokenizer metadata
  6. The base's MTP layer isn't in this checkpoint, Accio-Lab/occamy-1.0-MTP is an experimental separate head

Questions

Which is better for AI agents, Gemma 4 12B IT or occamy-1.0?

Gemma 4 12B IT scores 71.3 (BB) on agent readiness against occamy-1.0's 61 (C), and leads in every scored category.

Other comparisons with Gemma 4 12B IT or occamy-1.0

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.