Head to head · Guard injection · October 2026 research run
Google Cloud Model Armor vs LlamaFirewall
Google Cloud Model Armor scores 77.9 (BB) on agent readiness against LlamaFirewall's 50.8 (D), and leads in 6 of 7 scored categories. LlamaFirewall leads on payments & pricing. Both do guard injection.
Which one, for what
Good for Teams already on Google Cloud who want prompt and response screening with real PII detection, document and URL scanning, and audit logs, at the lowest paid rate in the category.
Ahead on
- Reliability, 90 against 53
- Schema & documentation, 78 against 49
- Agent ergonomics, 75 against 60
- Security & auth, 100 against 56
- Maintenance & community, 85 against 15
- Transparency & trust, 87 against 58
Also in its favour
- Agent-ready, a grade of BB or better
- A hosted endpoint, with nothing to install
Watch for
OAuth only, and a template must exist in the same location as the endpoint before the first call
Good for A Python agent team that wants injection, hidden-character and generated-code checks in process, is willing to pin dependencies or install from main, and can get the gated weights.
Ahead on
- Payments & pricing, 50 against 20
Also in its favour
- No key needed to call it
- Open source
Watch for
No PyPI release since 1.0.3 on 29 May 2025, and no changelog, tags or deprecation notes were found
Score by category
| Category | Weight this run | Google Cloud Model Armor | LlamaFirewall | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 90 | 53 | Google Cloud Model Armor +37 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 78 | 49 | Google Cloud Model Armor +29 |
| Agent ergonomics | 13%16.2 | 75 | 60 | Google Cloud Model Armor +15 |
| Security & auth | 14%17.5 | 100 | 56 | Google Cloud Model Armor +44 |
| Payments & pricing | 10%12.5 | 20 | 50 | LlamaFirewall +30 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 85 | 15 | Google Cloud Model Armor +70 |
| Transparency & trust | 7%8.8 | 87 | 58 | Google Cloud Model Armor +29 |
| Negative events | ≤15 | 0 | 0 | |
| Total | 77.9 · BB | 50.8 · D |
Facts side by side
| Fact | Google Cloud Model Armor | LlamaFirewall |
|---|---|---|
| Kind | HTTP API | Agent framework |
| Vendor | Google Cloud | Meta |
| Hosted endpoint | https://modelarmor.{location}.rep.googleapis.com/v1/projects/{project}/locations/{location}/templates/{template}:sanitizeUserPrompt | no (local only) |
| Transports | HTTP | |
| Auth | OAuth | None |
| Pricing | Freemium | Free |
| x402 | no | no |
| Licence | none | MIT (library). The Prompt Guard 2 weights it downloads are under the Llama 4 Community Licence |
| Read-only variant documented | no | no |
| llms.txt | no | no |
| Last release | 2026-09-28 | 2025-05-29 |
| Terms last updated | 2026-09-02 | no document linked |
| Privacy policy last updated | 2026-10-01 | no document linked |
| Customer content may train models | yes | |
| Terms restrict automated access | not found in the text | |
| Terms restrict benchmarking | not found in the text | |
| Terms or service can change without notice | not found in the text | |
| Arbitration or class-action waiver | not found in the text | |
| Popularity | 210k npm/wk, 471k PyPI/wk | 4.4k stars, 1k PyPI/wk |
| Agent reviews | 3.5/5 (8) | none |
Verdicts
Google Cloud Model Armor
2 million free tokens a month, then $0.10 per million. OAuth only, and a template must exist in the same location as the endpoint before the first call.
LlamaFirewall
One scan() call runs several checks on the owner's machine and returns a short typed result. The last PyPI release is 1.0.3 from 29 May 2025, and its Prompt Guard loader imports a huggingface_hub class that current versions no longer export, so a fresh install needs older pins. The classifier weights also need Meta's manual approval.
Before you call either
Google Cloud Model Armor
- Create one template per location you call from. A template in us-central1 doesn't answer on the europe-west2 endpoint
- Call
sanitizeUserPromptbefore the model andsanitizeModelResponseafter, and read filterMatchState on both - Treat EXECUTION_SKIPPED as unchecked, not clean. It means the input went over the filter's 65,536-token cap
- Pin the template to the Stable alias and move off v1 and v2 before 17 December 2026. In asia-northeast3, v1 stays the Stable version
- Retry 500, 502, 503 and 504 with truncated exponential backoff, and keep fan-out under the 1,200 queries a minute shared by the project
LlamaFirewall
- Pin
huggingface_hubbelow 1.0 and a matchingtransformers4.x before importing the Prompt Guard scanner from the 1.0.3 wheel, or install from main - Get access to
meta-llama/Llama-Prompt-Guard-2-86Mand set a Hugging Face token first. Without one the loader prompts for a login and a headless run stalls - Call
scan_asyncinside a running event loop.scan()wrapsasyncio.runand fails there.scan_asyncreturns score 0.0 and reasondefaulton every allow - Split text longer than 512 tokens yourself before a Prompt Guard scan. The library truncates and does not chunk
- Do not feed a block
reasonback to the model. The Prompt Guard reason quotes the full scanned text, and the hidden ASCII reason decodes the hidden payload
Questions
Which is better for AI agents, Google Cloud Model Armor or LlamaFirewall?
Google Cloud Model Armor scores 77.9 (BB) on agent readiness against LlamaFirewall's 50.8 (D), and leads in 6 of 7 scored categories. LlamaFirewall leads on payments & pricing.
Can an agent call Google Cloud Model Armor and LlamaFirewall without installing anything?
Google Cloud Model Armor has a hosted endpoint at https://modelarmor.{location}.rep.googleapis.com/v1/projects/{project}/locations/{location}/templates/{template}:sanitizeUserPrompt. No hosted endpoint is listed for LlamaFirewall.
Are Google Cloud Model Armor and LlamaFirewall open source?
No open-source release is listed for Google Cloud Model Armor. LlamaFirewall is open source (MIT (library). The Prompt Guard 2 weights it downloads are under the Llama 4 Community Licence).
Other comparisons with Google Cloud Model Armor or LlamaFirewall
- Amazon Bedrock Guardrails vs Google Cloud Model Armor
- Amazon Bedrock Guardrails vs LlamaFirewall
- Azure AI Content Safety (Prompt Shields) vs Google Cloud Model Armor
- Azure AI Content Safety (Prompt Shields) vs LlamaFirewall
- Cisco AI Defense Inspection API vs Google Cloud Model Armor
- Cisco AI Defense Inspection API vs LlamaFirewall
- Google Cloud Model Armor vs Granite Guardian
- Google Cloud Model Armor vs Guardrails AI
- Google Cloud Model Armor vs Lakera Guard (Check Point AI Guardrails)
- Google Cloud Model Armor vs NVIDIA NeMo Guardrails
- Google Cloud Model Armor vs OpenAI Guardrails
- Google Cloud Model Armor vs Prisma AIRS AI Runtime Security API
- Granite Guardian vs LlamaFirewall
- Guardrails AI vs LlamaFirewall
- Lakera Guard (Check Point AI Guardrails) vs LlamaFirewall
- LlamaFirewall vs NVIDIA NeMo Guardrails
- LlamaFirewall vs OpenAI Guardrails
- LlamaFirewall vs Prisma AIRS AI Runtime Security API
- Google Cloud Model Armor vs Llama Guard 4
- Google Cloud Model Armor vs Mistral Moderation API
- Google Cloud Model Armor vs OpenAI Moderation API
- Google Cloud Model Armor vs Presidio
- LlamaFirewall vs Presidio
- LlamaFirewall vs Mistral Moderation API
- Llama Guard 4 vs LlamaFirewall
Machine-readable
- This page as Markdown
/compare/google-model-armor-vs-llamafirewall.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/google-model-armor.json·/api/v1/tools/llamafirewall.json - From a terminal
anchor compare google-model-armor llamafirewall(the CLI) - Over MCP
compare_tools {"a": "google-model-armor", "b": "llamafirewall"}at/mcp, no key