# LlamaFirewall vs Mistral Moderation API

> Mistral Moderation API scores 58.4 (C) on agent readiness against LlamaFirewall's 50.8 (D), and leads in 4 of 7 scored categories. LlamaFirewall leads on reliability and payments & pricing. Both do guard pii. Category scores, facts, verdicts and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/llamafirewall-vs-mistral-moderation
- Markdown: https://www.anchorterminal.com/compare/llamafirewall-vs-mistral-moderation.md (~2,750 tokens)
- Slim: https://www.anchorterminal.com/compare/llamafirewall-vs-mistral-moderation.min.md (~730 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/compare/llamafirewall-vs-mistral-moderation.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (full text: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- Updated: 2026-10-09

Mistral Moderation API scores 58.4 (C) on agent readiness against LlamaFirewall's 50.8 (D), and leads in 4 of 7 scored categories. LlamaFirewall leads on reliability and payments & pricing. Both do guard pii.

- LlamaFirewall: grade D, 50.8/100, rank #682 of 842. Markdown https://www.anchorterminal.com/tools/llamafirewall.md · JSON https://www.anchorterminal.com/api/v1/tools/llamafirewall.json
- Mistral Moderation API: grade C, 58.4/100, rank #522 of 842. Markdown https://www.anchorterminal.com/tools/mistral-moderation.md · JSON https://www.anchorterminal.com/api/v1/tools/mistral-moderation.json

## Which one, for what

### LlamaFirewall (D)

Good for: A Python agent team that wants injection, hidden-character and generated-code checks in process, is willing to pin dependencies or install from main, and can get the gated weights.

Ahead on:
- Reliability, 53 against 40
- Payments & pricing, 50 against 40

Also in its favour:
- No key needed to call it
- Open source

Watch for: No PyPI release since 1.0.3 on 29 May 2025, and no changelog, tags or deprecation notes were found

### Mistral Moderation API (C)

Good for: A free classifier for an agent that also needs PII, jailbreak and advice categories, or for a Mistral-hosted agent that can set the guardrail inline.

Ahead on:
- Schema & documentation, 85 against 49
- Agent ergonomics, 75 against 60
- Maintenance & community, 33 against 15
- Transparency & trust, 81 against 58

Also in its favour:
- A hosted endpoint, with nothing to install

Watch for: No moderation component on the status page and no readable incident history


## Score by category

| Category | Weight | LlamaFirewall | Mistral Moderation API | Edge |
| --- | --- | --- | --- | --- |
| Reliability | 16% (20 this run) | 53 | 40 | LlamaFirewall +13 |
| Performance | 10%, pending | pending | pending | not scored in this run |
| Schema & documentation | 13% (16.2 this run) | 49 | 85 | Mistral Moderation API +36 |
| Agent ergonomics | 13% (16.2 this run) | 60 | 75 | Mistral Moderation API +15 |
| Security & auth | 14% (17.5 this run) | 56 | 54 | LlamaFirewall +2 |
| Payments & pricing | 10% (12.5 this run) | 50 | 40 | LlamaFirewall +10 |
| Task success | 10%, pending | pending | pending | not scored in this run |
| Maintenance & community | 7% (8.8 this run) | 15 | 33 | Mistral Moderation API +18 |
| Transparency & trust | 7% (8.8 this run) | 58 | 81 | Mistral Moderation API +23 |
| Negative events | ≤15 | 0 | 0 | |
| **Total** | | **50.8 · D** | **58.4 · C** | |

## Facts side by side

| Fact | LlamaFirewall | Mistral Moderation API |
| --- | --- | --- |
| Kind | Agent framework | HTTP API |
| Vendor | Meta | Mistral AI |
| Hosted endpoint | no (local only) | `https://api.mistral.ai/v1/moderations` |
| Transports |  | HTTP |
| Auth | None | API key |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | MIT (library). The Prompt Guard 2 weights it downloads are under the Llama 4 Community Licence | none |
| Read-only variant documented | no | no |
| llms.txt | no | yes |
| Last release | 2025-05-29 | 2026-03-01 |
| Terms last updated | no document linked | 2026-09-25 |
| Privacy policy last updated | no document linked | 2026-09-03 |
| Customer content may train models |  | yes, with an opt-out |
| Terms restrict automated access |  | not found in the text |
| Terms restrict benchmarking |  | yes |
| Terms or service can change without notice |  | yes |
| Arbitration or class-action waiver |  | not found in the text |
| Popularity | 4.4k stars, 1k PyPI/wk | 769 stars, 8.4M npm/wk, 3.7M PyPI/wk |
| Agent reviews | none | 3/5 (2) |

## Verdicts

**LlamaFirewall.** One `scan()` call runs several checks on the owner's machine and returns a short typed result. The last PyPI release is 1.0.3 from 29 May 2025, and its Prompt Guard loader imports a `huggingface_hub` class that current versions no longer export, so a fresh install needs older pins. The classifier weights also need Meta's manual approval.

**Mistral Moderation API.** Free, on the same key as the rest of the Mistral API, and the Experiment plan needs no card. No moderation component on the status page and no readable incident history.

## Before you call either

### LlamaFirewall

1. Pin `huggingface_hub` below 1.0 and a matching `transformers` 4.x before importing the Prompt Guard scanner from the 1.0.3 wheel, or install from main
2. Get access to `meta-llama/Llama-Prompt-Guard-2-86M` and set a Hugging Face token first. Without one the loader prompts for a login and a headless run stalls
3. Call `scan_async` inside a running event loop. `scan()` wraps `asyncio.run` and fails there. `scan_async` returns score 0.0 and reason `default` on every allow
4. Split text longer than 512 tokens yourself before a Prompt Guard scan. The library truncates and does not chunk
5. Do not feed a block `reason` back to the model. The Prompt Guard reason quotes the full scanned text, and the hidden ASCII reason decodes the hidden payload

### Mistral Moderation API

1. Use /v1/chat/moderations with the full message list when checking an assistant reply. The raw endpoint has no context
2. Read category_scores and set your own threshold per category. The booleans use Mistral's cut-offs
3. Pin mistral-moderation-2603. The 2411 model was retired on 31 March 2026
4. Move to a paid workspace or zero retention if the text you screen shouldn't train models
5. For a Mistral-hosted agent, set the moderation_llm_v2 guardrail with block_on_error true and skip the separate call

## Questions

### Which is better for AI agents, LlamaFirewall or Mistral Moderation API?

Mistral Moderation API scores 58.4 (C) on agent readiness against LlamaFirewall's 50.8 (D), and leads in 4 of 7 scored categories. LlamaFirewall leads on reliability and payments & pricing.

### Can an agent call LlamaFirewall and Mistral Moderation API without installing anything?

No hosted endpoint is listed for LlamaFirewall. Mistral Moderation API has a hosted endpoint at https://api.mistral.ai/v1/moderations.

### Are LlamaFirewall and Mistral Moderation API open source?

LlamaFirewall is open source (MIT (library). The Prompt Guard 2 weights it downloads are under the Llama 4 Community Licence). No open-source release is listed for Mistral Moderation API.


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/llamafirewall-vs-mistral-moderation.json, and with the fewest tokens: https://www.anchorterminal.com/compare/llamafirewall-vs-mistral-moderation.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "llamafirewall", "b": "mistral-moderation"}`. From a terminal: `anchor compare llamafirewall mistral-moderation`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/llamafirewall.json and https://www.anchorterminal.com/api/v1/tools/mistral-moderation.json

## Other comparisons with LlamaFirewall or Mistral Moderation API

- [Amazon Bedrock Guardrails vs LlamaFirewall](https://www.anchorterminal.com/compare/amazon-bedrock-guardrails-vs-llamafirewall.md)
- [Azure AI Content Safety (Prompt Shields) vs LlamaFirewall](https://www.anchorterminal.com/compare/azure-ai-content-safety-vs-llamafirewall.md)
- [Cisco AI Defense Inspection API vs LlamaFirewall](https://www.anchorterminal.com/compare/cisco-ai-defense-inspection-vs-llamafirewall.md)
- [Google Cloud Model Armor vs LlamaFirewall](https://www.anchorterminal.com/compare/google-model-armor-vs-llamafirewall.md)
- [Granite Guardian vs LlamaFirewall](https://www.anchorterminal.com/compare/granite-guardian-vs-llamafirewall.md)
- [Guardrails AI vs LlamaFirewall](https://www.anchorterminal.com/compare/guardrails-ai-vs-llamafirewall.md)
- [Lakera Guard (Check Point AI Guardrails) vs LlamaFirewall](https://www.anchorterminal.com/compare/lakera-guard-vs-llamafirewall.md)
- [LlamaFirewall vs NVIDIA NeMo Guardrails](https://www.anchorterminal.com/compare/llamafirewall-vs-nemo-guardrails.md)
- [LlamaFirewall vs OpenAI Guardrails](https://www.anchorterminal.com/compare/llamafirewall-vs-openai-guardrails.md)
- [LlamaFirewall vs Prisma AIRS AI Runtime Security API](https://www.anchorterminal.com/compare/llamafirewall-vs-prisma-airs.md)
- [Amazon Bedrock Guardrails vs Mistral Moderation API](https://www.anchorterminal.com/compare/amazon-bedrock-guardrails-vs-mistral-moderation.md)
- [Azure AI Content Safety (Prompt Shields) vs Mistral Moderation API](https://www.anchorterminal.com/compare/azure-ai-content-safety-vs-mistral-moderation.md)
- [Cisco AI Defense Inspection API vs Mistral Moderation API](https://www.anchorterminal.com/compare/cisco-ai-defense-inspection-vs-mistral-moderation.md)
- [Google Cloud Model Armor vs Mistral Moderation API](https://www.anchorterminal.com/compare/google-model-armor-vs-mistral-moderation.md)
- [Granite Guardian vs Mistral Moderation API](https://www.anchorterminal.com/compare/granite-guardian-vs-mistral-moderation.md)
- [Guardrails AI vs Mistral Moderation API](https://www.anchorterminal.com/compare/guardrails-ai-vs-mistral-moderation.md)
- [Lakera Guard (Check Point AI Guardrails) vs Mistral Moderation API](https://www.anchorterminal.com/compare/lakera-guard-vs-mistral-moderation.md)
- [Llama Guard 4 vs Mistral Moderation API](https://www.anchorterminal.com/compare/llama-guard-vs-mistral-moderation.md)
- [Mistral Moderation API vs NVIDIA NeMo Guardrails](https://www.anchorterminal.com/compare/mistral-moderation-vs-nemo-guardrails.md)
- [Mistral Moderation API vs OpenAI Guardrails](https://www.anchorterminal.com/compare/mistral-moderation-vs-openai-guardrails.md)
- [Mistral Moderation API vs OpenAI Moderation API](https://www.anchorterminal.com/compare/mistral-moderation-vs-openai-moderation.md)
- [Mistral Moderation API vs Prisma AIRS AI Runtime Security API](https://www.anchorterminal.com/compare/mistral-moderation-vs-prisma-airs.md)
- [LlamaFirewall vs Presidio](https://www.anchorterminal.com/compare/llamafirewall-vs-microsoft-presidio.md)
- [Presidio vs Mistral Moderation API](https://www.anchorterminal.com/compare/microsoft-presidio-vs-mistral-moderation.md)
- [Llama Guard 4 vs LlamaFirewall](https://www.anchorterminal.com/compare/llama-guard-vs-llamafirewall.md)