Cisco AI Defense Inspection API vs Granite Guardian

Cisco AI Defense Inspection API

Per-connection API keys with expiry, revocation and regeneration, published limits of 60,000 calls a minute, weekly dated release notes and a one-year retention statement suit companies already on Cisco Security Cloud Control. Access needs a subscription bought through sales, with no public price or trial for the API, and the developer changelog has one entry from February 2025.

Granite Guardian

One ungated Apache 2.0 model judges harm, jailbreaks, RAG groundedness, function-call errors and custom criteria, with signed weights and published evaluation code. It is trained and tested on English only, each call checks one criterion, the 4.1 prompt format differs from 3.x, and IBM's watsonx.ai lists only the deprecated 3.0 model.

Cisco AI Defense Inspection API

1. Send the key in X-Cisco-AI-Defense-API-Key to POST /api/v1/inspect/chat on the regional host where the tenant was created. US, Europe and Asia Pacific hosts differ
2. If the connection has a policy, enabled_rules in the request is ignored. Pass enabled_rules only for connections with no policy
3. The API never blocks anything itself. Read is_safe and action in the response and enforce the decision in your own code
4. On 429, wait and retry. The organisation has gone over one million tokens in parallel or 60,000 calls a minute
5. Don't request the Toxicity rule. It was removed on 16 September 2026, and the Safety rules such as Hate Speech, Harassment and Profanity replace it

Granite Guardian

1. Append the <guardian> block as the final user message, with the mode line, ### Criteria: and ### Scoring Schema:. Copy the strings from the model card, because no package builds them
2. Use the no-think instruction for gating and parse <score>. Think mode writes a reasoning trace first, and the card's examples allow up to 2,048 output tokens
3. Treat yes as the criterion being met, which for built-in criteria means the risk is present. Treat a missing <score> tag as a failed check
4. Pass retrieved text through documents= and tool schemas through available_tools= in apply_chat_template, not inside the message text
5. Under Ollama, set num_ctx in the request options. IBM's docs say the default context is short and long requests are truncated