Granite Switch 4.1 vs kettei

Granite Switch 4.1

One self-hosted Apache 2.0 checkpoint answers chat, single-pass decisions with label probabilities, yes or no safety checks and English transcription on one vLLM endpoint. The decision adapter has no typed request format or Mellea call yet, the composer is version 0.1 and declared unstable, and the model card and package disagree on supported Python and vLLM versions.

kettei

OneHot returns probabilities for up to 128 typed questions a call at $0.02 to $0.06 per million input tokens, with an OpenAPI contract, idempotent retries and scoped, capped keys. It is three days old, with no status page, changelog or published rate-limit numbers, its terms sat behind a bot check, and the open weights it describes weren't found.

Granite Switch 4.1

1. Pass chat_template_kwargs: {"adapter_name": "decision"} or "guardian-core". Without it the request is ordinary chat on the base model
2. For a decision, send the state and the ### DECISION question as two user turns, request logprob_token_ids for the option labels, and set max_completion_tokens to 1
3. Use single-token option labels. Split more than 128 labels into chunks with the identical prompt and apply one softmax over all returned logprobs
4. Parse guardian-core answers as JSON, {"score": "yes"} or {"score": "no"}, where yes means the criterion is met
5. Add authentication before exposing the vLLM server. Neither vLLM nor the checkpoint requires a key by default

kettei

1. Send context and decisions to POST https://api.sqwish.ai/v1/decide with a bearer key. Leaving out model gets kettei-core, which reads text only
2. Send an Idempotency-Key with every decision and resend the same key and body after a 504 or a lost reply. Replays aren't charged
3. Branch on error.code and error.retryable, not the status. Wait for Retry-After on 429 and retryable 503s
4. Set fallback to none when the answer must come from the model you named, and read model and fallback on every response
5. Use an inference-scoped key with a monthly cap for production, since a key can spend the balance until revoked