Granite Switch 4.1 vs Strands Decider 2B

Granite Switch 4.1

One self-hosted Apache 2.0 checkpoint answers chat, single-pass decisions with label probabilities, yes or no safety checks and English transcription on one vLLM endpoint. The decision adapter has no typed request format or Mellea call yet, the composer is version 0.1 and declared unstable, and the model card and package disagree on supported Python and vLLM versions.

Strands Decider 2B

A 1.9B-parameter Apache-2.0 decision model that runs on a laptop GPU, an Apple silicon Mac or a CPU, with its training data, recipe and per-version results published. It's an experimental 0.1.0 release with a 4,096-token window that cuts long states by default, and its local server has no authentication.

Granite Switch 4.1

1. Pass chat_template_kwargs: {"adapter_name": "decision"} or "guardian-core". Without it the request is ordinary chat on the base model
2. For a decision, send the state and the ### DECISION question as two user turns, request logprob_token_ids for the option labels, and set max_completion_tokens to 1
3. Use single-token option labels. Split more than 128 labels into chunks with the identical prompt and apply one softmax over all returned logprobs
4. Parse guardian-core answers as JSON, {"score": "yes"} or {"score": "no"}, where yes means the criterion is met
5. Add authentication before exposing the vLLM server. Neither vLLM nor the checkpoint requires a key by default

Strands Decider 2B

1. Pin the checkpoint by its full name, such as StrandsAgents/strands-decider-2B-hobson-v21, since each version is a separate Hugging Face repository
2. Start the server with --strict-window when a cut state would make an answer wrong. It then returns 422 naming the window
3. Ask every question about one state in one request. The state is read once and each question adds only its own tokens
4. Keep the server on 127.0.0.1 or put an authenticating proxy in front. It has no key option
5. Measure thresholds on your own traffic before acting automatically. The card says confidence bands hold for short classification only