Laya vs Granite Switch 4.1

Laya

Apache-2.0 code and weights, installed with pip install laya, with Python 3.10 to 3.13 tested in CI. Base checkpoints score 0.362 and 0.352 on the maintainers' typed-decisions benchmark against a 0.318 random baseline, so it needs fine-tuning.

Granite Switch 4.1

One self-hosted Apache 2.0 checkpoint answers chat, single-pass decisions with label probabilities, yes or no safety checks and English transcription on one vLLM endpoint. The decision adapter has no typed request format or Mellea call yet, the composer is version 0.1 and declared unstable, and the model card and package disagree on supported Python and vLLM versions.

Laya

1. Set LAYA_API_KEY before starting laya-serve. It listens on every interface by default
2. Gate on answer_confidence, not confidence, which measures entropy and doesn't match Jev's field
3. Shortlist choice questions with more than about 20 options using predict_shortlist or the laya_shortlist tool
4. Use semantic or opaque labels such as A and B, not yes and no, in choice questions. The checkpoints can follow the label text
5. Pass model="multilingual" and max_len=8192 for long documents. The English checkpoint stops at 512 tokens

Granite Switch 4.1

1. Pass chat_template_kwargs: {"adapter_name": "decision"} or "guardian-core". Without it the request is ordinary chat on the base model
2. For a decision, send the state and the ### DECISION question as two user turns, request logprob_token_ids for the option labels, and set max_completion_tokens to 1
3. Use single-token option labels. Split more than 128 labels into chunks with the identical prompt and apply one softmax over all returned logprobs
4. Parse guardian-core answers as JSON, {"score": "yes"} or {"score": "no"}, where yes means the criterion is met
5. Add authentication before exposing the vLLM server. Neither vLLM nor the checkpoint requires a key by default