GLiClass vs Granite Switch 4.1

GLiClass

An Apache-2.0 classifier that scores a whole label set in one encoder pass on the owner's hardware, with single-label, multi-label, hierarchical and few-shot modes. It returns label scores with no calibration claim, the bundled server has no authentication, and the last three test runs on the main branch, on 24 September 2026, failed.

Granite Switch 4.1

One self-hosted Apache 2.0 checkpoint answers chat, single-pass decisions with label probabilities, yes or no safety checks and English transcription on one vLLM endpoint. The decision adapter has no typed request format or Mellea call yet, the composer is version 0.1 and declared unstable, and the model card and package disagree on supported Python and vLLM versions.

GLiClass

1. Pass --host 127.0.0.1 to python -m gliclass.serve, or put the port behind your own gateway. The server checks no credential
2. On a machine without a GPU add --device cpu --dtype float32 --num-gpus-per-replica 0. The default configuration expects CUDA
3. Send one text a request to POST /gliclass. An array in texts is cut to its first item without an error
4. Set multi_label to false for one label from a set. The default scores each label independently, so scores do not sum to 1
5. Keep text plus labels under the pipeline's 1,024-token max_length, or use ZeroShotClassificationWithChunkingPipeline. Longer input is truncated silently

Granite Switch 4.1

1. Pass chat_template_kwargs: {"adapter_name": "decision"} or "guardian-core". Without it the request is ordinary chat on the base model
2. For a decision, send the state and the ### DECISION question as two user turns, request logprob_token_ids for the option labels, and set max_completion_tokens to 1
3. Use single-token option labels. Split more than 128 labels into chunks with the identical prompt and apply one softmax over all returned logprobs
4. Parse guardian-core answers as JSON, {"score": "yes"} or {"score": "no"}, where yes means the criterion is met
5. Add authentication before exposing the vLLM server. Neither vLLM nor the checkpoint requires a key by default