Laya vs kettei

Laya

Apache-2.0 code and weights, installed with pip install laya, with Python 3.10 to 3.13 tested in CI. Base checkpoints score 0.362 and 0.352 on the maintainers' typed-decisions benchmark against a 0.318 random baseline, so it needs fine-tuning.

kettei

OneHot returns probabilities for up to 128 typed questions a call at $0.02 to $0.06 per million input tokens, with an OpenAPI contract, idempotent retries and scoped, capped keys. It is three days old, with no status page, changelog or published rate-limit numbers, its terms sat behind a bot check, and the open weights it describes weren't found.

Laya

1. Set LAYA_API_KEY before starting laya-serve. It listens on every interface by default
2. Gate on answer_confidence, not confidence, which measures entropy and doesn't match Jev's field
3. Shortlist choice questions with more than about 20 options using predict_shortlist or the laya_shortlist tool
4. Use semantic or opaque labels such as A and B, not yes and no, in choice questions. The checkpoints can follow the label text
5. Pass model="multilingual" and max_len=8192 for long documents. The English checkpoint stops at 512 tokens

kettei

1. Send context and decisions to POST https://api.sqwish.ai/v1/decide with a bearer key. Leaving out model gets kettei-core, which reads text only
2. Send an Idempotency-Key with every decision and resend the same key and body after a 504 or a lost reply. Replays aren't charged
3. Branch on error.code and error.retryable, not the status. Wait for Retry-After on 429 and retryable 503s
4. Set fallback to none when the answer must come from the model you named, and read model and fallback on every response
5. Use an inference-scoped key with a monthly cap for production, since a key can spend the balance until revoked