{
  "data": null,
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/niches/decision-models.score-rubric/",
    "json": "https://www.anchorterminal.com/niches/decision-models.score-rubric/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/niches/decision-models.score-rubric/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/niches/decision-models.score-rubric/index.min.md"
  },
  "markdown": "Four or more companies' docs show a full fit.\n\n| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |\n| --- | --- | --- | --- | --- |\n| 15 | 7 | 30 | 8 | 4 |\n\n## What counts as done\n\nA probability per level and an expected score.\n\nMeasured, for our own tests: the chosen reading places at least 85 percent of the caller's labelled items in the right level and no critical item below the urgent cut.\n\nHow agents ask for it: how urgent is this; what fraud risk level is this transaction; rate this on a 1 to 5 rubric; how severe is this incident\n\n## Does the job\n\nThe docs show it meets the test above, and nothing we read says otherwise.\n\n- **Celeris-1 Decision (Marqo Inc)**: score returns a probability per level, the probability-weighted average level and a legend, up to 64 levels. Thresholding guidance is generic.\n- **Clef (Cloudflare, Inc.)**: score questions over ordered options return a probability per option. No threshold guidance from Cloudflare.\n- **Decider (Mark Marosi (Mapika))**: score over 2 to 10 described levels returns a probability per level and the expected level, with a fitted temperature per answer type.\n- **Decision 3.0 (vLLM Semantic Router project)**: score questions return a probability per level; the readout temperature is 1.0 with no calibration figure.\n- **elephant-1 (Baseten Labs, Inc.)**: score over 2 to 10 ordered levels returns a probability per level and the expected level; a Brier term in training discourages overconfidence.\n- **joey-1 (Baseten Labs, Inc.)**: score over 2 to 10 ordered levels returns a probability per level and the expected level; a Brier term in training discourages overconfidence.\n- **Liquid d1 (Liquid AI, Inc.)**: score returns the probability-weighted position and a probability per level; the guide's scoring and reranking examples set thresholds on the probabilities.\n- **mammoth-1 (Baseten)**: score over 2 to 10 ordered levels returns a probability per level and the expected level; a Brier term in training discourages overconfidence.\n- **Microsoft-Decision-1 (Microsoft)**: score over ordered levels returns an expected score and probabilities; Learn says to validate on your own labelled examples and prefer scores for ordering and thresholds over absolute ratings.\n- **Drex 1.5 (Nace AI, Inc.)**: score returns the expected score, a legend, a probability per level and confidence; levels are the criteria array in order.\n- **OpenAI Decisions API (OpenAI OpCo, LLC)**: score over 2 to 10 ordered levels returns the probability-weighted average level, probabilities and confidence.\n- **pplx-decider (Perplexity AI, Inc.)**: score over up to 10 levels returns the probability-weighted score, legend and probabilities; confidence formula is documented.\n- **pplx-decider-flash (Perplexity AI, Inc.)**: score over up to 10 levels with expected score, legend and probabilities; same documented confidence formula.\n- **ScaleDown (Carbon ScaleDown, Inc.)**: score over 2 to 10 levels returns the probability-weighted expected value and a probability per level, with the calculation worked through in the docs.\n- **SPEV (Sprag AI, Inc.)**: score over 2 to 10 levels returns the expected level, probabilities and confidence; vendor figures only.\n- **kettei (Sqwish Ltd, trading as Sqwish Labs)**: ordinal decisions over 2 to 255 levels with a rubric line each return probabilities and expected_level.\n- **Jev (TypeSafe AI, Inc.)**: score with probabilities per level, expected score and confidence, plus confidence-routing guidance for answers split across levels; fraud triage on 100 transactions and routing on 80 prompts ran against Strands with Jev stronger on fraud.\n\n## Does the job, with a limit\n\nIt does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.\n\n- **Laya (Convai Innovations Pvt. Ltd.)**: score questions are supported in one pass at 33 ms, with answer_confidence to gate on, but issue 131 reports laya-multilingual never selecting the first-listed score option and calibration error is high.\n- **Drex Max v1 (Nace AI, Inc.)**: score over ordered levels with expected score and probabilities. Vendor figures only; licence cap.\n- **Granite Switch 4.1 (International Business Machines Corporation)**: Ordered labels can be scored, but there is no score type, legend or expected level; the caller derives them from label logprobs.\n- **Kev (Jared Palmer)**: score over 1 to 255 levels with expected level and probabilities; issue 161 measured a slot-0 logit offset on identical score options, fixed in PR 236, so pin v1.0 or later weights.\n- **JEV-27B-VL (AutoTrust AI Lab)**: Rate 0 to 5 on text and images with a probability per level; vendor figures only.\n- **RightNow System Zero (RightNow AI, Inc.)**: score returns an expected level, legend and probabilities, flagged uncalibrated.\n- **Strands Decider 2B (Amazon Web Services, Inc.)**: score with expected level and probabilities; fraud triage scored 61 of 100 matching words in option descriptions, and the card says confidence bands hold for short classification only.\n- **Vela 2.0 (vLLM Semantic Router project (with KR Labs))**: score over 2 to 10 levels returns the expected level and distribution; USAGE.md says Choice and Score confidence are distribution statistics, not calibrated probabilities.\n\n- not this job: GLiClass (Knowledgator Engineering Ltd.): No ordered score type or expected level; labels are unordered and scored independently.\n\n1 listings in the category were added after this reading and aren't marked yet.\n\n## What stops agents finishing\n\n- expected score rounds a critical item into a lower queue when probability is spread\n- a one-point rubric cutoff hides borderline cases\n\n## Around it\n\nBefore: support.fetch-ticket, payments.fetch-transaction. After: support.set-priority, human-review.\n\n## Where this comes from\n\nWeight 8 of 100 in Decision models: 4 of 41 accounts; the AWS fraud and delivery tests, the Kev score-order issue and the Dataiku score threshold finding\n\nAs data: https://www.anchorterminal.com/api/v1/use-cases/decision-models.score-rubric.json, or the MCP tool get_use_case with id decision-models.score-rubric. Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person.\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-16",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.8",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "For agents",
        "url": "https://www.anchorterminal.com/agents/"
      },
      {
        "name": "Niches",
        "url": "https://www.anchorterminal.com/niches/"
      },
      {
        "name": "Place an item on an ordered scale",
        "url": ""
      }
    ],
    "description": "Place an item on an ordered scale: 15 companies fully do it, 7 with a limit, 30 carry the tag. Every listing in Decision models with the reason and a source.",
    "facts": null,
    "h1": "Place an item on an ordered scale",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/niches/decision-models.score-rubric/",
    "published": "",
    "section": "agents",
    "title": "Place an item on an ordered scale: who does it | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-15",
    "url": "https://www.anchorterminal.com/niches/decision-models.score-rubric/"
  },
  "tokens": {
    "markdown": 1750,
    "slim": 430
  },
  "version": 1
}
