Lab

The lab's evaluations

An evaluation is a fixed set of questions with known answers, run the same way every time on the lab's box, so two results can be put side by side. Open-weight models are the first, and more will be listed here as the lab runs them.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.