# Lab score: open-weight models on our own evaluation (slim)

> Open-weight models answering 59 questions about Anchor Terminal through its MCP server, pages and API, scored 0 to 100, with every run dated.

- Full: https://www.anchorterminal.com/lab/evaluation/index.md (~450 tokens) · this version ~330 tokens · JSON https://www.anchorterminal.com/lab/evaluation/index.json · canonical https://www.anchorterminal.com/lab/evaluation/
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · MCP: https://www.anchorterminal.com/mcp · Updated: 2026-11-18
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)

Each open-weight model the lab runs answers 59 questions about Anchor Terminal through our MCP server, pages and API, three times over, calling the tools itself or writing programs that call them, as it chooses.

No model has a Lab score yet.

## Every evaluation

A run in code mode, where the model may only write programs, is kept beside the Lab score's runs and scores nothing.

| Date | Model | Mode | Score | Right |
| --- | --- | --- | --- | --- |
| 18 November 2026 | qwen3.8-27b | code only | 89 | 54 of 59 |

The questions: https://github.com/Anchor-Terminal/anchorlab/blob/main/eval/tasks.go

An answer is checked against the site before and after the model answered, a question whose subject left the site or that has two right answers is skipped, and an answer with no lookup behind it counts as wrong.

JSON: https://www.anchorterminal.com/api/v1/lab-evals.json
