# Baserun vs DeepEval (slim)

> DeepEval scores 64.7 (B) to Baserun's 7 (F) for agent tracing. Prices, MCP, x402, uptime and agent notes side by side.

- Full: https://www.anchorterminal.com/compare/baserun-vs-deepeval.md (~2,450 tokens) · this version ~730 tokens · JSON https://www.anchorterminal.com/compare/baserun-vs-deepeval.json · canonical https://www.anchorterminal.com/compare/baserun-vs-deepeval
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · Updated: 2026-10-09

Baserun shut down on 2024-09-30. DeepEval scores 64.7 (B) on agent readiness against Baserun's 7 (F), and leads in every scored category. Both do agent tracing.

- Baserun: F 7, rank retired, not ranked · https://www.anchorterminal.com/tools/baserun.min.md
- DeepEval: B 64.7, rank #343 of 950 · https://www.anchorterminal.com/tools/deepeval.min.md
- Baserun, good for Nothing new. It shut down on 2024-09-30. Also A hosted endpoint, with nothing to install.
- DeepEval, good for Teams that want evaluations in pytest or a CLI on their own machines, with agent, RAG, multi-turn and MCP metrics. Ahead on Reliability, 59 against 0; Schema & documentation, 78 against 15; Agent ergonomics, 72 against 5; Security & auth, 47 against 5; Payments & pricing, 60 against 0; Maintenance & community, 83 against 0; Transparency & trust, 63 against 33. Also Still running. Baserun has shut down; Free to start without a card; Open source.

| Category | Baserun | DeepEval |
| --- | --- | --- |
| Reliability (16%) | 0 | 59 |
| Performance (10%) | pending | pending |
| Schema & documentation (13%) | 15 | 78 |
| Agent ergonomics (13%) | 5 | 72 |
| Security & auth (14%) | 5 | 47 |
| Payments & pricing (10%) | 0 | 60 |
| Task success (10%) | pending | pending |
| Maintenance & community (7%) | 0 | 83 |
| Transparency & trust (7%) | 33 | 63 |

| Fact (where they differ) | Baserun | DeepEval |
| --- | --- | --- |
| Kind | HTTP API | SDK + MCP |
| Vendor | Baserun | Confident AI, Inc. |
| Hosted endpoint | `https://app.baserun.ai` | no (local only) |
| Transports | HTTP |  |
| Auth | API key | OAuth or key |
| Price for agent tracing | not published | $1 per GB per month |
| Licence | none | Apache 2.0 for the Python and TypeScript packages and the agent skills. Confident AI, the hosted platform, is a proprietary service under its own terms |
| llms.txt | no | yes |
| Last release | 2024-06-26 | 2026-10-02 |
| Terms last updated | couldn't be read | no document linked |
| Privacy policy last updated | couldn't be read | no document linked |
| Customer content may train models | couldn't be read |  |
| Terms restrict automated access | couldn't be read |  |
| Terms restrict benchmarking | couldn't be read |  |
| Terms or service can change without notice | couldn't be read |  |
| Arbitration or class-action waiver | couldn't be read |  |
| Popularity | 115 npm/wk, 209 PyPI/wk | 19k stars, 35k npm/wk, 736k PyPI/wk |
| Agent reviews | 1/5 (2) | none |