# Baserun vs Gauge CLI (slim)

> Gauge CLI scores 60.4 (C) to Baserun's 7.3 (F) for evaluations. Prices, MCP, x402, uptime and agent notes side by side.

- Full: https://www.anchorterminal.com/compare/baserun-vs-gauge-cli.md (~3,700 tokens) · this version ~1,780 tokens · JSON https://www.anchorterminal.com/compare/baserun-vs-gauge-cli.json · canonical https://www.anchorterminal.com/compare/baserun-vs-gauge-cli
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · MCP: https://www.anchorterminal.com/mcp · Updated: 2026-11-06
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)

Baserun shut down on 2024-09-30. Gauge CLI scores 60.4 (C) on agent readiness against Baserun's 7.3 (F), and leads in every scored category. Both do evaluations.

- Baserun: F 7.3, rank retired, not ranked · https://www.anchorterminal.com/tools/baserun.min.md
- Gauge CLI: C 60.4, rank #590 of 1354 · https://www.anchorterminal.com/tools/gauge-cli.min.md
- Baserun, good for Nothing new. It shut down on 2024-09-30. Also A hosted endpoint, with nothing to install.
- Gauge CLI, good for Teams that build skills, CLIs, SDKs or MCP servers and want to see where coding agents get stuck with them, and to test fixes before release. Ahead on Reliability, 60 against 0; Schema & documentation, 60 against 15; Agent ergonomics, 75 against 5; Security & auth, 55 against 5; Payments & pricing, 40 against 0; Maintenance & community, 82 against 0; Transparency & trust, 53 against 36. Also Still running. Baserun has shut down; No key needed to call it; Open source.

| Category | Baserun | Gauge CLI |
| --- | --- | --- |
| Reliability (16%) | 0 | 60 |
| Performance (10%) | pending | pending |
| Schema & documentation (13%) | 15 | 60 |
| Agent ergonomics (13%) | 5 | 75 |
| Security & auth (14%) | 5 | 55 |
| Payments & pricing (10%) | 0 | 40 |
| Task success (10%) | pending | pending |
| Maintenance & community (7%) | 0 | 82 |
| Transparency & trust (7%) | 36 | 53 |

| Fact (where they differ) | Baserun | Gauge CLI |
| --- | --- | --- |
| Kind | HTTP API | cli |
| Vendor | Baserun | Gauge |
| Hosted endpoint | `https://app.baserun.ai` | no (local only) |
| Transports | HTTP |  |
| Auth | API key | None |
| Licence | none | MIT |
| Last release | 2024-06-26 | 2026-11-04 |
| Terms last updated | couldn't be read | no document linked |
| Privacy policy last updated | couldn't be read | no document linked |
| Customer content may train models | couldn't be read | not read yet |
| Terms restrict automated access | couldn't be read | not read yet |
| Terms restrict benchmarking | couldn't be read | not read yet |
| Terms or service can change without notice | couldn't be read | not read yet |
| Arbitration or class-action waiver | couldn't be read | not read yet |
| Popularity | 115 npm/wk, 209 PyPI/wk | none |
| Agent reviews | 1/5 (2) | none |

Why the edge:
- Maintenance & community, Gauge CLI +82: Baserun 0 (Last releases were PyPI 2.0.9 on 2024-06-26 (per the 1 October check, not re-read on 17 October, since PyPI answered with a JavaScript challenge) and npm 2.1.3, still the latest on 17 October, both more than two years old (0). No releases in the last 90 days (0). The Python SDK repository's last commit is still 2024-06-26 and nobody answers (0). SDKs aren't current (0). No CI beyond a pre-commit workflow (0).); Gauge CLI 82 (CLI 0.28.0 on 4 November 2026 (30). Six releases in 90 days (20). Issues and pull requests weren't read; a support address and issue tracker are published (12 of 25). Current official package (15). CI on push and pull request (5 of 10, results not read). 30 + 20 + 12 + 15 + 5 = 82.)
- Agent ergonomics, Gauge CLI +70: Baserun 5 (Nothing can be called. The Python and TypeScript SDKs still install (5 of the 15 for SDKs in two languages), but every call goes to a dead host. No sizing, pagination, error or retry behaviour to assess (0).); Gauge CLI 75 (CLI reading for an agent driving it. Bundled instructions match the installed version, and output is filterable with -o json (20 of 25). Run summaries and Findings with queryable fields (15 of 20). Errors not documented as a reference (10 of 20). Reruns from checkpoints and a recheck command with a confirm step (15 of 20). Four commands to start, Node only (15 of 15). 20 + 15 + 10 + 15 + 15 = 75.)
- Reliability, Gauge CLI +60: Baserun 0 (Shut down, so there's nothing left to be reliable. No status page (0) and no incident history (0). api.baserun.ai doesn't resolve in DNS and app.baserun.ai, the host the Python SDK calls by default, still serves a certificate that has expired. No rate limits, retry guidance or SLA survive (0). Nothing is generally available (0).); Gauge CLI 60 (Local package. Installs from npm as @withgauge/cli with Node 22.13 or later and Docker stated (20). checks.yml runs npm run check on push and pull request across a matrix, and the repository has 76 test files; whether main passes wasn't read (20 of 25). Issues weren't read (5, unchecked). A dated changelog with Added sections per release (15). Version 0.28.0 (0). 20 + 20 + 5 + 15 + 0 = 60.)
- Security & auth, Gauge CLI +50: Baserun 5 (The old credential model was one project API key read from `BASERUN_API_KEY` (no longer accepted anywhere, 0). No security policy, security.txt or certification found (0). The risk that remains is the SDK default. `baserun` on PyPI sends trace data to https://app.baserun.ai unless `BASERUN_API_URL` is set, neither package is marked deprecated, and whoever controls that host later would receive any prompts an old install still sends (5 for the archived privacy policy, nothing else).); Gauge CLI 55 (Local tool. Agent credentials stay on your machine in local mode; hosted login with a device flow (20 of 30). Test agents run in fresh Docker sessions with injected inputs, and the gateway brokers credentials in hosted mode (12 of 20). Agents under test read your product's docs and outputs, with no prompt-injection guidance (5 of 15). Local transcripts and SQLite evidence per run (10 of 15). No security policy found (8 of 20). 20 + 12 + 5 + 10 + 8 = 55.)
- Schema & documentation, Gauge CLI +45: Baserun 15 (Scored on what's left. docs.baserun.ai still serves an llms.txt index of 41 Markdown pages, read on 17 October (10), and the SDK pages carry code examples (5). No OpenAPI or other contract was ever published that we found (0), the docs describe a service that no longer answers, and there's no changelog (0). The llms.txt still links a changelog at www.baserun.ai, which fails the TLS handshake.); Gauge CLI 60 (CLI reading. No machine-readable contract, -o json on read commands (10 of 25). No llms.txt; instructions bundled in the CLI for agents (5). The README says what it finds and when local or hosted fits (16 of 20). Commands with help text; typed flags (9 of 15). Worked examples, no error reference (8 of 15). Dated changelog and semver tags (12 of 15). 10 + 5 + 16 + 9 + 8 + 12 = 60.)
- Payments & pricing, Gauge CLI +40: Baserun 0 (No longer sold (0 on every line). There's no way to buy, try or get a key, and no x402 or other machine payment (0).); Gauge CLI 40 (Scored on the hosted option. No payment protocol (0). Credit prices weren't found on the pages read (0). Local mode is free with no card (20). Local mode needs no sign-up (20). 0 + 0 + 20 + 20 = 40.)