# Gauge CLI (slim)

> Gauge CLI runs real coding agents (Claude Code, Codex, Pi, OpenCode) against your skills, CLIs, SDKs, MCP servers and docs in Docker, records where they get stuck, and lets your agent test fixes before release.

- Full: https://www.anchorterminal.com/tools/gauge-cli.md (~4,550 tokens) · this version ~1,130 tokens · JSON https://www.anchorterminal.com/tools/gauge-cli.json · canonical https://www.anchorterminal.com/tools/gauge-cli
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · MCP: https://www.anchorterminal.com/mcp · Updated: 2026-11-06 · pricing https://www.anchorterminal.com/tools/gauge-cli#pricing · reviews https://www.anchorterminal.com/tools/gauge-cli#reviews
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)

**C · 60.4/100 · rank #590 of 1354 · #13 in Agent observability & evals · not agent-ready · confidence low**


Assessment: An open-source CLI that measures how coding agents get on with your product and checks fixes before you ship them, locally in Docker with no account. It's young and pre-1.0, collects anonymous command usage by default with a documented opt-out, and hosted runs need credits.

## Facts

- Kind: cli · vendor: Gauge · category: Agent observability & evals · legal entity: not named · provenance 27/100
- Packages: npm `@withgauge/cli`
- Auth: None · pricing: Freemium · x402: no · licence: MIT
- Probe metrics: not measured yet (probes haven't run)
- Surface graded: The open-source CLI, read from a clone of github.com/gauge-sh/gauge-cli on 6 November 2026: the README, cli/README.md, cli/package.json, the changelog, workflows and tags. Hosted Gauge's pages and pricing weren't read. Nothing was installed or run
- Local and hosted: Local runs use Docker and your agent credentials, with results in a private SQLite database that your coding agent analyses. Hosted Gauge adds managed compute, automated judging, native binaries, website previews, authenticated MCP servers and APIs, scheduled measurements and GitHub PR checks, on workspace credits
- Releases: CLI 0.23.0 (20 October), 0.24.0 (22 October), 0.25.0 and 0.25.1 (27 October), 0.26.0 (28 October), 0.27.0 (2 November) and 0.28.0 (4 November) 2026, plus runtime, gateway and adapter packages
- Telemetry: On by default for the installed CLI: command name, timestamp, CLI version and a random installation ID, excluding arguments, prompts, file contents and account identifiers. Off with gauge telemetry disable or GAUGE_TELEMETRY_DISABLED=1

- Scores: Reliability 60, Performance pending, Schema & documentation 60, Agent ergonomics 75, Security & auth 55, Payments & pricing 40, Task success pending, Maintenance & community 82, Transparency & trust 53 · total over the 7 assessed categories
- Why: Reliability, Local package. · Schema & documentation, CLI reading. · Agent ergonomics, CLI reading for an agent driving it. · Security & auth, Local tool. · Payments & pricing, Scored on the hosted option. · Maintenance & community, CLI 0.28.0 on 4 November 2026 (30). · Transparency & trust, MIT (30).
- Sources: 3, open questions: 2, both in the full twin
- Capabilities: obs.evals
- JSON: https://www.anchorterminal.com/api/v1/tools/gauge-cli.json
- Verify (for the vendor): the badge `https://www.anchorterminal.com/badges/gauge-cli.svg` or a link to https://www.anchorterminal.com/tools/gauge-cli from a page on withgauge.com or one of its subdomains, or the README at the root of github.com/gauge-sh/gauge-cli, then `POST https://www.anchorterminal.com/api/v1/verify` `{"slug", "url"}` or `verify_listing` at /mcp; re-checked weekly, no effect on the grade. Snippets in the full twin.

## Before you call it

1. npm install -g @withgauge/cli, then gauge local runtime pull and gauge init --local in the project
2. Run gauge install-skill so your coding agent finds the CLI's own instructions
3. Set GAUGE_TELEMETRY_DISABLED=1 in CI if you don't want command usage collected
4. Rebuild and pack an npm CLI or SDK before rerunning, so test sessions get the new tarball
5. Keep .gauge/ private; it holds measurements and analyses

## Connect

```bash
npm install -g @withgauge/cli
gauge local runtime pull
gauge init --local
gauge install-skill
```

## Similar tools

| Tool | Grade | Score | Shared capabilities | Slim |
| --- | --- | --- | --- | --- |
| Arize Phoenix | BB | 72.1 | obs.evals | https://www.anchorterminal.com/tools/arize-phoenix.min.md |
| Respan API + MCP | BB | 72 | obs.evals | https://www.anchorterminal.com/tools/respan.min.md |
| Langfuse API + MCP | BB | 71.8 | obs.evals | https://www.anchorterminal.com/tools/langfuse.min.md |
| LangSmith API + MCP | BB | 71.6 | obs.evals | https://www.anchorterminal.com/tools/langsmith.min.md |
| Opik API + MCP | BB | 71.5 | obs.evals | https://www.anchorterminal.com/tools/opik.min.md |


## Panel reviews (0, desk reviews from public material, no calls made)