Agent Tree vs Braintrust API + MCP

Agent Tree 50

Framework reading, docs a model can follow, as superpowers was read. types/index.d.ts types the pane's state, and plugin.json declares seven userConfig options with types, titles, descriptions and defaults, but there's no interface for an outside caller (12 of 25). README in English and German, a nine-step GUIDE.md and PRIVACY.md, all Markdown in the repository; no llms.txt (10). The README and guide say what the pane shows and what each button does, but not when not to use it (10 of 20). Options are typed, with an enum for the language; the /agent-tree command takes stop, clear, intro and to <id> <text> (8 of 15). A demo GIF and the guide's steps, with few documented errors beyond the update and delivery toasts (5 of 15). Semver tags but no changelog or release notes read (5 of 15). 50 in all.

Braintrust API + MCP 85

OpenAPI 3.0.3 with 75 paths and 234 operations at /docs/openapi.json, pinned and refreshed weekly in the Python SDK repo (25). llms.txt with about 500 entries, every page served as Markdown (10). The MCP docs give a one-line purpose for each of the 42 tools and mark the test_* tools as dry runs, but say little about when not to use a tool. The MCP server is closed source, so we read the docs rather than the definitions (13). Typed OpenAPI schemas with pagination parameters and enums, though sql_query takes free-form SQL and event payloads are free-form by nature (11). 400, 401, 403, 429 and 500 responses are declared on most operations, but only 4 of 234 operations carry an inline example. The cookbook fills some of the gap (11). Versioned /v1 API, a monthly product changelog, a data-plane changelog and per-SDK changelogs (15).

Agent Tree 33

Local-package reading, as for superpowers and tokeneconomizer. One command installs it through Claude Code's plugin manager from the author's own marketplace (the GitHub repository), not an official one, with Claude Code 2.1.292 or later stated and 2.1.316 tested (15 of 20). No .github directory, so no public CI; 304 tests in four files under tests/ run on Claude Code's own test module on a contributor's machine (8 of 25). Issues couldn't be read, as github.com was unreachable from this session (5 of 25, unchecked). 19 semver tags in six days, each described in its commit message, with no changelog and no breaking changes called out (5 of 15). Version 0.5.4 (0). 33 in all.

Braintrust API + MCP 61

Statuspage at status.braintrust.dev with component history and 25 incidents since February 2026 (20). The last 90 days hold several majors. A critical run of 504s on the EU data plane on 16 July (about 30 minutes), gateway 5xx incidents on 3 August and 27 to 28 August, control plane 5xxs on 4 September, a 40-minute data-loading failure in the US on 9 September and 78 minutes of elevated errors across the US data plane API on 30 September. Most were short and the gateway is a side product, so 5 rather than 0. The only published limit is about 20 BTQL queries a minute on Starter and Pro. Ingestion and REST limits have no numbers (8). The OpenAPI spec documents 429 with a Retry-After header on 154 operations and recommends exponential backoff, the SDKs retry 408, 429 and 5xx, and events written with the same id overwrite rather than duplicate (15). Enterprise lists SLAs and guaranteed response times with no published terms (3). API and MCP are GA (10).

Agent Tree 60

v0.5.4 tagged on 29 October 2026 and a commit on 31 October (30). 19 tags from v0.2.2 (24 October) to v0.5.4 (29 October), far more than three in 90 days (20). Issue and pull-request replies couldn't be read, as github.com was unreachable (5 of 25). Not in Claude's official plugin directory; claude.com/plugins/agent-tree answered 404 (0). No dependencies beyond Claude Code's plugin module, tests in the tree, no CI (5 of 10). 60 in all.

Braintrust API + MCP 85

TypeScript SDK braintrust 3.36.0 and Python SDK 0.44.0, both on 2026-10-01 (30). 15 TypeScript and 19 Python releases since 16 July (20). The product changelog lists dozens of September entries and both SDK repositories take outside contributions credited in the changelog. We didn't load issue reply times (12). Official SDKs in six languages, current (15). Public CI (checks.yaml), integration tests, Dependabot and a weekly dependency job. We didn't confirm the pass state (8).

Agent Tree 60

Self-hosted rule. No payment protocol (0). Free under MIT with nothing to buy (20). No card or account (20). A person installs it with one command and no sign-up (20). 60 in all.

Braintrust API + MCP 40

No x402 or other machine payment (0). Usage prices published without login, $4 a GB and $2.50 per 1,000 scores on Starter, $3 and $1.50 on Pro (20). Starter is free with no card (20). A person signs up in a browser to create a key. The MCP OAuth flow also needs a browser sign-in (0).

Agent Tree 49

Harness reading of the framework checklist, as superpowers and tokeneconomizer were read. 30 for what leaves the machine and credentials, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No credentials of its own, and the only request is a daily GET of plugin.json from the main branch carrying nothing about the session. Auto-update is on by default and runs claude plugin update agent-tree whenever main has a newer version, so code from one maintainer's account runs inside Claude Code at the next start without review, in hooks that see every model step and tool call (18). Hooks act only after the person acts in the pane, per PRIVACY.md and the code. Stops, messages and model changes are explicit. There's no sandbox, and a stop replaces the sub-agent's next step and denies its tool calls (12). Corrections carry only the person's text, framed and labelled, and the pane masks bearer tokens, URL credentials and secret-named values in what it shows. No guidance on untrusted content in sub-agent output (9). Each message to a sub-agent is noted in the main transcript and in a running parent's. The event log stays in memory and isn't kept after the session (8). No SECURITY.md, no security.txt and no advisories found; GitHub's security page couldn't be read (2). 49 in all.

Braintrust API + MCP 58

User API keys and service tokens as Bearer tokens. Service tokens attach to permission groups that can be scoped to single projects on any plan, keys can be deleted through /v1/api_key and /v1/service_token, and the MCP server also takes OAuth 2.0 with dynamic client registration (25). Viewer groups exist, but the MCP server gained write tools in August with no server-side read-only mode, and the docs leave confirmation to the client (12). Traces hold whatever the application logged, and we found no prompt-injection guidance for agents reading them (3). The October changelog mentions audit logging, and a knowledge-base page says org-wide API key auditing is in the UI only (8). SOC 2 Type II is claimed on the pricing page. The Vanta trust centre at trust.braintrust.dev rendered nothing readable to us, there's no security.txt and no SECURITY.md in either SDK repository, and the two credential-capture fixes below were explained in knowledge-base pages rather than advisories (10).