Head to head · Design files · October 2026 research run

pen.dev vs Subframe

pen.dev scores 47.6 (D) on agent readiness against Subframe's 39.7 (E), and leads in 4 of 7 scored categories. Subframe leads on security & auth and maintenance & community. Both do design files.

Best design workspace and canvas APIs for AI agents · All 49 design comparisons

Which one, for what

pen.dev D

Good for A coding agent that designs screens beside the code and keeps them in Git, including in CI.

Ahead on

  • Reliability, 33 against 19
  • Schema & documentation, 61 against 54
  • Agent ergonomics, 66 against 47
  • Payments & pricing, 38 against 33

Also in its favour

  • Runs on your own machine
  • No incidents deducted, where Subframe loses 3 points for them

Watch for

No changelog. The three desktop releases on GitHub have empty notes, and the format docs reserve the right to make breaking changes

Subframe E

Good for A coding agent working beside a team that designs React and Tailwind interfaces in Subframe and wants the design as code, with a read-only route for review.

Ahead on

  • Security & auth, 44 against 33
  • Maintenance & community, 65 against 59

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

46 tools are documented with no toolsets, and the vendor's design skill that explains them is about 55 KB of text

Score by category

CategoryWeight this runpen.devSubframeEdge
Reliability16%203319pen.dev +14
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26154pen.dev +7
Agent ergonomics13%16.26647pen.dev +19
Security & auth14%17.53344Subframe +11
Payments & pricing10%12.53833pen.dev +5
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.85965Subframe +6
Transparency & trust7%8.85357Subframe +4
Negative events≤150-3
Total47.6 · D39.7 · E

Facts side by side

Factpen.devSubframe
KindMCP serverMCP server
VendorHigh Agency, Inc.Atomic Design Inc
Hosted endpointno (local only)https://mcp.subframe.com/mcp
TransportsstdioHTTP
AuthOAuth or keyOAuth or key
PricingFreemiumFreemium
x402nono
LicenceProprietary. The CLI package on npm carries a proprietary licence file, and the apps fall under the vendor's EULAProprietary service under Atomic Design's terms of service. @subframe/cli and @subframe/core are marked ISC in their package files and the Claude Code plugin MIT in its manifest, with no licence file in the repository
Tools exposed646
Read-only variant documentednoyes
llms.txtnoyes
Last release2026-10-082026-10-08
Terms last updated2026-10-062026-01-22
Privacy policy last updated2026-10-062026-01-22
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waivernot found in the textnot found in the text
Popularity3.5k npm/wk435 stars, 1k npm/wk

Verdicts

pen.dev

An agent can create, edit and export .pen designs without a GUI through the pen CLI, with four compact MCP tools that carry annotations and a documented JSON format. The software is closed and needs a pen.dev account. No changelog, status page or security contact was found, and 14 public issue reports had no reply on 8 October 2026.

Subframe

An agent can read and change pages, components, snippets and themes in a Subframe project through a hosted MCP server with OAuth, and Viewer accounts get a read-only server. The server lists 46 tools, and no status page, rate limits, changelog or security contact were found. Three tools were renamed in September 2026 with no notice found.

Before you call either

pen.dev

  1. Call read_skill(), then read_skill({ path: "pen-schema.md" }) and read_skill({ path: "execute.md" }) before the first execute. The tool description alone doesn't document the operations
  2. Call get_app_state() and confirm the active document before editing. The MCP server works on whichever .pen file is open in the app
  3. In headless pen interactive, call save() before exit(), and keep --in and --out on different paths to preserve the source
  4. Check that an export file exists. The docs say an export failure can print an error without a nonzero exit status
  5. In CI set PEN_CLI_KEY plus a provider key such as ANTHROPIC_API_KEY. Run pen version, since pen --version is not a flag

Subframe

  1. Connect with an MCP client that supports OAuth. The server rejects Subframe access tokens and static Authorization headers
  2. Pass projectId on every call. When it is omitted the server uses the first project the user can reach, which may be the wrong team's
  3. After design_page, design_component or edit_component, call wait_for_jobs with the jobId before reading the result. Earlier reads return stale content
  4. Ask the owner before any delete tool or a theme token deletion. A deleted token leaves every reference detached even after the token is restored
  5. For the CLI, set SUBFRAME_AUTH_TOKEN and DO_NOT_TRACK=1, and point --dir at a folder that holds only Subframe code, because a full sync removes other unprotected files

Questions

Which is better for AI agents, pen.dev or Subframe?

pen.dev scores 47.6 (D) on agent readiness against Subframe's 39.7 (E), and leads in 4 of 7 scored categories. Subframe leads on security & auth and maintenance & community.

Do pen.dev and Subframe need an API key?

Both take an API key or an OAuth sign-in.

Can an agent call pen.dev and Subframe without installing anything?

pen.dev runs on your own machine, with no hosted endpoint listed. Subframe has a hosted endpoint at https://mcp.subframe.com/mcp.

Other comparisons with pen.dev or Subframe

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.