Head to head · Design components · October 2026 research run

Astryx vs Subframe

Astryx scores 71.7 (BB) on agent readiness against Subframe's 40.2 (E), and leads in every scored category. Both do design components.

Best design workspace and canvas APIs for AI agents · All 162 design comparisons

Which one, for what

Astryx BB

Best for Coding agents building React 19 interfaces that want a component library they can query for props, templates and themes.

Ahead on

  • Reliability, 62 against 19
  • Schema & documentation, 90 against 50
  • Agent ergonomics, 65 against 47
  • Security & auth, 61 against 47
  • Payments & pricing, 90 against 50
  • Maintenance & community, 75 against 65

Also in its favour

  • Agent-ready, a grade of BB or better
  • No key needed to call it
  • Runs on your own machine
  • Open source
  • No incidents deducted, where Subframe loses 5 points for them

Watch for

Version 0.7.x and called a beta in the README and on the home page. Charts are published only under the canary tag

Subframe E

Best for A coding agent working beside a team that designs React and Tailwind interfaces in Subframe and wants the design as code, with a read-only route for review.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

67 tools are documented with no toolsets, and since 5 November 2026 no public file gives their input parameters

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability Astryx +43

Astryx 62

Scored as a local package, since the owner runs it. Official npm packages with Node 22.13 or later and React 19 or later stated (20). A public CI workflow runs tests, builds and accessibility audits on pull requests and the merge queue, but run results on main weren't read (15 of 25). The repository had 348 open issues on 18 November 2026. The 25 newest, opened 16 to 18 November, are nearly all bug reports, many with a lane label and 14 with a reply, so bugs arrive and get sorted quickly but the open count is high (12 of 25). Per-package changelogs mark breaking changes under their own heading and ship codemods for them (15). Version 0.7.x, called a beta in the README and on the home page (0). Total 62.

Subframe 19

Read with the hosted lines, because the surface an agent uses is the MCP server at mcp.subframe.com. No status page is linked from the site, the docs or the new changelog (0 of 20). With no page there is no incident history to read (5 of 30). No rate limit is published in the docs or the skill files (0 of 15). No 429 or backoff guidance was found. The docs say a background job that stops reporting for about 10 minutes is returned as error, and the CLI retries a failed request once (4 of 15). No SLA is published, and the terms say the service is not warranted to be uninterrupted (0 of 10). The MCP server carries no beta label (10 of 10).

Schema & documentation Astryx +40

Astryx 90

MCP reading. Every tool has a JSON Schema input built from the CLI's own command definitions, with additionalProperties: false (25). The CLI serves agent-ready Markdown docs through astryx docs, and https://astryx.atmeta.com/llms.txt tells agents to use the CLI instead of crawling the site (10). The server instructions explain the tool naming rule and the mcp command doc says when an agent should run the CLI instead, but tool descriptions are the commands' own descriptions, written for the CLI (15 of 20). Option choices become enums and required arguments are marked, though most inputs are plain strings (12 of 15). Each command documents examples and exit codes, and errors carry one of 83 codes (13 of 15). Tagged releases and per-package changelogs (15). Total 90.

Subframe 50

The MCP server is closed, so the tool definitions and their input schemas were not read. Partial credit for a contract that exists but isn't public, as for Honeycomb (12 of 25). The docs list 67 tools by name, one line each, and since 5 November 2026 the skill files carry workflow guidance only, with no tool parameters. docs.subframe.com publishes llms.txt and a Markdown twin of each page (10 of 10). The design skill still says when to use each kind of tool, for example create_page and edit_page against design_page, which spends AI credits, and update_node_styles against edit_page (15 of 20). Only projectId, jobId and the job states are named in public docs (2 of 15). Example prompts and a troubleshooting section, with no list of error responses (7 of 15). A public dated changelog at subframe.com/changelog runs from 7 October 2026 with entries that name the MCP server, and the CLI and plugin carry semver versions, but the hosted server publishes no version, so the earlier partial is held (4 of 15).

Payments & pricing Astryx +40

Astryx 90

Free self-hosted software with nothing to buy, so 30 + 30 + 30. No payment protocol (0). Total 90.

Subframe 50

No machine payment protocol (0 of 40). Plan prices are public, Free at $0 and Pro at $20 an editor a month, with AI credits described only as limited and 6x and no per-call price (10 of 20). The Free plan has one project and includes MCP and CLI access, and the docs mention a card only at the Stripe checkout for Pro (20 of 20). A person has to sign in through a browser to approve OAuth. A client can register itself with the authorisation server and a connected agent can mint a CLI token with generate_auth_token, which earns 3 (3 of 20). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 33 is 50.

Agent ergonomics Astryx +18

Astryx 65

Read from source, not from a run. The local server lists 31 tools (5), with 10 back for --docs-only, a nine-tool read-only subset (15 of 25). --limit on search, build and discover, a domain filter on search, and --detail and --dense to size answers, but no paging (16 of 20). A failing command returns its JSON error with isError, and errors carry codes and suggested fixes (18 of 20). No readOnlyHint or destructiveHint annotations. Template, swizzle and theme writes refuse to overwrite without --overwrite, and integration add has --dry-run (8 of 20). Few required inputs, but JavaScript only (8 of 15). Total 65.

Subframe 47

67 documented tools is over 30 (5), with 3 added back because a Viewer account gets a read-only server. No toolsets or dynamic loading are documented. The design skill is now about 6 KB (8 of 25). list_comments can be scoped to a page, a canvas or the project, screenshots can target one element or breakpoint and read_prototype_file returns one file. No paging is documented (10 of 20). wait_for_jobs reports running, done, error or not_found, theme token deletes are refused unless a replacement is named, and the skill tells agents to read parser warnings and applied results. The CLI prints a JSON error envelope (13 of 20). No idempotency keys. Tool annotations could not be read. Version history can restore (8 of 20). An omitted projectId uses the only project the user can reach and otherwise asks for one. No API SDK (8 of 15).

Security & auth Astryx +14

Astryx 61

Local software with no credentials, so the middle band, as for other keyless local tools (20). --docs-only drops every input that names a folder, a file to write or a package, cwd is held inside the served folder, and gap-report won't file a public GitHub issue without --confirm-public. Other writes have no approval step (14 of 20). Most tools return Astryx's own docs, but theme add downloads shared themes from https URLs and blog fetches remote text, with no prompt-injection guidance found (7 of 15). debug hands package authors a record of each CLI run, with no operator audit log (5 of 15). SECURITY.md routes reports to Meta's bug bounty, and npm releases use trusted publishing with provenance. astryx.atmeta.com serves no security.txt (15 of 20). Total 61.

Subframe 47

The MCP server uses OAuth with dynamic client registration, PKCE and refresh tokens, per the discovery documents read on 9 October, and rejects Subframe access tokens. The authorisation server lists only identity scopes, so access follows the user's team role and not a scope. CLI tokens are shown once and can be deleted, with no scopes or expiry documented, and the generate_auth_token tool lets a connected agent mint one (22 of 30). Viewers get a read-only MCP server. Confirmation before deletes is guidance in the skill file and not a documented server control (12 of 20). list_comments, design documents and search_docs return text other people wrote, and no prompt-injection guidance was found (3 of 15). No audit log is documented. Version history records changes for 24 hours on Free and 7 days on Pro (3 of 15). A SECURITY.md added on 10 November 2026 routes reports through GitHub private vulnerability reporting and promises an acknowledgement with no stated time, for the CLI, the core package, the plugin, skills and starter kits. No security.txt, bug bounty or certification was found (7 of 20).

Maintenance & community Astryx +10

Astryx 75

v0.7.16 tagged on 13 November 2026, five days before this check, with commits on main on 18 November (30). Five or more releases in the last 90 days, including v0.7.10 on 6 November and v0.7.13 to v0.7.16 from 10 to 13 November (20). 348 open issues and 704 open pull requests on 18 November. Of the 25 newest issues, opened 16 to 18 November, 14 had a reply and many carried a lane label (15 of 25). No Astryx entry in the official MCP registry, searched for astryx and astryxdesign on 18 November (0 of 15). Dependabot, a pinned pnpm lockfile and CI workflows (10). Total 75.

Subframe 65

The public changelog dates MCP changes on 5 November 2026 (agents create and edit components directly over MCP), 29 October, 28 October, 26 October, 21 October (projects over MCP), 20 October (image uploads over MCP) and 19 October, and the Claude Code plugin reached 1.2.10 on 6 November 2026 (30 of 30). Far more than three dated changes fall inside the 90 days from 12 August (20 of 20). Issues were not re-read, because GitHub's pages refuse our reader; per the 9 October check, seven of 13 issues were open with sparse replies, and pull requests merge most days (10 of 25). No readable official MCP registry entry (0 of 15). Pull-request CI that lints, type-checks and tests was added on 10 November 2026 with Dependabot, and a 6 November commit updated dependencies to close critical alerts. No CI result could be read (5 of 10).

Score by category

CategoryWeightAstryxSubframeEdge
Reliability16%6219Astryx +43
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%9050Astryx +40
Agent ergonomics13%6547Astryx +18
Security & auth14%6147Astryx +14
Payments & pricing10%9050Astryx +40
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%7565Astryx +10
Transparency & trust7%6463Astryx +1
Negative events≤150-5
TotalBB 71.7/100E 40.2/100

Facts side by side

FactAstryxSubframe
KindSDK + MCPMCP server
VendorMetaAtomic Design Inc
Hosted endpointhttps://astryx.atmeta.com/mcphttps://mcp.subframe.com/mcp
Transportsstdio, Streamable HTTPHTTP
AuthNoneOAuth or key
PricingFreeFreemium
x402nono
LicenceMITProprietary service under Atomic Design's terms of service. The public repository, @subframe/cli, @subframe/core and the Claude Code plugin carry an MIT licence, added on 10 November 2026 (the package files said ISC before)
Tools exposed3167
Read-only variant documentedyesyes
llms.txtyesyes
Last release2026-11-132026-11-06
Terms last updatedno document linked2026-01-22
Privacy policy last updatedno document linked2026-01-22
Customer content may train modelsnot read yetnot found in the text
Terms restrict automated accessnot read yetnot found in the text
Terms restrict benchmarkingnot read yetnot found in the text
Terms or service can change without noticenot read yetnot found in the text
Arbitration or class-action waivernot read yetnot found in the text
Popularity31k stars435 stars
Agent reviewsnone3/5 (4)

How the scores have moved

Verdicts

Astryx

Astryx gives a coding agent typed MCP tools to search components, read docs and build themes, with no account and an MIT licence, and Meta tagged four releases from 10 to 13 November 2026. It is a 0.x beta, and its local server lists 31 tools with no read-only or destructive hints and no approval step for file writes.

Subframe

An agent can read and change pages, components, snippets and themes in a Subframe project through a hosted MCP server with OAuth, and Viewer accounts get a read-only server. The server lists 67 tools whose input schemas aren't public, and no status page, rate limits or SLA were found. The CLI calls identified usage events anonymous.

Before you call either

Astryx

  1. Run astryx directly when you can run commands. Use astryx mcp only from a client that reaches tools through MCP
  2. Use astryx mcp --docs-only or https://astryx.atmeta.com/mcp when you only need to look things up, since those tools can't write files
  3. Pass --limit to search, build and discover, and --detail or --dense, to keep answers small
  4. Before theme add from a URL, check the source, because a shared theme is downloaded and installed into the project
  5. Read the code in a failed tool's JSON error and follow its suggested fix before retrying

Subframe

  1. Connect with an MCP client that supports OAuth. The server rejects Subframe access tokens and static Authorization headers
  2. Pass projectId on every call. When it is omitted and the user can reach several projects, the tool asks for one instead of acting
  3. Write pages and components with create_page, edit_page, create_component and edit_component. The design_* tools spend Subframe AI credits even on a Claude or Codex subscription
  4. After a design_* tool, call wait_for_jobs with the jobId before reading the result. Earlier reads return stale content
  5. For the CLI, set SUBFRAME_AUTH_TOKEN and DO_NOT_TRACK=1, and point --dir at a folder that holds only Subframe code, because a full sync removes other unprotected files

Questions

Which is better for AI agents, Astryx or Subframe?

Astryx scores 71.7 (BB) on agent readiness against Subframe's 40.2 (E), and leads in every scored category.

Can an agent call Astryx and Subframe without installing anything?

Yes. Astryx has a hosted endpoint at https://astryx.atmeta.com/mcp and Subframe at https://mcp.subframe.com/mcp.

Are Astryx and Subframe open source?

Astryx is open source (MIT). No open-source release is listed for Subframe.

Other comparisons with Astryx or Subframe

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.