{ "data": { "a": { "slug": "axlr", "name": "AXLR", "vendor": "Underpass AI", "vendorUrl": "https://axlr.underpassai.com", "kind": "harness", "category": "agent-harnesses", "summary": "Open-source Go execution engine for agentic work from Underpass AI. A console with work modes and approval cards, an mTLS HTTP, gRPC and MCP service, a JSON worker and a Go library, with KMP memory and MADE procedures over MCP.", "url": "https://www.anchorterminal.com/tools/axlr", "markdownUrl": "https://www.anchorterminal.com/tools/axlr.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/axlr.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/axlr.json", "dns": "axlr.grade.anchorterminal.com", "repo": "https://github.com/underpass-ai/AXLR", "license": "Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder", "transports": [], "packages": [ { "registry": "go", "name": "github.com/underpass-ai/AXLR" }, { "registry": "oci", "name": "ghcr.io/underpass-ai/axlr" }, { "registry": "oci", "name": "ghcr.io/underpass-ai/charts/axlr" } ], "auth": "mixed", "authNotes": "The console and the one-command `axlr-tui --exec` need a model route, an OpenRouter key (`OPENROUTER_API_KEY` or `credentials.json`, mode 0600), a local OpenAI-compatible server, or an Anthropic Messages or OpenAI Responses key in a `local_models` entry; the JSON worker and the library tests need no model account. The service, `axlr-serve`, requires TLS 1.3 and a client certificate signed by its CA whose SHA-256 fingerprint is mapped in a private principals file to a principal and the roles `session_client`, `approver`, `tool_operator` and `admin`; an unmapped certificate is forbidden, a session belongs to the principal that created it, and authentication never approves a tool by itself. MCP at `/mcp` is stateless and authenticated per request by the same certificate; gRPC uses the TLS peer certificate.", "pricing": "free", "pricingNotes": "Free and open source under Apache-2.0, with nothing to buy from Underpass AI. You pay your model provider (OpenRouter reports a cost per request, which the console's `/usage` and `max_session_usd` track) or run a local server at no charge; TypeSafe's Jev judge is optional and needs its own key. No hosted AXLR exists (checked 2026-11-01).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the repository, the OpenAPI file or the two sites (checked 2026-11-01). Nothing is sold.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 0, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-11-01" }, "docsUrl": "https://axlr.underpassai.com/docs/", "openapi": "https://github.com/underpass-ai/AXLR/blob/main/api/openapi/axlr-v1.yaml", "capabilities": [ "agent.harness", "agent.mcp-client", "agent.multi-agent" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "go", "cli", "mcp-client", "openapi", "grpc", "docker", "helm", "sandbox", "approvals", "pre-1.0", "new" ], "lastRelease": "2026-10-25", "graded": true, "anchor": { "graded": true, "score": 70.6, "grade": "BB", "agentReady": true, "rank": 168, "ranked": true, "rankOf": 1253, "categoryRank": 3, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 83, "maintenance": 79, "payments": 60, "reliability": 70, "schema": 80, "security": 62, "transparency": 55 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-01" }, "negative": 0, "verdict": "A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.", "bestFor": "A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.", "strengths": [ "mTLS HTTP, gRPC and MCP service with four principal roles, `Idempotency-Key` required on turns, approvals and direct calls, and `expected_revision` on decisions", "A policy (observe, propose, act-with-approval, act-within-policy), a budget in seconds, requests, tool calls and dollars, and a bubblewrap or container sandbox with an enforced egress allow list, each per execution", "`axlr-tui --exec --json` runs one task headless and ends with a result object; exit 0 done, 3 waiting for a decision, 1 error", "OpenRouter, local OpenAI-compatible servers (llama.cpp, vLLM, Ollama, LM Studio), and the Anthropic Messages and OpenAI Responses APIs spoken directly", "21 releases in October 2026 from a workflow that tests on six native runners and refuses to republish different bytes, with a `.sha256` beside every archive" ], "weaknesses": [ "The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list", "Pre-1.0 with one maintainer, 0 stars and 10 open issues, all the founder's own trackers; releases have empty notes and there is no changelog", "The service needs KMP and MADE as remote gRPC services, a client CA and a principals file before a first session, and has no work modes, plugins or forged-tool setting yet", "No SECURITY.md, security.txt, advisories or disclosure route; the legal entity is not yet incorporated and no terms or privacy policy exist", "No llms.txt, and the Go library is the only SDK; the catalog registry answers every non-AXLR client with 403" ], "agentNotes": [ "Before the first prompt, set `approvals.autonomous` to false or run with `--approve none`, and turn `exec_sandbox.mode` to `auto` or `required` on Linux; after setup both default the other way", "Drive a run with `axlr-tui --exec --json --policy \u003cfile\u003e --budget \u003cfile\u003e --sandbox \u003cfile\u003e` and read only the last `result` line; exit 3 means a call waits for `--decide approve|deny` with `--session \u003cid\u003e`", "On the service, send `Idempotency-Key` (16 to 128 safe ASCII characters) on every turn, approval and direct call, and pass the session's `expected_revision`; a reused key with a different body answers 409", "A local model must return native tool calls (llama.cpp with `--jinja`, vLLM with `--enable-auto-tool-choice`); set `context_tokens` on the entry and `OLLAMA_CONTEXT_LENGTH` for Ollama", "Leave `TYPESAFE_API_KEY` unset unless you want the setup assistant to switch Jev on, which sends requests and final answers to TypeSafe" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "BB", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 70.6 } ], "editorialScores": { "ergonomics": 83, "maintenance": 79, "payments": 60, "reliability": 70, "schema": 80, "security": 62, "transparency": 68 }, "provenanceScore": 42, "checked": { "categories": { "ergonomics": "2026-11-01", "maintenance": "2026-11-01", "payments": "2026-11-01", "reliability": "2026-11-01", "schema": "2026-11-01", "security": "2026-11-01", "transparency": "2026-11-01" }, "last": "2026-11-01", "oldest": "2026-11-01", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "V=v0.15.0; OS=linux; ARCH=amd64; curl -fsSLO https://github.com/underpass-ai/AXLR/releases/download/$V/axlr-$V-$OS-$ARCH.tar.gz{,.sha256} \u0026\u0026 sha256sum -c axlr-$V-$OS-$ARCH.tar.gz.sha256 \u0026\u0026 tar xzf axlr-$V-$OS-$ARCH.tar.gz -C ~/.local/bin axlr axlr-tui axlr-serve # or build from source with Go 1.26", "headless": { "command": "axlr-tui --root \"$PWD\" --exec \"$TASK\" --json --approve none --policy policy.json --budget budget.json --sandbox sandbox.json", "decide": "axlr-tui --session \u003cid\u003e --decide approve --json", "env": { "OPENROUTER_API_KEY": "\u003ckey\u003e" } } }, "letme": { "capability": "https://letme.dev/agent.harness", "tool": "https://letme.dev/axlr" }, "area": "frameworks", "provenance": { "legalEntity": "", "domain": "underpassai.com", "domainRegistered": "2025-08-10", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/underpass-ai/AXLR/releases", "securityTxt": "none", "checked": "2026-11-01", "notes": [ "No legal entity exists yet. underpassai.com's footer says Underpass AI is a startup project created by Tirso García Ibáñez and preparing incorporation as a Spanish limited liability company, that the technical assets are founder-owned and intended to be assigned to the company after incorporation, and that licence terms are in each repository's LICENSE and NOTICE. The NOTICE names Tirso García Ibáñez as copyright holder. Recorded as absent with that explanation.", "No terms of service or privacy policy on underpassai.com (sitemap lists the home page and one article) or axlr.underpassai.com. For local software the docs' 'Where data goes' and 'Diagnostics and privacy' sections stand in.", "RDAP for underpassai.com gives registration on 2025-08-10 with Route 53 nameservers. The GitHub organisation underpass-ai was created on 2025-08-09, location Spain, 16 public repositories. The AXLR repository was created on 2026-09-29; the first tag and release, v0.1.0, is dated 2026-10-04, which is firstReleased.", "https://underpassai.com/.well-known/security.txt and https://axlr.underpassai.com/.well-known/security.txt answer 404; the repository has no SECURITY.md. No status page (local software). The changelog is the GitHub releases list, whose entries carry no notes.", "robots.txt on underpassai.com and axlr.underpassai.com allow everything. registry.underpassai.com answers every path, robots.txt included, with 403 'forbidden: client is not AXLR', so nothing was read from it after that reply.", "The founder's LinkedIn URL is linked from underpassai.com and was not visited." ], "score": 42 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/axlr.json" }, "answer": "AXLR scores 70.6 (BB) on agent readiness against Devin's 55.8 (C), and leads in 4 of 7 scored categories. Devin leads on security \u0026 auth and transparency \u0026 trust.", "b": { "slug": "devin", "name": "Devin", "vendor": "Cognition AI, Inc.", "vendorUrl": "https://devin.ai", "kind": "harness", "category": "agent-harnesses", "summary": "Devin is Cognition's hosted coding agent. It works in its own cloud virtual machine to plan, edit code, run commands and open pull requests. Outside agents start and steer sessions through a REST API and a remote MCP server.", "url": "https://www.anchorterminal.com/tools/devin", "markdownUrl": "https://www.anchorterminal.com/tools/devin.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/devin.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/devin.json", "dns": "devin.grade.anchorterminal.com", "license": "Proprietary service under Cognition's Platform Terms of Service", "transports": [ "http" ], "remoteUrl": "https://mcp.devin.ai/mcp", "packages": [], "auth": "api-key", "authNotes": "A Bearer token with the `cog_` prefix on every request to https://api.devin.ai/v3. Service-user keys are provisioned by a person in Settings \u003e Devin API, shown once, and carry a role (Admin or Member on Teams, custom roles on Enterprise). Personal access tokens act as the user who made them and can expire. Legacy `apk_` keys work only with the deprecated v1 and v2 APIs. The MCP server takes the same keys, and enterprise keys and personal tokens add an `X-Org-Id` header. Access is self-serve, with no app review or sales approval for Teams.", "pricing": "freemium", "pricingNotes": "Free $0, Pro $20 a month, Max $200 a month, Teams $80 a month minimum with full seats at $40 each, Enterprise by quote (devin.ai/pricing, checked 2026-10-08). Paid plans include a daily or weekly usage quota, then prepaid on-demand credits described as usage at API pricing, with no unit rate on the page. The pricing page lists cloud agents from Pro upward, while the docs say Free includes limited Devin usage. Whether the API works on Free, and whether signup needs a card, wasn't established.", "priceSummary": "$20 / mo", "where": "hosted", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs index, the v3 OpenAPI spec or the pricing page (checked 2026-10-08).", "endpoints": [] }, "toolCount": 13, "popularity": { "githubStars": null, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-08" }, "docsUrl": "https://docs.devin.ai", "llmsTxt": "https://docs.devin.ai/llms.txt", "openapi": "https://docs.devin.ai/v3-openapi.yaml", "capabilities": [ "agent.harness", "agent.mcp-client", "agent.multi-agent" ], "tags": [ "hosted", "cloud-agent", "closed-source", "api-key", "rbac", "openapi", "llms-txt", "mcp", "status-page", "soc2", "freemium" ], "lastRelease": "2026-10-07", "graded": true, "anchor": { "graded": true, "score": 55.8, "grade": "C", "agentReady": false, "rank": 783, "ranked": true, "rankOf": 1253, "categoryRank": 32, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 62, "maintenance": 63, "payments": 20, "reliability": 30, "schema": 80, "security": 72, "transparency": 70 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-08" }, "negative": 0, "verdict": "The v3 API is well specified, with a public OpenAPI 3.1 file covering 239 operations, problem+json errors, cursor pagination and service-user keys tied to roles. The status page records three critical and several major incidents on the cloud agent between 22 July and 24 September 2026, and no rate limit figures or retry guidance were found in the reviewed documentation.", "bestFor": "A team that wants to hand whole tasks to a cloud agent and collect pull requests, driven from a pipeline or another agent.", "strengths": [ "Public OpenAPI 3.1 spec for the v3 API with 239 operations, each declaring 401, 403, 404, 409, 422 and 429 responses in RFC 9457 problem+json", "Service-user keys carry a role, every endpoint except GET /v3/self names the permission it needs, and audit logs list service users separately from people", "Security profiles can limit a session to a network allowlist, an MCP server allowlist, read-only git and a read-only Devin MCP", "Remote MCP server at mcp.devin.ai/mcp with 13 documented tools for sessions, playbooks, knowledge, schedules and repository documentation", "Dated release notes several times a week, the newest on 7 October 2026, and a separate API release notes page" ], "weaknesses": [ "www.devinstatus.com lists three critical incidents (22 July, 13 August, 24 September 2026) and six major ones on the cloud agent or web app since 10 July 2026", "No rate limit figures, Retry-After or backoff guidance found in the API docs, and v3 session creation has no idempotency key", "Customer data may be used for model training by default on self-serve plans. The opt-out is for paid plans only, per section 3.3.1 of the platform terms", "A person must sign up and provision the service user in the web app. No key-creation route exists for an agent starting from nothing", "No official SDK found, and the Devin MCP server was not found in the official MCP registry" ], "agentNotes": [ "Use a `cog_` service-user key with the Member role. Legacy `apk_` keys fail against v3 and the MCP server with 401 or 403", "Set `max_acu_limit` on every session you create. Usage is metered by the work done and has no published unit rate", "Session creation is not idempotent in v3. After a timeout, list sessions by tag before creating again", "Enterprise keys and personal access tokens must send `X-Org-Id` to the MCP server. Organisation-scoped keys resolve it automatically", "Create scheduled work as an automation. POST to the schedules endpoint returns 403 for migrated organisations since 24 September 2026" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 55.8 } ], "editorialScores": { "ergonomics": 62, "maintenance": 63, "payments": 20, "reliability": 30, "schema": 80, "security": 72, "transparency": 61 }, "provenanceScore": 78, "checked": { "categories": { "ergonomics": "2026-10-08", "maintenance": "2026-10-08", "payments": "2026-10-08", "reliability": "2026-10-08", "schema": "2026-10-08", "security": "2026-10-08", "transparency": "2026-10-08" }, "last": "2026-10-08", "lastMoved": "2026-10-28", "oldest": "2026-10-08", "stale": false, "staleAfterDays": 90 } }, "connect": { "http": "curl -X POST \"https://api.devin.ai/v3/organizations/$DEVIN_ORG_ID/sessions\" -H \"Authorization: Bearer $DEVIN_API_KEY\" -H \"Content-Type: application/json\" -d '{\"prompt\": \"Create a simple Python script that prints Hello World\"}'", "config": { "mcpServers": { "devin": { "headers": { "Authorization": "Bearer \u003cAPI_KEY\u003e", "X-Org-Id": "\u003cYOUR_ORG_ID\u003e" }, "serverUrl": "https://mcp.devin.ai/mcp" } } } }, "letme": { "capability": "https://letme.dev/agent.harness", "tool": "https://letme.dev/devin" }, "area": "frameworks", "unitPrices": [ { "item": "Pro plan", "unit": "month", "usd": 20, "note": "one user, daily and weekly usage quota" }, { "item": "Max plan", "unit": "month", "usd": 200, "note": "one user, larger weekly quota" }, { "item": "Teams full seat", "unit": "seat-month", "usd": 40, "note": "$80 a month minimum per team, flex seats free and billed from shared credits" } ], "provenance": { "legalEntity": "Cognition AI, Inc.", "domain": "devin.ai", "domainRegistered": "2022-12-06", "endpointOnVendorDomain": true, "terms": "https://cognition.com/legal/platform-terms-of-service", "privacy": "https://cognition.com/legal/privacy-policy", "statusPage": "https://www.devinstatus.com", "changelog": "https://docs.devin.ai/release-notes/overview", "securityTxt": "none", "checked": "2026-10-08", "notes": [ "The Platform Terms of Service (last updated 30 June 2026) name Cognition AI, Inc. and govern the Cognition Platform for customers who register and use the services. Enterprise customers sign separate Enterprise Terms of Service.", "The privacy policy (last updated 9 March 2026) names Cognition AI, Inc and covers Devin and Windsurf as well as cognition.com. The data processing agreement gives the address 550 Third Street, San Francisco, CA 94107.", "devin.ai, cognition.com and api.devin.ai all return 404 for /.well-known/security.txt. The docs give security@cognition.ai for vulnerability reports.", "The API answers at api.devin.ai and the MCP server at mcp.devin.ai. status.devin.ai redirects to www.devinstatus.com.", "RDAP for devin.ai gives a registration date of 2022-12-06." ], "score": 78 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/devin.json", "live": { "slug": "devin", "probe": { "target": "https://mcp.devin.ai/mcp", "method": "get", "lastAt": "2026-11-01T22:08:27.962701537Z", "lastOk": true, "lastStatus": 401, "lastMs": 448, "lastNote": "asks for credentials", "authRequired": true, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 453, "p95ms24h": 558, "samples24h": 250, "samples30d": 6064, "days": [ { "date": "2026-10-08", "probes": 70, "ok": 70 }, { "date": "2026-10-09", "probes": 250, "ok": 250 }, { "date": "2026-10-10", "probes": 247, "ok": 247 }, { "date": "2026-10-11", "probes": 247, "ok": 247 }, { "date": "2026-10-12", "probes": 247, "ok": 247 }, { "date": "2026-10-13", "probes": 248, "ok": 248 }, { "date": "2026-10-14", "probes": 249, "ok": 249 }, { "date": "2026-10-15", "probes": 253, "ok": 253 }, { "date": "2026-10-16", "probes": 252, "ok": 252 }, { "date": "2026-10-17", "probes": 253, "ok": 253 }, { "date": "2026-10-18", "probes": 256, "ok": 256 }, { "date": "2026-10-19", "probes": 255, "ok": 255 }, { "date": "2026-10-20", "probes": 252, "ok": 252 }, { "date": "2026-10-21", "probes": 253, "ok": 253 }, { "date": "2026-10-22", "probes": 253, "ok": 253 }, { "date": "2026-10-23", "probes": 248, "ok": 248 }, { "date": "2026-10-24", "probes": 251, "ok": 251 }, { "date": "2026-10-25", "probes": 250, "ok": 250 }, { "date": "2026-10-26", "probes": 252, "ok": 252 }, { "date": "2026-10-27", "probes": 249, "ok": 249 }, { "date": "2026-10-28", "probes": 251, "ok": 251 }, { "date": "2026-10-29", "probes": 248, "ok": 248 }, { "date": "2026-10-30", "probes": 249, "ok": 249 }, { "date": "2026-10-31", "probes": 251, "ok": 251 }, { "date": "2026-11-01", "probes": 230, "ok": 230 } ] }, "vendorStatus": { "page": "https://www.devinstatus.com", "indicator": "none", "summary": "All Systems Operational", "checkedAt": "2026-11-01T22:09:03.261000135Z" }, "securityTxt": { "url": "https://devin.ai/.well-known/security.txt", "state": "none", "checkedAt": "2026-11-01T15:42:39.125763146Z" }, "llmsTxt": { "url": "https://docs.devin.ai/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-11-01T15:13:34.688906215Z" }, "domain": { "domain": "devin.ai", "registered": "2022-12-06", "source": "https://rdap.identitydigital.services/rdap/domain/devin.ai", "checkedAt": "2026-11-01T14:10:10.140023192Z" }, "pages": [ { "url": "https://docs.devin.ai/release-notes/overview", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-01T06:41:28.629619893Z", "changedAt": "2026-10-30T05:37:10.416674334Z", "fingerprint": "b88ae6d3291b" }, { "url": "https://cognition.com/legal/privacy-policy", "kind": "privacy", "status": 200, "checkedAt": "2026-11-01T06:37:55.092079157Z", "changedAt": "2026-10-27T03:40:45.211757948Z", "fingerprint": "c7ff7ef6261d" }, { "url": "https://cognition.com/legal/platform-terms-of-service", "kind": "terms", "status": 200, "checkedAt": "2026-11-01T06:37:53.062866817Z", "changedAt": "2026-10-27T03:40:42.911014275Z", "fingerprint": "5b2f0650a5cf" } ], "updatedAt": "2026-11-01T22:09:03.261000135Z" } }, "edges": [ { "by": 40, "category": "reliability", "leads": "axlr", "name": "Reliability", "reasons": { "a": "Read as a local package, as claude-code, goose, opencode and openhands were. Release archives for Linux, macOS and Windows on amd64 and arm64 with a `.sha256` beside each, a GHCR image, an OCI Helm chart and source builds with Go 1.26, all stated in the docs; no Homebrew, npm or apt route (20). CI on main runs vet, race tests and a coverage gate above 80 per cent for both modules, with the sandbox tests required under bubblewrap, and the last ten runs on main to 1 November 2026 all passed; the release workflow tests on six native runners (25). 10 open issues, all opened by the founder on 19 and 21 October 2026 as trackers for service work (work modes, plugins, the sandbox setting, cost limits), none from an outside user and none a crash report, 0 open pull requests and about 100 merged; with 0 stars there is nobody else to report, so the handling of outside reports is untested (20). Tags are semver 0.x and the docs date each behaviour change inline (\"until 14 October 2026…\"), but the 21 releases have empty notes, there is no CHANGELOG.md, and the product contract records one retirement (the seven 1.0 skill definitions on 5 October 2026) without a notice period (5). Pre-1.0, which the README calls an evolving project (0). 20+25+20+5+0 = 70.", "b": "Hosted reading. Status page at www.devinstatus.com with 14 components and incident history (20). In the 90 days to 8 October 2026 it lists three critical incidents (22 July, 43 minutes of platform-wide queuing, 13 August, Devin Cloud unavailable for 2 hours 40 minutes, 24 September, the web app down for 2 hours) and six major ones on session start-up, so several majors (0). 429 is a documented response, but no rate limit figures were found (0). No Retry-After or backoff guidance found, and v3 session creation has no idempotency key, although the legacy v1 API had one (0). The platform terms supply the service as is with no service level, and enterprise terms weren't read (0). The v3 API is the current, recommended surface, with 44 of 239 operations marked beta under /v3beta1 (10)." }, "scores": { "a": 70, "b": 30 } }, { "by": 40, "category": "payments", "leads": "axlr", "name": "Payments \u0026 pricing", "reasons": { "a": "No payment protocol (0). Free and Apache-2.0 with nothing to buy, so 20, 20 and 20 on the last three lines by the self-hosted rule, since the docs say what you pay your model provider, the free route needs no card, and it runs local models with no signup at all, the JSON worker without any model. 0+20+20+20 = 60.", "b": "Published rubric. No payment protocol (0). Plan prices are public, $20, $200 and $40 a seat with an $80 team minimum, but usage past the quota is billed at an unpublished rate (10). A Free plan exists. The pricing page lists cloud agents from Pro upward, and we couldn't confirm API use on Free or whether a card is needed (10). A person signs up in a browser and provisions the service user in settings (0)." }, "scores": { "a": 60, "b": 20 } }, { "by": 21, "category": "ergonomics", "leads": "axlr", "name": "Agent ergonomics", "reasons": { "a": "Harness reading of the framework line, scored on what a program driving it has to supply. Six local tools plus the host's bookkeeping tools; work modes and an execution policy hide the tools a run may not use, `axlr_catalog` searches the catalog instead of loading it, forged tools keep the request prefix for the prompt cache, and a context cap of 75,000 prompt tokens opens a successor session (20). `local_read`, `local_search` and `local_list` page with `offset`, `next_offset` and `max_bytes`; `StreamEvents` takes `after`, `max_events` (1 to 256) and `wait_ms`; a budget per execution in seconds, requests, tool calls and dollars; 32 tool calls a turn and `max_session_usd` (20). The `--exec` run ends in one `result` line with a status, the pending call, every call's outcome and the usage, and exits 0, 3 or 1; service errors carry codes an agent can act on; a budget stop says which limit (`budget: requests 20 reached`) and leaves the session resumable (16). `Idempotency-Key` on every turn, approval and direct call with cross-transport replay, `expected_revision` on decisions, `expected_sha256` on worker writes, and an interrupted effectful call left `uncertain` for an operator rather than retried (19). One command runs a task, but the first launch needs an OpenRouter key or a local server, the service needs a CA, a principals file and remote KMP and MADE before a first session, and the only SDK is the Go library (8). 20+20+16+19+8 = 83.", "b": "API and MCP reading. The MCP server documents 13 tools, several of them consolidated manage tools, and list endpoints take `first` to size a page (17). Cursor pagination on every v3 list endpoint and filters on session search by tag, playbook, origin, user and time (18). problem+json with `error_code`, field-level errors on 422 and a 400 that lists valid platform names, but no published code list (15). No idempotency key on v3 session creation. `max_acu_limit` caps what a session can spend, and the MCP tool annotations couldn't be read without a key (4). Only `prompt` is required to start a session. No official SDK found, only a Terraform provider (8)." }, "scores": { "a": 83, "b": 62 } }, { "by": 16, "category": "maintenance", "leads": "axlr", "name": "Maintenance \u0026 community", "reasons": { "a": "v0.15.0 on 2026-10-25, with commits on main to 2026-11-01 (30). 21 releases between 4 and 25 October 2026 (20). One maintainer (368 of 399 commits, the rest by two agent accounts), 10 open issues that are his own trackers with no comments, about 100 merged pull requests and no outside report to measure a reply against (15). Not in the MCP registry; the Go module and a proto to generate clients from are the only client code, beside the GHCR image and Helm chart (5). Go 1.26 toolchain pinned, release actions pinned by commit SHA, a go-licenses check that the third-party bundle matches the dependency graph, and CI passing on main (9). 30+20+15+5+9 = 79.", "b": "Closed service. Newest release note dated 7 October 2026 (30). Nineteen dated release notes between 7 August and 7 October 2026, and API notes for August and September (20). Public release notes and a support address, with no public tracker or forum found (10). No official SDK found and the Devin MCP server didn't appear in a search of the official MCP registry (0). No public CI or packages to assess, with the docs and three OpenAPI specs kept current (3)." }, "scores": { "a": 79, "b": 63 } }, { "by": 15, "category": "transparency", "leads": "devin", "name": "Transparency \u0026 trust", "reasons": { "a": "Apache-2.0 with a NOTICE (30). No privacy policy or terms on underpassai.com or axlr.underpassai.com; the docs' 'Where data goes' and 'Diagnostics and privacy' sections say that model requests go to OpenRouter, the local server or the native API, that Jev sends text to TypeSafe only when on, that sessions live under `$XDG_STATE_HOME/axlr`, that payload capture is off by default and redacted when on, and that traces are deleted after 30 days; nothing covers the engine downloads' or the catalog registry's handling of a client's requests (15). No deprecation policy; pre-1.0 changes are dated inline in the docs and the product contract records the 5 October 2026 retirement of the first skill catalogue after the fact (6). No telemetry to disclose, and the docs say in two places what leaves the machine and how to stop payload capture, though no single page says there is no telemetry (17). 30+15+6+17 = 68.", "b": "Editorial half. Closed source with clear terms from Cognition AI, Inc. (15). Terms, privacy policy, security page and data processing agreement agree with each other. Customer data may be used for model training by default on self-serve plans, with an opt-out on paid plans that also turns on zero data retention at model providers. Retention is stated as the length of the customer relationship, with no periods (18). Dated notices for the schedules endpoints (announced 10 September, creation refused from 24 September 2026) and the v2 clone endpoint, but no deprecation policy and no end date for v1 and v2 (10). Sub-processors listed with purpose and country, and 15 days' notice of additions (18)." }, "scores": { "a": 55, "b": 70 } }, { "by": 10, "category": "security", "leads": "devin", "name": "Security \u0026 auth", "reasons": { "a": "Harness reading of the framework checklist, as for the other four harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No product telemetry in the console source (the outbound hosts are openrouter.ai, api.anthropic.com, api.openai.com, a configured local server, api.github.com and github.com for engine downloads, and registry.underpassai.com for the signed catalog index) or in the docs; payload capture is off by default since 9 October 2026, traces omit prompts and credentials, model keys are never given to commands or plugins, and Jev sends requests and answers to TypeSafe only when on, which the setup assistant does when `TYPESAFE_API_KEY` is set, with a notice on stderr (27). Approval cards, a destructive list that always asks, four work modes, a policy level per execution, a bubblewrap or container sandbox with an enforced egress allow list, and a service that approves nothing but reads. Against that, the setup assistant writes `autonomous: true`, `exec_sandbox` is off by default, forged tools run with the person's rights, and the README says the console and worker are not sandboxes (13). Forged tools are refused when a file changes since the forge, a policy forbids calls outside the model, and the docs say MCP tools keep their own side effects, but no prompt-injection guidance was found and MCP results reach the model unmarked (6). The service keeps an event journal, audit records, a receipt with the SHA-256 of every call's arguments and outcome, and correlation ids on every event; the console keeps session records, a redacted app log and `/session` (14). No SECURITY.md, no security.txt on either host, no advisories, no bug bounty; release checksums and a minisign-signed catalog are integrity, not a programme (2). 27+13+6+14+2 = 62.", "b": "Hosted reading. Service-user keys with roles and named permissions per endpoint, revocable, with rotation endpoints in beta for Enterprise and expiring personal tokens. Custom roles are an Enterprise option, and Teams has Admin and Member only (25). Security profiles restrict network, MCP servers, git and the Devin MCP to read-only, and read-only API permissions exist. They are opt-in, and session creation accepts `bypass_approval` (16). AI Guardrails screen user messages and pull request comments for prompt injection, on Enterprise only, and they don't cover web pages or repository content Devin reads (8). Audit logs through the API need an enterprise-level permission. Session events and insights are available on all plans (10). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address at security@cognition.ai, no security.txt, and the trust centre answers No to having a bug bounty (13)." }, "scores": { "a": 62, "b": 72 } } ], "facts": [ { "a": "Agent harness", "b": "Agent harness", "name": "Kind" }, { "a": "Underpass AI", "b": "Cognition AI, Inc.", "name": "Vendor" }, { "a": "no (local only)", "b": "https://mcp.devin.ai/mcp", "name": "Hosted endpoint" }, { "a": "", "b": "HTTP", "name": "Transports" }, { "a": "OAuth or key", "b": "API key", "name": "Auth" }, { "a": "Free", "b": "Freemium", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder", "b": "Proprietary service under Cognition's Platform Terms of Service", "name": "Licence" }, { "a": "none", "b": "13", "name": "Tools exposed" }, { "a": "no", "b": "yes", "name": "Read-only variant documented" }, { "a": "no", "b": "yes", "name": "llms.txt" }, { "a": "2026-10-25", "b": "2026-10-07", "name": "Last release" }, { "a": "no document linked", "b": "2026-06-30", "name": "Terms last updated" }, { "a": "no document linked", "b": "2026-03-09", "name": "Privacy policy last updated" }, { "a": "not read yet", "b": "yes, with an opt-out", "name": "Customer content may train models" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "not read yet", "b": "yes", "name": "Terms restrict benchmarking" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "not read yet", "b": "yes", "name": "Arbitration or class-action waiver" }, { "a": "0 stars", "b": "none", "name": "Popularity" } ], "faq": [ { "answer": "AXLR scores 70.6 (BB) on agent readiness against Devin's 55.8 (C), and leads in 4 of 7 scored categories. Devin leads on security \u0026 auth and transparency \u0026 trust.", "question": "Which is better for AI agents, AXLR or Devin?" }, { "answer": "AXLR is open source (Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder). No open-source release is listed for Devin.", "question": "Are AXLR and Devin open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 70 against 30", "Agent ergonomics, 83 against 62", "Payments \u0026 pricing, 60 against 20", "Maintenance \u0026 community, 79 against 63" ], "also": [ "Agent-ready, a grade of BB or better", "Free to start without a card", "Open source" ], "goodFor": "A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.", "slug": "axlr", "watchFor": "The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list" }, { "aheadOn": [ "Security \u0026 auth, 72 against 62", "Transparency \u0026 trust, 70 against 55" ], "also": [ "A hosted endpoint, with nothing to install" ], "goodFor": "A team that wants to hand whole tasks to a cloud agent and collect pull requests, driven from a pipeline or another agent.", "slug": "devin", "watchFor": "www.devinstatus.com lists three critical incidents (22 July, 13 August, 24 September 2026) and six major ones on the cloud agent or web app since 10 July 2026" } ], "history": { "axlr": null, "devin": [ { "causes": [ "method" ], "date": "2026-10-28", "delta": 0.1, "from": 55.7, "fromGrade": "C", "to": 55.8, "toGrade": "C" } ] }, "job": { "capability": "agent.harness", "name": "Agent harnesses" }, "others": [ { "json": "https://www.anchorterminal.com/compare/agent-zero-vs-axlr.json", "title": "Agent Zero vs AXLR", "url": "https://www.anchorterminal.com/compare/agent-zero-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/agent-zero-vs-devin.json", "title": "Agent Zero vs Devin", "url": "https://www.anchorterminal.com/compare/agent-zero-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/aider-vs-axlr.json", "title": "Aider vs AXLR", "url": "https://www.anchorterminal.com/compare/aider-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/aider-vs-devin.json", "title": "Aider vs Devin", "url": "https://www.anchorterminal.com/compare/aider-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/amp-vs-axlr.json", "title": "Amp vs AXLR", "url": "https://www.anchorterminal.com/compare/amp-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/amp-vs-devin.json", "title": "Amp vs Devin", "url": "https://www.anchorterminal.com/compare/amp-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr.json", "title": "Antigravity CLI vs AXLR", "url": "https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/antigravity-cli-vs-devin.json", "title": "Antigravity CLI vs Devin", "url": "https://www.anchorterminal.com/compare/antigravity-cli-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/auggie-vs-axlr.json", "title": "Auggie CLI vs AXLR", "url": "https://www.anchorterminal.com/compare/auggie-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/auggie-vs-devin.json", "title": "Auggie CLI vs Devin", "url": "https://www.anchorterminal.com/compare/auggie-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-claude-code.json", "title": "AXLR vs Claude Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-claude-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cline.json", "title": "AXLR vs Cline", "url": "https://www.anchorterminal.com/compare/axlr-vs-cline" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-crush.json", "title": "AXLR vs Crush", "url": "https://www.anchorterminal.com/compare/axlr-vs-crush" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cursor-cli.json", "title": "AXLR vs Cursor CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-cursor-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness.json", "title": "AXLR vs DeepSeek Harness (dsh)", "url": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent.json", "title": "AXLR vs dsh-superagent (DeepSeek)", "url": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-droid-cli.json", "title": "AXLR vs Droid CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-droid-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-earendil-pi.json", "title": "AXLR vs Pi", "url": "https://www.anchorterminal.com/compare/axlr-vs-earendil-pi" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-gemini-cli.json", "title": "AXLR vs Gemini CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-gemini-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli.json", "title": "AXLR vs GitHub Copilot CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-goose.json", "title": "AXLR vs goose", "url": "https://www.anchorterminal.com/compare/axlr-vs-goose" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harness2.json", "title": "AXLR vs Harness²", "url": "https://www.anchorterminal.com/compare/axlr-vs-harness2" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harnessrouter.json", "title": "AXLR vs HarnessRouter", "url": "https://www.anchorterminal.com/compare/axlr-vs-harnessrouter" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-jules.json", "title": "AXLR vs Jules", "url": "https://www.anchorterminal.com/compare/axlr-vs-jules" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-junie.json", "title": "AXLR vs Junie CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-junie" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli.json", "title": "AXLR vs Kilo Code CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli.json", "title": "AXLR vs Kimi Code CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kiro-cli.json", "title": "AXLR vs Kiro CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kiro-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent.json", "title": "AXLR vs mini-swe-agent", "url": "https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-minimax-code.json", "title": "AXLR vs MiniMax Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-minimax-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli.json", "title": "AXLR vs Mistral Vibe CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-muse-code.json", "title": "AXLR vs Muse Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-muse-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex.json", "title": "AXLR vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-opencode.json", "title": "AXLR vs OpenCode", "url": "https://www.anchorterminal.com/compare/axlr-vs-opencode" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openhands.json", "title": "AXLR vs OpenHands", "url": "https://www.anchorterminal.com/compare/axlr-vs-openhands" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openmausbot.json", "title": "AXLR vs OpenMausBot", "url": "https://www.anchorterminal.com/compare/axlr-vs-openmausbot" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-prime-agent.json", "title": "AXLR vs Prime Agent", "url": "https://www.anchorterminal.com/compare/axlr-vs-prime-agent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-qoder-cli.json", "title": "AXLR vs Qoder CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-qoder-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-qwen-code.json", "title": "AXLR vs Qwen Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-qwen-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror.json", "title": "AXLR vs Mirror CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.json", "title": "AXLR vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-unstoppable.json", "title": "AXLR vs Unstoppable", "url": "https://www.anchorterminal.com/compare/axlr-vs-unstoppable" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-vibe-trading.json", "title": "AXLR vs Vibe-Trading", "url": "https://www.anchorterminal.com/compare/axlr-vs-vibe-trading" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-warp.json", "title": "AXLR vs Warp (Warp Agent CLI and the Oz Agent API)", "url": "https://www.anchorterminal.com/compare/axlr-vs-warp" }, { "json": "https://www.anchorterminal.com/compare/claude-code-vs-devin.json", "title": "Claude Code vs Devin", "url": "https://www.anchorterminal.com/compare/claude-code-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/cline-vs-devin.json", "title": "Cline vs Devin", "url": "https://www.anchorterminal.com/compare/cline-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/crush-vs-devin.json", "title": "Crush vs Devin", "url": "https://www.anchorterminal.com/compare/crush-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/cursor-cli-vs-devin.json", "title": "Cursor CLI vs Devin", "url": "https://www.anchorterminal.com/compare/cursor-cli-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/deepseek-harness-vs-devin.json", "title": "DeepSeek Harness (dsh) vs Devin", "url": "https://www.anchorterminal.com/compare/deepseek-harness-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/deepseek-superagent-vs-devin.json", "title": "dsh-superagent (DeepSeek) vs Devin", "url": "https://www.anchorterminal.com/compare/deepseek-superagent-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-droid-cli.json", "title": "Devin vs Droid CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-droid-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-earendil-pi.json", "title": "Devin vs Pi", "url": "https://www.anchorterminal.com/compare/devin-vs-earendil-pi" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-gemini-cli.json", "title": "Devin vs Gemini CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-gemini-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-github-copilot-cli.json", "title": "Devin vs GitHub Copilot CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-github-copilot-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-goose.json", "title": "Devin vs goose", "url": "https://www.anchorterminal.com/compare/devin-vs-goose" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-harness2.json", "title": "Devin vs Harness²", "url": "https://www.anchorterminal.com/compare/devin-vs-harness2" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-harnessrouter.json", "title": "Devin vs HarnessRouter", "url": "https://www.anchorterminal.com/compare/devin-vs-harnessrouter" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-jules.json", "title": "Devin vs Jules", "url": "https://www.anchorterminal.com/compare/devin-vs-jules" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-junie.json", "title": "Devin vs Junie CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-junie" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-kilo-code-cli.json", "title": "Devin vs Kilo Code CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-kilo-code-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-kimi-code-cli.json", "title": "Devin vs Kimi Code CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-kimi-code-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-kiro-cli.json", "title": "Devin vs Kiro CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-kiro-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-mini-swe-agent.json", "title": "Devin vs mini-swe-agent", "url": "https://www.anchorterminal.com/compare/devin-vs-mini-swe-agent" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-minimax-code.json", "title": "Devin vs MiniMax Code", "url": "https://www.anchorterminal.com/compare/devin-vs-minimax-code" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-mistral-vibe-cli.json", "title": "Devin vs Mistral Vibe CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-mistral-vibe-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-muse-code.json", "title": "Devin vs Muse Code", "url": "https://www.anchorterminal.com/compare/devin-vs-muse-code" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-openai-codex.json", "title": "Devin vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/devin-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-opencode.json", "title": "Devin vs OpenCode", "url": "https://www.anchorterminal.com/compare/devin-vs-opencode" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-openhands.json", "title": "Devin vs OpenHands", "url": "https://www.anchorterminal.com/compare/devin-vs-openhands" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-openmausbot.json", "title": "Devin vs OpenMausBot", "url": "https://www.anchorterminal.com/compare/devin-vs-openmausbot" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-prime-agent.json", "title": "Devin vs Prime Agent", "url": "https://www.anchorterminal.com/compare/devin-vs-prime-agent" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-qoder-cli.json", "title": "Devin vs Qoder CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-qoder-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-qwen-code.json", "title": "Devin vs Qwen Code", "url": "https://www.anchorterminal.com/compare/devin-vs-qwen-code" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-reflection-mirror.json", "title": "Devin vs Mirror CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-reflection-mirror" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-rovo-dev-cli.json", "title": "Devin vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-unstoppable.json", "title": "Devin vs Unstoppable", "url": "https://www.anchorterminal.com/compare/devin-vs-unstoppable" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-vibe-trading.json", "title": "Devin vs Vibe-Trading", "url": "https://www.anchorterminal.com/compare/devin-vs-vibe-trading" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-warp.json", "title": "Devin vs Warp (Warp Agent CLI and the Oz Agent API)", "url": "https://www.anchorterminal.com/compare/devin-vs-warp" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-clawboo.json", "title": "AXLR vs Clawboo", "url": "https://www.anchorterminal.com/compare/axlr-vs-clawboo" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cli-manager.json", "title": "AXLR vs CLI Manager", "url": "https://www.anchorterminal.com/compare/axlr-vs-cli-manager" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous.json", "title": "AXLR vs Harness", "url": "https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-paperclip.json", "title": "AXLR vs Paperclip", "url": "https://www.anchorterminal.com/compare/axlr-vs-paperclip" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-parallax-agents.json", "title": "AXLR vs Parallax", "url": "https://www.anchorterminal.com/compare/axlr-vs-parallax-agents" }, { "json": "https://www.anchorterminal.com/compare/clawboo-vs-devin.json", "title": "Clawboo vs Devin", "url": "https://www.anchorterminal.com/compare/clawboo-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/cli-manager-vs-devin.json", "title": "CLI Manager vs Devin", "url": "https://www.anchorterminal.com/compare/cli-manager-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-harness-autonomous.json", "title": "Devin vs Harness", "url": "https://www.anchorterminal.com/compare/devin-vs-harness-autonomous" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-paperclip.json", "title": "Devin vs Paperclip", "url": "https://www.anchorterminal.com/compare/devin-vs-paperclip" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-parallax-agents.json", "title": "Devin vs Parallax", "url": "https://www.anchorterminal.com/compare/devin-vs-parallax-agents" } ], "panel": null, "scores": [ { "axlr": 70, "by": 40, "devin": 30, "edge": "axlr", "key": "reliability", "name": "Reliability", "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "axlr": 80, "by": 0, "devin": 80, "edge": "", "key": "schema", "name": "Schema \u0026 documentation", "weight": 13 }, { "axlr": 83, "by": 21, "devin": 62, "edge": "axlr", "key": "ergonomics", "name": "Agent ergonomics", "weight": 13 }, { "axlr": 62, "by": 10, "devin": 72, "edge": "devin", "key": "security", "name": "Security \u0026 auth", "weight": 14 }, { "axlr": 60, "by": 40, "devin": 20, "edge": "axlr", "key": "payments", "name": "Payments \u0026 pricing", "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "axlr": 79, "by": 16, "devin": 63, "edge": "axlr", "key": "maintenance", "name": "Maintenance \u0026 community", "weight": 7 }, { "axlr": 55, "by": 15, "devin": 70, "edge": "devin", "key": "transparency", "name": "Transparency \u0026 trust", "weight": 7 } ], "summary": "AXLR scores 70.6 (BB) on agent readiness against Devin's 55.8 (C), and leads in 4 of 7 scored categories. Devin leads on security \u0026 auth and transparency \u0026 trust. Both do agent harnesses.", "tasks": null, "tutorials": [], "verdicts": { "axlr": "A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.", "devin": "The v3 API is well specified, with a public OpenAPI 3.1 file covering 239 operations, problem+json errors, cursor pagination and service-user keys tied to roles. The status page records three critical and several major incidents on the cloud agent between 22 July and 24 September 2026, and no rate limit figures or retry guidance were found in the reviewed documentation." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/axlr-vs-devin", "json": "https://www.anchorterminal.com/compare/axlr-vs-devin.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/axlr-vs-devin.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/axlr-vs-devin.min.md" }, "markdown": "AXLR scores 70.6 (BB) on agent readiness against Devin's 55.8 (C), and leads in 4 of 7 scored categories. Devin leads on security \u0026 auth and transparency \u0026 trust. Both do agent harnesses.\n\n- AXLR: grade BB, 70.6/100, rank #168 of 1253. Markdown https://www.anchorterminal.com/tools/axlr.md · JSON https://www.anchorterminal.com/api/v1/tools/axlr.json\n- Devin: grade C, 55.8/100, rank #783 of 1253. Markdown https://www.anchorterminal.com/tools/devin.md · JSON https://www.anchorterminal.com/api/v1/tools/devin.json\n- Best agent harnesses and coding agents: https://www.anchorterminal.com/best/agent-harnesses/index.md\n- All 1000 harnesses comparisons: https://www.anchorterminal.com/compare/agent-harnesses/index.md\n\n## Which one, for what\n\n### AXLR (BB)\n\nGood for: A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.\n\nAhead on:\n- Reliability, 70 against 30\n- Agent ergonomics, 83 against 62\n- Payments \u0026 pricing, 60 against 20\n- Maintenance \u0026 community, 79 against 63\n\nAlso in its favour:\n- Agent-ready, a grade of BB or better\n- Free to start without a card\n- Open source\n\nWatch for: The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list\n\n### Devin (C)\n\nGood for: A team that wants to hand whole tasks to a cloud agent and collect pull requests, driven from a pipeline or another agent.\n\nAhead on:\n- Security \u0026 auth, 72 against 62\n- Transparency \u0026 trust, 70 against 55\n\nAlso in its favour:\n- A hosted endpoint, with nothing to install\n\nWatch for: www.devinstatus.com lists three critical incidents (22 July, 13 August, 24 September 2026) and six major ones on the cloud agent or web app since 10 July 2026\n\n\n## Why the edge\n\n### Reliability: AXLR +40\n\n- AXLR (70): Read as a local package, as claude-code, goose, opencode and openhands were. Release archives for Linux, macOS and Windows on amd64 and arm64 with a `.sha256` beside each, a GHCR image, an OCI Helm chart and source builds with Go 1.26, all stated in the docs; no Homebrew, npm or apt route (20). CI on main runs vet, race tests and a coverage gate above 80 per cent for both modules, with the sandbox tests required under bubblewrap, and the last ten runs on main to 1 November 2026 all passed; the release workflow tests on six native runners (25). 10 open issues, all opened by the founder on 19 and 21 October 2026 as trackers for service work (work modes, plugins, the sandbox setting, cost limits), none from an outside user and none a crash report, 0 open pull requests and about 100 merged; with 0 stars there is nobody else to report, so the handling of outside reports is untested (20). Tags are semver 0.x and the docs date each behaviour change inline (\"until 14 October 2026…\"), but the 21 releases have empty notes, there is no CHANGELOG.md, and the product contract records one retirement (the seven 1.0 skill definitions on 5 October 2026) without a notice period (5). Pre-1.0, which the README calls an evolving project (0). 20+25+20+5+0 = 70.\n- Devin (30): Hosted reading. Status page at www.devinstatus.com with 14 components and incident history (20). In the 90 days to 8 October 2026 it lists three critical incidents (22 July, 43 minutes of platform-wide queuing, 13 August, Devin Cloud unavailable for 2 hours 40 minutes, 24 September, the web app down for 2 hours) and six major ones on session start-up, so several majors (0). 429 is a documented response, but no rate limit figures were found (0). No Retry-After or backoff guidance found, and v3 session creation has no idempotency key, although the legacy v1 API had one (0). The platform terms supply the service as is with no service level, and enterprise terms weren't read (0). The v3 API is the current, recommended surface, with 44 of 239 operations marked beta under /v3beta1 (10).\n\n### Payments \u0026 pricing: AXLR +40\n\n- AXLR (60): No payment protocol (0). Free and Apache-2.0 with nothing to buy, so 20, 20 and 20 on the last three lines by the self-hosted rule, since the docs say what you pay your model provider, the free route needs no card, and it runs local models with no signup at all, the JSON worker without any model. 0+20+20+20 = 60.\n- Devin (20): Published rubric. No payment protocol (0). Plan prices are public, $20, $200 and $40 a seat with an $80 team minimum, but usage past the quota is billed at an unpublished rate (10). A Free plan exists. The pricing page lists cloud agents from Pro upward, and we couldn't confirm API use on Free or whether a card is needed (10). A person signs up in a browser and provisions the service user in settings (0).\n\n### Agent ergonomics: AXLR +21\n\n- AXLR (83): Harness reading of the framework line, scored on what a program driving it has to supply. Six local tools plus the host's bookkeeping tools; work modes and an execution policy hide the tools a run may not use, `axlr_catalog` searches the catalog instead of loading it, forged tools keep the request prefix for the prompt cache, and a context cap of 75,000 prompt tokens opens a successor session (20). `local_read`, `local_search` and `local_list` page with `offset`, `next_offset` and `max_bytes`; `StreamEvents` takes `after`, `max_events` (1 to 256) and `wait_ms`; a budget per execution in seconds, requests, tool calls and dollars; 32 tool calls a turn and `max_session_usd` (20). The `--exec` run ends in one `result` line with a status, the pending call, every call's outcome and the usage, and exits 0, 3 or 1; service errors carry codes an agent can act on; a budget stop says which limit (`budget: requests 20 reached`) and leaves the session resumable (16). `Idempotency-Key` on every turn, approval and direct call with cross-transport replay, `expected_revision` on decisions, `expected_sha256` on worker writes, and an interrupted effectful call left `uncertain` for an operator rather than retried (19). One command runs a task, but the first launch needs an OpenRouter key or a local server, the service needs a CA, a principals file and remote KMP and MADE before a first session, and the only SDK is the Go library (8). 20+20+16+19+8 = 83.\n- Devin (62): API and MCP reading. The MCP server documents 13 tools, several of them consolidated manage tools, and list endpoints take `first` to size a page (17). Cursor pagination on every v3 list endpoint and filters on session search by tag, playbook, origin, user and time (18). problem+json with `error_code`, field-level errors on 422 and a 400 that lists valid platform names, but no published code list (15). No idempotency key on v3 session creation. `max_acu_limit` caps what a session can spend, and the MCP tool annotations couldn't be read without a key (4). Only `prompt` is required to start a session. No official SDK found, only a Terraform provider (8).\n\n### Maintenance \u0026 community: AXLR +16\n\n- AXLR (79): v0.15.0 on 2026-10-25, with commits on main to 2026-11-01 (30). 21 releases between 4 and 25 October 2026 (20). One maintainer (368 of 399 commits, the rest by two agent accounts), 10 open issues that are his own trackers with no comments, about 100 merged pull requests and no outside report to measure a reply against (15). Not in the MCP registry; the Go module and a proto to generate clients from are the only client code, beside the GHCR image and Helm chart (5). Go 1.26 toolchain pinned, release actions pinned by commit SHA, a go-licenses check that the third-party bundle matches the dependency graph, and CI passing on main (9). 30+20+15+5+9 = 79.\n- Devin (63): Closed service. Newest release note dated 7 October 2026 (30). Nineteen dated release notes between 7 August and 7 October 2026, and API notes for August and September (20). Public release notes and a support address, with no public tracker or forum found (10). No official SDK found and the Devin MCP server didn't appear in a search of the official MCP registry (0). No public CI or packages to assess, with the docs and three OpenAPI specs kept current (3).\n\n### Transparency \u0026 trust: Devin +15\n\n- AXLR (55): Apache-2.0 with a NOTICE (30). No privacy policy or terms on underpassai.com or axlr.underpassai.com; the docs' 'Where data goes' and 'Diagnostics and privacy' sections say that model requests go to OpenRouter, the local server or the native API, that Jev sends text to TypeSafe only when on, that sessions live under `$XDG_STATE_HOME/axlr`, that payload capture is off by default and redacted when on, and that traces are deleted after 30 days; nothing covers the engine downloads' or the catalog registry's handling of a client's requests (15). No deprecation policy; pre-1.0 changes are dated inline in the docs and the product contract records the 5 October 2026 retirement of the first skill catalogue after the fact (6). No telemetry to disclose, and the docs say in two places what leaves the machine and how to stop payload capture, though no single page says there is no telemetry (17). 30+15+6+17 = 68.\n- Devin (70): Editorial half. Closed source with clear terms from Cognition AI, Inc. (15). Terms, privacy policy, security page and data processing agreement agree with each other. Customer data may be used for model training by default on self-serve plans, with an opt-out on paid plans that also turns on zero data retention at model providers. Retention is stated as the length of the customer relationship, with no periods (18). Dated notices for the schedules endpoints (announced 10 September, creation refused from 24 September 2026) and the v2 clone endpoint, but no deprecation policy and no end date for v1 and v2 (10). Sub-processors listed with purpose and country, and 15 days' notice of additions (18).\n\n### Security \u0026 auth: Devin +10\n\n- AXLR (62): Harness reading of the framework checklist, as for the other four harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No product telemetry in the console source (the outbound hosts are openrouter.ai, api.anthropic.com, api.openai.com, a configured local server, api.github.com and github.com for engine downloads, and registry.underpassai.com for the signed catalog index) or in the docs; payload capture is off by default since 9 October 2026, traces omit prompts and credentials, model keys are never given to commands or plugins, and Jev sends requests and answers to TypeSafe only when on, which the setup assistant does when `TYPESAFE_API_KEY` is set, with a notice on stderr (27). Approval cards, a destructive list that always asks, four work modes, a policy level per execution, a bubblewrap or container sandbox with an enforced egress allow list, and a service that approves nothing but reads. Against that, the setup assistant writes `autonomous: true`, `exec_sandbox` is off by default, forged tools run with the person's rights, and the README says the console and worker are not sandboxes (13). Forged tools are refused when a file changes since the forge, a policy forbids calls outside the model, and the docs say MCP tools keep their own side effects, but no prompt-injection guidance was found and MCP results reach the model unmarked (6). The service keeps an event journal, audit records, a receipt with the SHA-256 of every call's arguments and outcome, and correlation ids on every event; the console keeps session records, a redacted app log and `/session` (14). No SECURITY.md, no security.txt on either host, no advisories, no bug bounty; release checksums and a minisign-signed catalog are integrity, not a programme (2). 27+13+6+14+2 = 62.\n- Devin (72): Hosted reading. Service-user keys with roles and named permissions per endpoint, revocable, with rotation endpoints in beta for Enterprise and expiring personal tokens. Custom roles are an Enterprise option, and Teams has Admin and Member only (25). Security profiles restrict network, MCP servers, git and the Devin MCP to read-only, and read-only API permissions exist. They are opt-in, and session creation accepts `bypass_approval` (16). AI Guardrails screen user messages and pull request comments for prompt injection, on Enterprise only, and they don't cover web pages or repository content Devin reads (8). Audit logs through the API need an enterprise-level permission. Session events and insights are available on all plans (10). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address at security@cognition.ai, no security.txt, and the trust centre answers No to having a bug bounty (13).\n\n## Score by category\n\n| Category | Weight | AXLR | Devin | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 70 | 30 | AXLR +40 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 80 | 80 | even |\n| Agent ergonomics | 13% (16.2 this run) | 83 | 62 | AXLR +21 |\n| Security \u0026 auth | 14% (17.5 this run) | 62 | 72 | Devin +10 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 20 | AXLR +40 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 79 | 63 | AXLR +16 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 55 | 70 | Devin +15 |\n| Negative events | ≤15 | 0 | 0 | |\n| **Total** | | **70.6 · BB** | **55.8 · C** | |\n\n## Facts side by side\n\n| Fact | AXLR | Devin |\n| --- | --- | --- |\n| Kind | Agent harness | Agent harness |\n| Vendor | Underpass AI | Cognition AI, Inc. |\n| Hosted endpoint | no (local only) | `https://mcp.devin.ai/mcp` |\n| Transports | | HTTP |\n| Auth | OAuth or key | API key |\n| Pricing | Free | Freemium |\n| x402 | no | no |\n| Licence | Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder | Proprietary service under Cognition's Platform Terms of Service |\n| Tools exposed | none | 13 |\n| Read-only variant documented | no | yes |\n| llms.txt | no | yes |\n| Last release | 2026-10-25 | 2026-10-07 |\n| Terms last updated | no document linked | 2026-06-30 |\n| Privacy policy last updated | no document linked | 2026-03-09 |\n| Customer content may train models | not read yet | yes, with an opt-out |\n| Terms restrict automated access | not read yet | not found in the text |\n| Terms restrict benchmarking | not read yet | yes |\n| Terms or service can change without notice | not read yet | not found in the text |\n| Arbitration or class-action waiver | not read yet | yes |\n| Popularity | 0 stars | none |\n\n## How the scores have moved\n\n### AXLR\n\nNo score change since it was listed.\n\n### Devin\n\n- +0.1 on 28 October 2026: checklist\n\n## Verdicts\n\n**AXLR.** A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.\n\n**Devin.** The v3 API is well specified, with a public OpenAPI 3.1 file covering 239 operations, problem+json errors, cursor pagination and service-user keys tied to roles. The status page records three critical and several major incidents on the cloud agent between 22 July and 24 September 2026, and no rate limit figures or retry guidance were found in the reviewed documentation.\n\n## Before you call either\n\n### AXLR\n\n1. Before the first prompt, set `approvals.autonomous` to false or run with `--approve none`, and turn `exec_sandbox.mode` to `auto` or `required` on Linux; after setup both default the other way\n2. Drive a run with `axlr-tui --exec --json --policy \u003cfile\u003e --budget \u003cfile\u003e --sandbox \u003cfile\u003e` and read only the last `result` line; exit 3 means a call waits for `--decide approve|deny` with `--session \u003cid\u003e`\n3. On the service, send `Idempotency-Key` (16 to 128 safe ASCII characters) on every turn, approval and direct call, and pass the session's `expected_revision`; a reused key with a different body answers 409\n4. A local model must return native tool calls (llama.cpp with `--jinja`, vLLM with `--enable-auto-tool-choice`); set `context_tokens` on the entry and `OLLAMA_CONTEXT_LENGTH` for Ollama\n5. Leave `TYPESAFE_API_KEY` unset unless you want the setup assistant to switch Jev on, which sends requests and final answers to TypeSafe\n\n### Devin\n\n1. Use a `cog_` service-user key with the Member role. Legacy `apk_` keys fail against v3 and the MCP server with 401 or 403\n2. Set `max_acu_limit` on every session you create. Usage is metered by the work done and has no published unit rate\n3. Session creation is not idempotent in v3. After a timeout, list sessions by tag before creating again\n4. Enterprise keys and personal access tokens must send `X-Org-Id` to the MCP server. Organisation-scoped keys resolve it automatically\n5. Create scheduled work as an automation. POST to the schedules endpoint returns 403 for migrated organisations since 24 September 2026\n\n## Questions\n\n### Which is better for AI agents, AXLR or Devin?\n\nAXLR scores 70.6 (BB) on agent readiness against Devin's 55.8 (C), and leads in 4 of 7 scored categories. Devin leads on security \u0026 auth and transparency \u0026 trust.\n\n### Are AXLR and Devin open source?\n\nAXLR is open source (Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder). No open-source release is listed for Devin.\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/axlr-vs-devin.json, and with the fewest tokens: https://www.anchorterminal.com/compare/axlr-vs-devin.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"axlr\", \"b\": \"devin\"}`. From a terminal: `anchor compare axlr devin`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/axlr.json and https://www.anchorterminal.com/api/v1/tools/devin.json\n\n## Other comparisons with AXLR or Devin\n\n- [Agent Zero vs AXLR](https://www.anchorterminal.com/compare/agent-zero-vs-axlr.md)\n- [Agent Zero vs Devin](https://www.anchorterminal.com/compare/agent-zero-vs-devin.md)\n- [Aider vs AXLR](https://www.anchorterminal.com/compare/aider-vs-axlr.md)\n- [Aider vs Devin](https://www.anchorterminal.com/compare/aider-vs-devin.md)\n- [Amp vs AXLR](https://www.anchorterminal.com/compare/amp-vs-axlr.md)\n- [Amp vs Devin](https://www.anchorterminal.com/compare/amp-vs-devin.md)\n- [Antigravity CLI vs AXLR](https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr.md)\n- [Antigravity CLI vs Devin](https://www.anchorterminal.com/compare/antigravity-cli-vs-devin.md)\n- [Auggie CLI vs AXLR](https://www.anchorterminal.com/compare/auggie-vs-axlr.md)\n- [Auggie CLI vs Devin](https://www.anchorterminal.com/compare/auggie-vs-devin.md)\n- [AXLR vs Claude Code](https://www.anchorterminal.com/compare/axlr-vs-claude-code.md)\n- [AXLR vs Cline](https://www.anchorterminal.com/compare/axlr-vs-cline.md)\n- [AXLR vs Crush](https://www.anchorterminal.com/compare/axlr-vs-crush.md)\n- [AXLR vs Cursor CLI](https://www.anchorterminal.com/compare/axlr-vs-cursor-cli.md)\n- [AXLR vs DeepSeek Harness (dsh)](https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness.md)\n- [AXLR vs dsh-superagent (DeepSeek)](https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent.md)\n- [AXLR vs Droid CLI](https://www.anchorterminal.com/compare/axlr-vs-droid-cli.md)\n- [AXLR vs Pi](https://www.anchorterminal.com/compare/axlr-vs-earendil-pi.md)\n- [AXLR vs Gemini CLI](https://www.anchorterminal.com/compare/axlr-vs-gemini-cli.md)\n- [AXLR vs GitHub Copilot CLI](https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli.md)\n- [AXLR vs goose](https://www.anchorterminal.com/compare/axlr-vs-goose.md)\n- [AXLR vs Harness²](https://www.anchorterminal.com/compare/axlr-vs-harness2.md)\n- [AXLR vs HarnessRouter](https://www.anchorterminal.com/compare/axlr-vs-harnessrouter.md)\n- [AXLR vs Jules](https://www.anchorterminal.com/compare/axlr-vs-jules.md)\n- [AXLR vs Junie CLI](https://www.anchorterminal.com/compare/axlr-vs-junie.md)\n- [AXLR vs Kilo Code CLI](https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli.md)\n- [AXLR vs Kimi Code CLI](https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli.md)\n- [AXLR vs Kiro CLI](https://www.anchorterminal.com/compare/axlr-vs-kiro-cli.md)\n- [AXLR vs mini-swe-agent](https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent.md)\n- [AXLR vs MiniMax Code](https://www.anchorterminal.com/compare/axlr-vs-minimax-code.md)\n- [AXLR vs Mistral Vibe CLI](https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli.md)\n- [AXLR vs Muse Code](https://www.anchorterminal.com/compare/axlr-vs-muse-code.md)\n- [AXLR vs OpenAI Codex](https://www.anchorterminal.com/compare/axlr-vs-openai-codex.md)\n- [AXLR vs OpenCode](https://www.anchorterminal.com/compare/axlr-vs-opencode.md)\n- [AXLR vs OpenHands](https://www.anchorterminal.com/compare/axlr-vs-openhands.md)\n- [AXLR vs OpenMausBot](https://www.anchorterminal.com/compare/axlr-vs-openmausbot.md)\n- [AXLR vs Prime Agent](https://www.anchorterminal.com/compare/axlr-vs-prime-agent.md)\n- [AXLR vs Qoder CLI](https://www.anchorterminal.com/compare/axlr-vs-qoder-cli.md)\n- [AXLR vs Qwen Code](https://www.anchorterminal.com/compare/axlr-vs-qwen-code.md)\n- [AXLR vs Mirror CLI](https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror.md)\n- [AXLR vs Rovo Dev CLI](https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.md)\n- [AXLR vs Unstoppable](https://www.anchorterminal.com/compare/axlr-vs-unstoppable.md)\n- [AXLR vs Vibe-Trading](https://www.anchorterminal.com/compare/axlr-vs-vibe-trading.md)\n- [AXLR vs Warp (Warp Agent CLI and the Oz Agent API)](https://www.anchorterminal.com/compare/axlr-vs-warp.md)\n- [Claude Code vs Devin](https://www.anchorterminal.com/compare/claude-code-vs-devin.md)\n- [Cline vs Devin](https://www.anchorterminal.com/compare/cline-vs-devin.md)\n- [Crush vs Devin](https://www.anchorterminal.com/compare/crush-vs-devin.md)\n- [Cursor CLI vs Devin](https://www.anchorterminal.com/compare/cursor-cli-vs-devin.md)\n- [DeepSeek Harness (dsh) vs Devin](https://www.anchorterminal.com/compare/deepseek-harness-vs-devin.md)\n- [dsh-superagent (DeepSeek) vs Devin](https://www.anchorterminal.com/compare/deepseek-superagent-vs-devin.md)\n- [Devin vs Droid CLI](https://www.anchorterminal.com/compare/devin-vs-droid-cli.md)\n- [Devin vs Pi](https://www.anchorterminal.com/compare/devin-vs-earendil-pi.md)\n- [Devin vs Gemini CLI](https://www.anchorterminal.com/compare/devin-vs-gemini-cli.md)\n- [Devin vs GitHub Copilot CLI](https://www.anchorterminal.com/compare/devin-vs-github-copilot-cli.md)\n- [Devin vs goose](https://www.anchorterminal.com/compare/devin-vs-goose.md)\n- [Devin vs Harness²](https://www.anchorterminal.com/compare/devin-vs-harness2.md)\n- [Devin vs HarnessRouter](https://www.anchorterminal.com/compare/devin-vs-harnessrouter.md)\n- [Devin vs Jules](https://www.anchorterminal.com/compare/devin-vs-jules.md)\n- [Devin vs Junie CLI](https://www.anchorterminal.com/compare/devin-vs-junie.md)\n- [Devin vs Kilo Code CLI](https://www.anchorterminal.com/compare/devin-vs-kilo-code-cli.md)\n- [Devin vs Kimi Code CLI](https://www.anchorterminal.com/compare/devin-vs-kimi-code-cli.md)\n- [Devin vs Kiro CLI](https://www.anchorterminal.com/compare/devin-vs-kiro-cli.md)\n- [Devin vs mini-swe-agent](https://www.anchorterminal.com/compare/devin-vs-mini-swe-agent.md)\n- [Devin vs MiniMax Code](https://www.anchorterminal.com/compare/devin-vs-minimax-code.md)\n- [Devin vs Mistral Vibe CLI](https://www.anchorterminal.com/compare/devin-vs-mistral-vibe-cli.md)\n- [Devin vs Muse Code](https://www.anchorterminal.com/compare/devin-vs-muse-code.md)\n- [Devin vs OpenAI Codex](https://www.anchorterminal.com/compare/devin-vs-openai-codex.md)\n- [Devin vs OpenCode](https://www.anchorterminal.com/compare/devin-vs-opencode.md)\n- [Devin vs OpenHands](https://www.anchorterminal.com/compare/devin-vs-openhands.md)\n- [Devin vs OpenMausBot](https://www.anchorterminal.com/compare/devin-vs-openmausbot.md)\n- [Devin vs Prime Agent](https://www.anchorterminal.com/compare/devin-vs-prime-agent.md)\n- [Devin vs Qoder CLI](https://www.anchorterminal.com/compare/devin-vs-qoder-cli.md)\n- [Devin vs Qwen Code](https://www.anchorterminal.com/compare/devin-vs-qwen-code.md)\n- [Devin vs Mirror CLI](https://www.anchorterminal.com/compare/devin-vs-reflection-mirror.md)\n- [Devin vs Rovo Dev CLI](https://www.anchorterminal.com/compare/devin-vs-rovo-dev-cli.md)\n- [Devin vs Unstoppable](https://www.anchorterminal.com/compare/devin-vs-unstoppable.md)\n- [Devin vs Vibe-Trading](https://www.anchorterminal.com/compare/devin-vs-vibe-trading.md)\n- [Devin vs Warp (Warp Agent CLI and the Oz Agent API)](https://www.anchorterminal.com/compare/devin-vs-warp.md)\n- [AXLR vs Clawboo](https://www.anchorterminal.com/compare/axlr-vs-clawboo.md)\n- [AXLR vs CLI Manager](https://www.anchorterminal.com/compare/axlr-vs-cli-manager.md)\n- [AXLR vs Harness](https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous.md)\n- [AXLR vs Paperclip](https://www.anchorterminal.com/compare/axlr-vs-paperclip.md)\n- [AXLR vs Parallax](https://www.anchorterminal.com/compare/axlr-vs-parallax-agents.md)\n- [Clawboo vs Devin](https://www.anchorterminal.com/compare/clawboo-vs-devin.md)\n- [CLI Manager vs Devin](https://www.anchorterminal.com/compare/cli-manager-vs-devin.md)\n- [Devin vs Harness](https://www.anchorterminal.com/compare/devin-vs-harness-autonomous.md)\n- [Devin vs Paperclip](https://www.anchorterminal.com/compare/devin-vs-paperclip.md)\n- [Devin vs Parallax](https://www.anchorterminal.com/compare/devin-vs-parallax-agents.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-11-01", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "AXLR vs Devin", "url": "" } ], "description": "AXLR scores 70.6 (BB) to Devin's 55.8 (C) for agent harnesses. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "AXLR BB 70.6", "Devin C 55.8", "scores" ], "h1": "AXLR vs Devin", "image": "https://www.anchorterminal.com/assets/og/default.png", "path": "/compare/axlr-vs-devin", "published": "2026-10-01", "section": "tools", "title": "AXLR vs Devin for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-11-01", "url": "https://www.anchorterminal.com/compare/axlr-vs-devin" }, "tokens": { "markdown": 6650, "slim": 3430 }, "version": 1 }