{ "data": { "a": { "slug": "axlr", "name": "AXLR", "vendor": "Underpass AI", "vendorUrl": "https://axlr.underpassai.com", "kind": "harness", "category": "agent-harnesses", "summary": "Open-source Go execution engine for agentic work from Underpass AI. A console with work modes and approval cards, an mTLS HTTP, gRPC and MCP service, a JSON worker and a Go library, with KMP memory and MADE procedures over MCP.", "url": "https://www.anchorterminal.com/tools/axlr", "markdownUrl": "https://www.anchorterminal.com/tools/axlr.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/axlr.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/axlr.json", "dns": "axlr.grade.anchorterminal.com", "repo": "https://github.com/underpass-ai/AXLR", "license": "Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder", "transports": [], "packages": [ { "registry": "go", "name": "github.com/underpass-ai/AXLR" }, { "registry": "oci", "name": "ghcr.io/underpass-ai/axlr" }, { "registry": "oci", "name": "ghcr.io/underpass-ai/charts/axlr" } ], "auth": "mixed", "authNotes": "The console and the one-command `axlr-tui --exec` need a model route, an OpenRouter key (`OPENROUTER_API_KEY` or `credentials.json`, mode 0600), a local OpenAI-compatible server, or an Anthropic Messages or OpenAI Responses key in a `local_models` entry; the JSON worker and the library tests need no model account. The service, `axlr-serve`, requires TLS 1.3 and a client certificate signed by its CA whose SHA-256 fingerprint is mapped in a private principals file to a principal and the roles `session_client`, `approver`, `tool_operator` and `admin`; an unmapped certificate is forbidden, a session belongs to the principal that created it, and authentication never approves a tool by itself. MCP at `/mcp` is stateless and authenticated per request by the same certificate; gRPC uses the TLS peer certificate.", "pricing": "free", "pricingNotes": "Free and open source under Apache-2.0, with nothing to buy from Underpass AI. You pay your model provider (OpenRouter reports a cost per request, which the console's `/usage` and `max_session_usd` track) or run a local server at no charge; TypeSafe's Jev judge is optional and needs its own key. No hosted AXLR exists (checked 2026-11-01).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the repository, the OpenAPI file or the two sites (checked 2026-11-01). Nothing is sold.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 0, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-11-01" }, "docsUrl": "https://axlr.underpassai.com/docs/", "openapi": "https://github.com/underpass-ai/AXLR/blob/main/api/openapi/axlr-v1.yaml", "capabilities": [ "agent.harness", "agent.mcp-client", "agent.multi-agent" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "go", "cli", "mcp-client", "openapi", "grpc", "docker", "helm", "sandbox", "approvals", "pre-1.0", "new" ], "lastRelease": "2026-10-25", "graded": true, "anchor": { "graded": true, "score": 70.6, "grade": "BB", "agentReady": true, "rank": 168, "ranked": true, "rankOf": 1253, "categoryRank": 3, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 83, "maintenance": 79, "payments": 60, "reliability": 70, "schema": 80, "security": 62, "transparency": 55 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-01" }, "negative": 0, "verdict": "A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.", "bestFor": "A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.", "strengths": [ "mTLS HTTP, gRPC and MCP service with four principal roles, `Idempotency-Key` required on turns, approvals and direct calls, and `expected_revision` on decisions", "A policy (observe, propose, act-with-approval, act-within-policy), a budget in seconds, requests, tool calls and dollars, and a bubblewrap or container sandbox with an enforced egress allow list, each per execution", "`axlr-tui --exec --json` runs one task headless and ends with a result object; exit 0 done, 3 waiting for a decision, 1 error", "OpenRouter, local OpenAI-compatible servers (llama.cpp, vLLM, Ollama, LM Studio), and the Anthropic Messages and OpenAI Responses APIs spoken directly", "21 releases in October 2026 from a workflow that tests on six native runners and refuses to republish different bytes, with a `.sha256` beside every archive" ], "weaknesses": [ "The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list", "Pre-1.0 with one maintainer, 0 stars and 10 open issues, all the founder's own trackers; releases have empty notes and there is no changelog", "The service needs KMP and MADE as remote gRPC services, a client CA and a principals file before a first session, and has no work modes, plugins or forged-tool setting yet", "No SECURITY.md, security.txt, advisories or disclosure route; the legal entity is not yet incorporated and no terms or privacy policy exist", "No llms.txt, and the Go library is the only SDK; the catalog registry answers every non-AXLR client with 403" ], "agentNotes": [ "Before the first prompt, set `approvals.autonomous` to false or run with `--approve none`, and turn `exec_sandbox.mode` to `auto` or `required` on Linux; after setup both default the other way", "Drive a run with `axlr-tui --exec --json --policy \u003cfile\u003e --budget \u003cfile\u003e --sandbox \u003cfile\u003e` and read only the last `result` line; exit 3 means a call waits for `--decide approve|deny` with `--session \u003cid\u003e`", "On the service, send `Idempotency-Key` (16 to 128 safe ASCII characters) on every turn, approval and direct call, and pass the session's `expected_revision`; a reused key with a different body answers 409", "A local model must return native tool calls (llama.cpp with `--jinja`, vLLM with `--enable-auto-tool-choice`); set `context_tokens` on the entry and `OLLAMA_CONTEXT_LENGTH` for Ollama", "Leave `TYPESAFE_API_KEY` unset unless you want the setup assistant to switch Jev on, which sends requests and final answers to TypeSafe" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "BB", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 70.6 } ], "editorialScores": { "ergonomics": 83, "maintenance": 79, "payments": 60, "reliability": 70, "schema": 80, "security": 62, "transparency": 68 }, "provenanceScore": 42, "checked": { "categories": { "ergonomics": "2026-11-01", "maintenance": "2026-11-01", "payments": "2026-11-01", "reliability": "2026-11-01", "schema": "2026-11-01", "security": "2026-11-01", "transparency": "2026-11-01" }, "last": "2026-11-01", "oldest": "2026-11-01", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "V=v0.15.0; OS=linux; ARCH=amd64; curl -fsSLO https://github.com/underpass-ai/AXLR/releases/download/$V/axlr-$V-$OS-$ARCH.tar.gz{,.sha256} \u0026\u0026 sha256sum -c axlr-$V-$OS-$ARCH.tar.gz.sha256 \u0026\u0026 tar xzf axlr-$V-$OS-$ARCH.tar.gz -C ~/.local/bin axlr axlr-tui axlr-serve # or build from source with Go 1.26", "headless": { "command": "axlr-tui --root \"$PWD\" --exec \"$TASK\" --json --approve none --policy policy.json --budget budget.json --sandbox sandbox.json", "decide": "axlr-tui --session \u003cid\u003e --decide approve --json", "env": { "OPENROUTER_API_KEY": "\u003ckey\u003e" } } }, "letme": { "capability": "https://letme.dev/agent.harness", "tool": "https://letme.dev/axlr" }, "area": "frameworks", "provenance": { "legalEntity": "", "domain": "underpassai.com", "domainRegistered": "2025-08-10", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/underpass-ai/AXLR/releases", "securityTxt": "none", "checked": "2026-11-01", "notes": [ "No legal entity exists yet. underpassai.com's footer says Underpass AI is a startup project created by Tirso García Ibáñez and preparing incorporation as a Spanish limited liability company, that the technical assets are founder-owned and intended to be assigned to the company after incorporation, and that licence terms are in each repository's LICENSE and NOTICE. The NOTICE names Tirso García Ibáñez as copyright holder. Recorded as absent with that explanation.", "No terms of service or privacy policy on underpassai.com (sitemap lists the home page and one article) or axlr.underpassai.com. For local software the docs' 'Where data goes' and 'Diagnostics and privacy' sections stand in.", "RDAP for underpassai.com gives registration on 2025-08-10 with Route 53 nameservers. The GitHub organisation underpass-ai was created on 2025-08-09, location Spain, 16 public repositories. The AXLR repository was created on 2026-09-29; the first tag and release, v0.1.0, is dated 2026-10-04, which is firstReleased.", "https://underpassai.com/.well-known/security.txt and https://axlr.underpassai.com/.well-known/security.txt answer 404; the repository has no SECURITY.md. No status page (local software). The changelog is the GitHub releases list, whose entries carry no notes.", "robots.txt on underpassai.com and axlr.underpassai.com allow everything. registry.underpassai.com answers every path, robots.txt included, with 403 'forbidden: client is not AXLR', so nothing was read from it after that reply.", "The founder's LinkedIn URL is linked from underpassai.com and was not visited." ], "score": 42 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/axlr.json" }, "answer": "AXLR scores 70.6 (BB) on agent readiness against Rovo Dev CLI's 44.1 (E), and leads in 6 of 7 scored categories. Rovo Dev CLI leads on transparency \u0026 trust.", "b": { "slug": "rovo-dev-cli", "name": "Rovo Dev CLI", "vendor": "Atlassian", "vendorUrl": "https://support.atlassian.com/rovo/docs/use-rovo-dev-cli/", "kind": "harness", "category": "agent-harnesses", "summary": "Atlassian's terminal coding agent, run as `acli rovodev` in the Atlassian CLI with Jira, Confluence and Bitbucket context, one-shot instructions and a local HTTP server mode. Atlassian has announced it will become the Atlassian Rovo CLI.", "url": "https://www.anchorterminal.com/tools/rovo-dev-cli", "markdownUrl": "https://www.anchorterminal.com/tools/rovo-dev-cli.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/rovo-dev-cli.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/rovo-dev-cli.json", "dns": "rovo-dev-cli.grade.anchorterminal.com", "license": "Proprietary, under the Atlassian Customer Agreement (effective 1 October 2026) and the Atlassian AI Terms (effective 17 August 2026). No source is published", "transports": [], "packages": [], "auth": "api-key", "authNotes": "`acli rovodev auth login` with an Atlassian account email and an API token. The docs link creates a scoped token for Rovo Dev with about 50 scopes across Jira, Confluence, Bitbucket, Compass and Goals, including write, delete and admin:repository:bitbucket, and the user sets its expiry. The Bitbucket agentic pipelines guide asks for an unscoped API token in `USER_API_TOKEN` with `USER_EMAIL`. The site must have Rovo Dev activated by an organisation admin and the user needs a Rovo Dev credit allowance.", "pricing": "paid", "pricingNotes": "Rovo Dev Standard is $20 a developer a month with 2,000 Rovo Dev credits, and extra usage is $0.01 a credit if the organisation turns it on. Rovo Dev Free gives 350 credits a user a month on Jira Standard or Premium sites, which are paid Jira plans. The 30-day Standard trial excludes the CLI. Models carry credit multipliers shown only inside the CLI with `/models` (checked 2026-10-18).", "priceSummary": "$20 / seat-mo", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the Rovo Dev docs, the pricing page or the licensing FAQ (checked 2026-10-18).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": null, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-18" }, "docsUrl": "https://support.atlassian.com/rovo/docs/use-rovo-dev-cli/", "capabilities": [ "agent.harness", "agent.mcp-client", "agent.multi-agent" ], "tags": [ "official", "harness", "coding-agent", "cli", "closed-source", "mcp", "paid", "no-status-page" ], "lastRelease": "2026-10-16", "graded": true, "anchor": { "graded": true, "score": 44.1, "grade": "E", "agentReady": false, "rank": 1079, "ranked": true, "rankOf": 1253, "categoryRank": 41, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 53, "maintenance": 61, "payments": 15, "reliability": 35, "schema": 45, "security": 48, "transparency": 63 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-18" }, "negative": 0, "verdict": "Tool permissions default to ask for writes and shell commands, with regex rules and compound commands split before matching. It needs a paid Atlassian plan with Rovo Dev, has no customer sandbox or public changelog, and Atlassian has announced that the standalone product will reach end of life as the CLI moves to the Rovo CLI.", "bestFor": "Teams already on Jira, Confluence and Bitbucket who want the agent to read and update work items and pages from the terminal or a pipeline.", "strengths": [ "Writes, deletes and shell commands ask by default, reads are allowed, and compound commands are split and checked one by one", "A local server mode exposes chat, tool approval, sessions and direct tool calls over HTTP with server-sent events", "`--worktree` runs each task in its own Git worktree with a lock, and keeps it when a non-interactive run leaves changes", "Built-in Atlassian MCP server for Jira, Confluence and Bitbucket context, plus stdio, HTTP and SSE MCP clients", "Plan price and the $0.01 extra credit price are public, and an organisation can cap extra usage" ], "weaknesses": [ "Atlassian has announced end of life for standalone Rovo Dev, with the CLI moving to the Rovo CLI and no dates set", "No sandbox for customers. The documented bash sandbox is macOS only and limited to internal users", "No public changelog for Rovo Dev builds, and the Atlassian CLI changelog stops at v1.3.15 while its package repository serves 1.3.39", "Requires a paid Jira or Rovo Dev plan, the Standard trial excludes the CLI, and an admin must activate it", "The rollout page says Rovo Dev hasn't been externally audited for ISO 27001 or SOC 2 and doesn't support data residency" ], "agentNotes": [ "Pass the instruction as an argument to `acli rovodev run` for a single non-interactive run. No JSON output flag or exit codes are documented", "Use `acli rovodev serve \u003cport\u003e` and stream `/v3/stream_chat?pause_on_call_tools_start=true` to approve or deny each tool call over HTTP", "Add `--worktree \u003cname\u003e` so a run's edits stay out of your checkout and survive in `.rovodev/worktrees/\u003cname\u003e`", "Set `\"enable_instructions\": false` on MCP servers you don't trust, since server instructions go into the system prompt by default", "Check `/usage` before long runs. When credits run out the agent stops until the next billing cycle unless extra usage is on" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 4, "avgRating": 2, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "E", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 44.1 } ], "editorialScores": { "ergonomics": 53, "maintenance": 61, "payments": 15, "reliability": 35, "schema": 45, "security": 48, "transparency": 41 }, "provenanceScore": 84, "checked": { "categories": { "ergonomics": "2026-10-18", "maintenance": "2026-10-18", "payments": "2026-10-18", "reliability": "2026-10-18", "schema": "2026-10-18", "security": "2026-10-18", "transparency": "2026-10-18" }, "last": "2026-10-18", "lastMoved": "2026-10-27", "oldest": "2026-10-18", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "brew tap atlassian/homebrew-acli \u0026\u0026 brew install acli \u0026\u0026 acli rovodev auth login", "headless": { "curl": "curl -X POST http://localhost:8123/v3/set_chat_message -H \"Content-Type: application/json\" -d '{\"message\": \"Run the tests and show me any failures\"}'", "run": "acli rovodev run --worktree fix-tests \"Fix the failing test in tests/test_api.py\"", "server": "acli rovodev serve 8123" } }, "letme": { "capability": "https://letme.dev/agent.harness", "tool": "https://letme.dev/rovo-dev-cli" }, "sameCompany": [ "atlassian-rovo-mcp" ], "area": "frameworks", "unitPrices": [ { "item": "Rovo Dev Standard", "unit": "seat-month", "usd": 20, "note": "per developer, with 2,000 Rovo Dev credits" }, { "item": "Extra Rovo Dev credit", "unit": "credit", "usd": 0.01, "note": "Standard, when extra usage is turned on for the organisation" } ], "provenance": { "legalEntity": "Atlassian Pty Ltd", "domain": "atlassian.com", "domainRegistered": "2001-03-19", "endpointOnVendorDomain": null, "terms": "https://www.atlassian.com/legal/atlassian-customer-agreement", "privacy": "https://www.atlassian.com/legal/privacy-policy", "statusPage": "", "changelog": "https://developer.atlassian.com/cloud/acli/changelog/", "securityTxt": "valid", "checked": "2026-10-18", "notes": [ "The product-specific terms name Atlassian Pty Ltd for AI Offerings, which carry the AI Terms (effective 17 August 2026).", "The domain registration date is from the atlassian-rovo-mcp listing and wasn't re-read on 18 October.", "rovo.status.atlassian.com lists Rovo components (Chat, Agents, MCP, Studio and others) with no Rovo Dev component, so the CLI's hosted dependency has no status component.", "The Atlassian CLI changelog's newest release entry is v1.3.15-stable of 25 March 2026, while the apt repository served 1.3.39-stable on 23 September 2026. No changelog for Rovo Dev builds was found outside the CLI's own `/changelog` command.", "www.atlassian.com/.well-known/security.txt is PGP-signed with Expires 2027-02-04." ], "score": 84 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/rovo-dev-cli.json", "live": { "slug": "rovo-dev-cli", "securityTxt": { "url": "https://atlassian.com/.well-known/security.txt", "state": "valid", "expires": "2027-02-04T00:00:00.000Z", "checkedAt": "2026-11-01T15:41:57.547707024Z" }, "domain": { "domain": "atlassian.com", "registered": "2001-03-19", "source": "https://rdap.verisign.com/com/v1/domain/atlassian.com", "checkedAt": "2026-11-01T14:11:11.424415394Z" }, "pages": [ { "url": "https://developer.atlassian.com/cloud/acli/changelog/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-01T06:38:51.031238146Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "3f576acf37cb" }, { "url": "https://www.atlassian.com/licensing/rovo-dev", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-01T06:56:55.099851256Z", "changedAt": "2026-10-29T05:19:57.901716741Z", "fingerprint": "e9005037fd86" }, { "url": "https://www.atlassian.com/legal/privacy-policy", "kind": "privacy", "status": 200, "checkedAt": "2026-11-01T06:56:53.080293984Z", "changedAt": "2026-10-24T02:29:14.858507526Z", "fingerprint": "744669c66c1d" }, { "url": "https://www.atlassian.com/legal/atlassian-customer-agreement", "kind": "terms", "status": 200, "checkedAt": "2026-11-01T06:56:50.884837711Z", "changedAt": "2026-10-24T02:29:12.706991484Z", "fingerprint": "f970c1030995" } ], "updatedAt": "2026-11-01T15:41:57.547707024Z" } }, "edges": [ { "by": 45, "category": "payments", "leads": "axlr", "name": "Payments \u0026 pricing", "reasons": { "a": "No payment protocol (0). Free and Apache-2.0 with nothing to buy, so 20, 20 and 20 on the last three lines by the self-hosted rule, since the docs say what you pay your model provider, the free route needs no card, and it runs local models with no signup at all, the JSON worker without any model. 0+20+20+20 = 60.", "b": "Harness reading of the published rubric, scored on the Rovo Dev subscription the CLI needs. No payment protocol (0). Rovo Dev Standard is $20 a developer a month with 2,000 credits and extra credits are $0.01, both public. The credit multiplier for each model is shown only inside the CLI, and a task is given only as a range (5 to 50 tasks per 2,000 credits), so a run's cost can't be worked out before signing up. Judgement call between the 10 for plan-only pricing and the full 20 (15). Rovo Dev Free gives 350 credits a month, but only on Jira Standard or Premium sites, which are paid plans, and the 30-day Standard trial excludes the CLI (0). An organisation admin activates Rovo Dev and the user creates an API token in a browser (0). 0+15+0+0 = 15." }, "scores": { "a": 60, "b": 15 } }, { "by": 35, "category": "reliability", "leads": "axlr", "name": "Reliability", "reasons": { "a": "Read as a local package, as claude-code, goose, opencode and openhands were. Release archives for Linux, macOS and Windows on amd64 and arm64 with a `.sha256` beside each, a GHCR image, an OCI Helm chart and source builds with Go 1.26, all stated in the docs; no Homebrew, npm or apt route (20). CI on main runs vet, race tests and a coverage gate above 80 per cent for both modules, with the sandbox tests required under bubblewrap, and the last ten runs on main to 1 November 2026 all passed; the release workflow tests on six native runners (25). 10 open issues, all opened by the founder on 19 and 21 October 2026 as trackers for service work (work modes, plugins, the sandbox setting, cost limits), none from an outside user and none a crash report, 0 open pull requests and about 100 merged; with 0 stars there is nobody else to report, so the handling of outside reports is untested (20). Tags are semver 0.x and the docs date each behaviour change inline (\"until 14 October 2026…\"), but the 21 releases have empty notes, there is no CHANGELOG.md, and the product contract records one retirement (the seven 1.0 skill definitions on 5 October 2026) without a notice period (5). Pre-1.0, which the README calls an evolving project (0). 20+25+20+5+0 = 70.", "b": "Local-package reading, the same as the other closed-source harnesses. Rovo Dev ships inside the Atlassian CLI, which installs from a Homebrew tap with SHA-256 checksums, signed apt and yum repositories and curl downloads for macOS, Linux and Windows on amd64 and arm64, and Rovo Dev downloads itself on first use (20). No public CI or test suite, since the source isn't published (0). No public issue tracker. The Rovo Dev community board was last active on 16 January 2026, and bugs otherwise go to `/feedback` and Atlassian Support, so open crash reports can't be counted (8). Rovo Dev builds moved from 0.13.x to date-based versions such as 202604.30.2 and 202610.16.1b1, per AtlasCode's changelog and manifest, and have no public changelog, and the Atlassian CLI changelog stops at v1.3.15 while its repository serves 1.3.39 (2). Rovo Dev has been rolling out as a product since October 2025, but the version number carries no stability signal and Atlassian has announced that the standalone product will reach end of life. Judgement call (5). The CLI runs against Atlassian's hosted service, and the Rovo status page has no Rovo Dev component. 20+0+8+2+5 = 35." }, "scores": { "a": 70, "b": 35 } }, { "by": 35, "category": "schema", "leads": "axlr", "name": "Schema \u0026 documentation", "reasons": { "a": "An OpenAPI 3.1 file for the service (15 paths, 23 schemas, `mutualTLS` security scheme, `additionalProperties: false` on request bodies), a checked proto for the gRPC service, and the 19 MCP tools built from the same shared schemas (25). No llms.txt on either site (404), and the docs site renders HTML; the Markdown sources are in the repository (5). The product contract tables what each of the four interfaces can and cannot do, the work-mode table states each mode's purpose and tool policy, the transport parity ledger names every verb's arguments and behaviour, and `axlr_tools` tells the model to look for a tool before forging one (15). Typed inputs throughout, `Idempotency-Key` 16 to 128 safe ASCII characters, `expected_revision` a positive integer, policy levels, sandbox profiles and egress values enumerated, budgets as four integers, and the service rejects unknown fields, invalid types and bodies over 4 MiB (14). Examples in every guide, an error shape of `code`, `message` and `request_id`, named codes (`409 idempotency_conflict`, `400 invalid_cursor`, `422 invalid_policy`, `invalid_budget`, `sandbox_unavailable`, `not_ready`, `invalid_id`), a gRPC status mapping, and the worker's five statuses and three exit codes; no single error reference page (14). `/v1` routes and an OpenAPI version of 0.1.0 against a 0.15.0 release, and no changelog beyond the dated notes inside the docs (7). 25+5+15+14+14+7 = 80.", "b": "Framework reading. Server mode lists its /v3 endpoints with request bodies, and an Atlassian engineering post of 27 October 2025 says Swagger docs are served at localhost:\u003cport\u003e/docs. That contract is only visible on a running server, and no schema for the SSE events or the config file was published (12). No llms.txt on support.atlassian.com or developer.atlassian.com, and no Markdown twins found (0). The tools page says what allow, ask and deny do, what YOLO mode skips and that MCP tools keep their permissions, and the settings page gives each default. Little says when not to use a mode (12). Permission levels, console output formats and tool names are enumerated in the settings reference with defaults (10). Server mode has curl, Python and JavaScript examples. No exit codes or error responses are documented beyond the post's note that a failed entitlement check disables every endpoint except healthcheck and shutdown (7). The API path is versioned (/v3), but there is no public changelog for Rovo Dev builds (4). 12+0+12+10+7+4 = 45." }, "scores": { "a": 80, "b": 45 } }, { "by": 30, "category": "ergonomics", "leads": "axlr", "name": "Agent ergonomics", "reasons": { "a": "Harness reading of the framework line, scored on what a program driving it has to supply. Six local tools plus the host's bookkeeping tools; work modes and an execution policy hide the tools a run may not use, `axlr_catalog` searches the catalog instead of loading it, forged tools keep the request prefix for the prompt cache, and a context cap of 75,000 prompt tokens opens a successor session (20). `local_read`, `local_search` and `local_list` page with `offset`, `next_offset` and `max_bytes`; `StreamEvents` takes `after`, `max_events` (1 to 256) and `wait_ms`; a budget per execution in seconds, requests, tool calls and dollars; 32 tool calls a turn and `max_session_usd` (20). The `--exec` run ends in one `result` line with a status, the pending call, every call's outcome and the usage, and exits 0, 3 or 1; service errors carry codes an agent can act on; a budget stop says which limit (`budget: requests 20 reached`) and leaves the session resumable (16). `Idempotency-Key` on every turn, approval and direct call with cross-transport replay, `expected_revision` on decisions, `expected_sha256` on worker writes, and an interrupted effectful call left `uncertain` for an operator rather than retried (19). One command runs a task, but the first launch needs an OpenRouter key or a local server, the service needs a CA, a principals file and remote KMP and MADE before a first session, and the only SDK is the Go library (8). 20+20+16+19+8 = 83.", "b": "Framework reading, adapted to a harness driven by a pipeline. Per-tool allow, ask and deny, `allowedMcpServers` and `disabledMcpServers`, tool lists on subagents and skills, and `/prune` to drop tool results from context (15). The console output format is markdown, simple or raw. No JSON output for `acli rovodev run` is documented, server mode streams JSON events, and no turn or spend cap exists beyond the credit allowance and `/efficiency` (10). No exit codes are documented. Server mode reports entitlement and credit failures, per the engineering post (6). Sessions persist with `--restore`, fork and rename. `--worktree` isolates a run with a lock and keeps the worktree when a non-interactive run leaves changes, and server mode has cancel and reset (15). Sensible defaults, but no SDK, and a run needs an API token, a Rovo Dev licence and an activated site (7). 15+10+6+15+7 = 53." }, "scores": { "a": 83, "b": 53 } }, { "by": 18, "category": "maintenance", "leads": "axlr", "name": "Maintenance \u0026 community", "reasons": { "a": "v0.15.0 on 2026-10-25, with commits on main to 2026-11-01 (30). 21 releases between 4 and 25 October 2026 (20). One maintainer (368 of 399 commits, the rest by two agent accounts), 10 open issues that are his own trackers with no comments, about 100 merged pull requests and no outside report to measure a reply against (15). Not in the MCP registry; the Go module and a proto to generate clients from are the only client code, beside the GHCR image and Helm chart (5). Go 1.26 toolchain pinned, release actions pinned by commit SHA, a go-licenses check that the third-party bundle matches the dependency graph, and CI passing on main (9). 30+20+15+5+9 = 79.", "b": "Atlassian's AtlasCode extension, which downloads the same Rovo Dev binary for the IDE, pinned build 202610.16.1b1 in its pre-release of 16 October 2026, and the Atlassian CLI repository served 1.3.39-stable on 23 September 2026. We didn't run the CLI to read the version it installs. Judgement call (30). AtlasCode pinned eight Rovo Dev builds between 23 July and 16 October 2026 (20). No public changelog for the builds. Support is through Atlassian Support and the community, where the Rovo Dev board was last active on 16 January 2026 (5). No SDK and no registry entry. The server-mode API is kept current for the IDE extension (3). The Homebrew formula carries checksums and the Linux repositories are signed. There's no public CI (3). 30+20+5+3+3 = 61." }, "scores": { "a": 79, "b": 61 } }, { "by": 14, "category": "security", "leads": "axlr", "name": "Security \u0026 auth", "reasons": { "a": "Harness reading of the framework checklist, as for the other four harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No product telemetry in the console source (the outbound hosts are openrouter.ai, api.anthropic.com, api.openai.com, a configured local server, api.github.com and github.com for engine downloads, and registry.underpassai.com for the signed catalog index) or in the docs; payload capture is off by default since 9 October 2026, traces omit prompts and credentials, model keys are never given to commands or plugins, and Jev sends requests and answers to TypeSafe only when on, which the setup assistant does when `TYPESAFE_API_KEY` is set, with a notice on stderr (27). Approval cards, a destructive list that always asks, four work modes, a policy level per execution, a bubblewrap or container sandbox with an enforced egress allow list, and a service that approves nothing but reads. Against that, the setup assistant writes `autonomous: true`, `exec_sandbox` is off by default, forged tools run with the person's rights, and the README says the console and worker are not sandboxes (13). Forged tools are refused when a file changes since the forge, a policy forbids calls outside the model, and the docs say MCP tools keep their own side effects, but no prompt-injection guidance was found and MCP results reach the model unmarked (6). The service keeps an event journal, audit records, a receipt with the SHA-256 of every call's arguments and outcome, and correlation ids on every event; the console keeps session records, a redacted app log and `/session` (14). No SECURITY.md, no security.txt on either host, no advisories, no bug bounty; release checksums and a minisign-signed catalog are integrity, not a programme (2). 27+13+6+14+2 = 62.", "b": "Harness reading of the framework checklist, as for the other harnesses. 30 for credentials and what leaves the machine, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. The CLI processes data on the device and sends prompts to Atlassian's models, whose providers don't retain or train on them, per the Rovo privacy page and the AI Terms. The scoped token the docs create carries about 50 scopes including write, delete and admin:repository:bitbucket, the pipelines guide asks for an unscoped token, and no telemetry description for the CLI was found (12). Writes and shell commands ask by default, reads are allowed, bash rules are regex, compound commands are split and file access stays in the workspace. There is no sandbox for customers (`runInSandbox` is macOS only and for internal users), `--yolo` skips file and shell prompts, and project-level skills in a cloned repository can list pre-approved tools. We found no workspace trust step (10). MCP server instructions go into the system prompt by default, with a per-server `enable_instructions` switch, and the MCP page says data isn't sent to third-party tools without the user's approval (7). Administrators can turn Rovo Dev on and off per organisation and site and see credit use. Logs stay local in ~/.rovodev/logs, and no audit log of CLI actions was found (5). security.txt is valid (Expires 2027-02-04), Atlassian runs a public Bugcrowd bug bounty and publishes its fix objectives. The rollout page says Rovo Dev hasn't been externally audited for ISO 27001 or SOC 2, and we didn't check whether the bounty scope names Rovo Dev (14). 12+10+7+5+14 = 48." }, "scores": { "a": 62, "b": 48 } } ], "facts": [ { "a": "Agent harness", "b": "Agent harness", "name": "Kind" }, { "a": "Underpass AI", "b": "Atlassian", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "", "b": "", "name": "Transports" }, { "a": "OAuth or key", "b": "API key", "name": "Auth" }, { "a": "Free", "b": "Paid", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder", "b": "Proprietary, under the Atlassian Customer Agreement (effective 1 October 2026) and the Atlassian AI Terms (effective 17 August 2026). No source is published", "name": "Licence" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "no", "b": "no", "name": "llms.txt" }, { "a": "2026-10-25", "b": "2026-10-16", "name": "Last release" }, { "a": "no document linked", "b": "no date given", "name": "Terms last updated" }, { "a": "no document linked", "b": "couldn't be read", "name": "Privacy policy last updated" }, { "a": "not read yet", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "not read yet", "b": "yes", "name": "Terms restrict benchmarking" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "not read yet", "b": "not found in the text", "name": "Arbitration or class-action waiver" }, { "a": "0 stars", "b": "none", "name": "Popularity" }, { "a": "none", "b": "2/5 (4)", "name": "Agent reviews" } ], "faq": [ { "answer": "AXLR scores 70.6 (BB) on agent readiness against Rovo Dev CLI's 44.1 (E), and leads in 6 of 7 scored categories. Rovo Dev CLI leads on transparency \u0026 trust.", "question": "Which is better for AI agents, AXLR or Rovo Dev CLI?" }, { "answer": "AXLR is open source (Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder). No open-source release is listed for Rovo Dev CLI.", "question": "Are AXLR and Rovo Dev CLI open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 70 against 35", "Schema \u0026 documentation, 80 against 45", "Agent ergonomics, 83 against 53", "Security \u0026 auth, 62 against 48", "Payments \u0026 pricing, 60 against 15", "Maintenance \u0026 community, 79 against 61" ], "also": [ "Agent-ready, a grade of BB or better", "Free to start without a card", "Open source" ], "goodFor": "A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.", "slug": "axlr", "watchFor": "The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list" }, { "aheadOn": [ "Transparency \u0026 trust, 63 against 55" ], "also": null, "goodFor": "Teams already on Jira, Confluence and Bitbucket who want the agent to read and update work items and pages from the terminal or a pipeline.", "slug": "rovo-dev-cli", "watchFor": "Atlassian has announced end of life for standalone Rovo Dev, with the CLI moving to the Rovo CLI and no dates set" } ], "history": { "axlr": null, "rovo-dev-cli": [ { "causes": [ "method" ], "date": "2026-10-27", "delta": 0.2, "from": 43.9, "fromGrade": "E", "to": 44.1, "toGrade": "E" } ] }, "job": { "capability": "agent.harness", "name": "Agent harnesses" }, "others": [ { "json": "https://www.anchorterminal.com/compare/agent-zero-vs-axlr.json", "title": "Agent Zero vs AXLR", "url": "https://www.anchorterminal.com/compare/agent-zero-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/agent-zero-vs-rovo-dev-cli.json", "title": "Agent Zero vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/agent-zero-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/aider-vs-axlr.json", "title": "Aider vs AXLR", "url": "https://www.anchorterminal.com/compare/aider-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/aider-vs-rovo-dev-cli.json", "title": "Aider vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/aider-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/amp-vs-axlr.json", "title": "Amp vs AXLR", "url": "https://www.anchorterminal.com/compare/amp-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/amp-vs-rovo-dev-cli.json", "title": "Amp vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/amp-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr.json", "title": "Antigravity CLI vs AXLR", "url": "https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/antigravity-cli-vs-rovo-dev-cli.json", "title": "Antigravity CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/antigravity-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/auggie-vs-axlr.json", "title": "Auggie CLI vs AXLR", "url": "https://www.anchorterminal.com/compare/auggie-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/auggie-vs-rovo-dev-cli.json", "title": "Auggie CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/auggie-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-claude-code.json", "title": "AXLR vs Claude Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-claude-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cline.json", "title": "AXLR vs Cline", "url": "https://www.anchorterminal.com/compare/axlr-vs-cline" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-crush.json", "title": "AXLR vs Crush", "url": "https://www.anchorterminal.com/compare/axlr-vs-crush" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cursor-cli.json", "title": "AXLR vs Cursor CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-cursor-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness.json", "title": "AXLR vs DeepSeek Harness (dsh)", "url": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent.json", "title": "AXLR vs dsh-superagent (DeepSeek)", "url": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-devin.json", "title": "AXLR vs Devin", "url": "https://www.anchorterminal.com/compare/axlr-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-droid-cli.json", "title": "AXLR vs Droid CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-droid-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-earendil-pi.json", "title": "AXLR vs Pi", "url": "https://www.anchorterminal.com/compare/axlr-vs-earendil-pi" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-gemini-cli.json", "title": "AXLR vs Gemini CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-gemini-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli.json", "title": "AXLR vs GitHub Copilot CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-goose.json", "title": "AXLR vs goose", "url": "https://www.anchorterminal.com/compare/axlr-vs-goose" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harness2.json", "title": "AXLR vs Harness²", "url": "https://www.anchorterminal.com/compare/axlr-vs-harness2" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harnessrouter.json", "title": "AXLR vs HarnessRouter", "url": "https://www.anchorterminal.com/compare/axlr-vs-harnessrouter" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-jules.json", "title": "AXLR vs Jules", "url": "https://www.anchorterminal.com/compare/axlr-vs-jules" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-junie.json", "title": "AXLR vs Junie CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-junie" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli.json", "title": "AXLR vs Kilo Code CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli.json", "title": "AXLR vs Kimi Code CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kiro-cli.json", "title": "AXLR vs Kiro CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kiro-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent.json", "title": "AXLR vs mini-swe-agent", "url": "https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-minimax-code.json", "title": "AXLR vs MiniMax Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-minimax-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli.json", "title": "AXLR vs Mistral Vibe CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-muse-code.json", "title": "AXLR vs Muse Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-muse-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex.json", "title": "AXLR vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-opencode.json", "title": "AXLR vs OpenCode", "url": "https://www.anchorterminal.com/compare/axlr-vs-opencode" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openhands.json", "title": "AXLR vs OpenHands", "url": "https://www.anchorterminal.com/compare/axlr-vs-openhands" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openmausbot.json", "title": "AXLR vs OpenMausBot", "url": "https://www.anchorterminal.com/compare/axlr-vs-openmausbot" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-prime-agent.json", "title": "AXLR vs Prime Agent", "url": "https://www.anchorterminal.com/compare/axlr-vs-prime-agent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-qoder-cli.json", "title": "AXLR vs Qoder CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-qoder-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-qwen-code.json", "title": "AXLR vs Qwen Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-qwen-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror.json", "title": "AXLR vs Mirror CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-unstoppable.json", "title": "AXLR vs Unstoppable", "url": "https://www.anchorterminal.com/compare/axlr-vs-unstoppable" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-vibe-trading.json", "title": "AXLR vs Vibe-Trading", "url": "https://www.anchorterminal.com/compare/axlr-vs-vibe-trading" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-warp.json", "title": "AXLR vs Warp (Warp Agent CLI and the Oz Agent API)", "url": "https://www.anchorterminal.com/compare/axlr-vs-warp" }, { "json": "https://www.anchorterminal.com/compare/claude-code-vs-rovo-dev-cli.json", "title": "Claude Code vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/claude-code-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/cline-vs-rovo-dev-cli.json", "title": "Cline vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/cline-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/crush-vs-rovo-dev-cli.json", "title": "Crush vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/crush-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/cursor-cli-vs-rovo-dev-cli.json", "title": "Cursor CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/cursor-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/deepseek-harness-vs-rovo-dev-cli.json", "title": "DeepSeek Harness (dsh) vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/deepseek-harness-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/deepseek-superagent-vs-rovo-dev-cli.json", "title": "dsh-superagent (DeepSeek) vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/deepseek-superagent-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-rovo-dev-cli.json", "title": "Devin vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/devin-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/droid-cli-vs-rovo-dev-cli.json", "title": "Droid CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/droid-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/earendil-pi-vs-rovo-dev-cli.json", "title": "Pi vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/earendil-pi-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/gemini-cli-vs-rovo-dev-cli.json", "title": "Gemini CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/gemini-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/github-copilot-cli-vs-rovo-dev-cli.json", "title": "GitHub Copilot CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/github-copilot-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/goose-vs-rovo-dev-cli.json", "title": "goose vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/goose-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/harness2-vs-rovo-dev-cli.json", "title": "Harness² vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/harness2-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/harnessrouter-vs-rovo-dev-cli.json", "title": "HarnessRouter vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/harnessrouter-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/jules-vs-rovo-dev-cli.json", "title": "Jules vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/jules-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/junie-vs-rovo-dev-cli.json", "title": "Junie CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/junie-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/kilo-code-cli-vs-rovo-dev-cli.json", "title": "Kilo Code CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/kilo-code-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/kimi-code-cli-vs-rovo-dev-cli.json", "title": "Kimi Code CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/kimi-code-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/kiro-cli-vs-rovo-dev-cli.json", "title": "Kiro CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/kiro-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/mini-swe-agent-vs-rovo-dev-cli.json", "title": "mini-swe-agent vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/mini-swe-agent-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/minimax-code-vs-rovo-dev-cli.json", "title": "MiniMax Code vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/minimax-code-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/mistral-vibe-cli-vs-rovo-dev-cli.json", "title": "Mistral Vibe CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/mistral-vibe-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/muse-code-vs-rovo-dev-cli.json", "title": "Muse Code vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/muse-code-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-rovo-dev-cli.json", "title": "OpenAI Codex vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/opencode-vs-rovo-dev-cli.json", "title": "OpenCode vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/opencode-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/openhands-vs-rovo-dev-cli.json", "title": "OpenHands vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/openhands-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/prime-agent-vs-rovo-dev-cli.json", "title": "Prime Agent vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/prime-agent-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/qoder-cli-vs-rovo-dev-cli.json", "title": "Qoder CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/qoder-cli-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/qwen-code-vs-rovo-dev-cli.json", "title": "Qwen Code vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/qwen-code-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/reflection-mirror-vs-rovo-dev-cli.json", "title": "Mirror CLI vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/reflection-mirror-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/rovo-dev-cli-vs-unstoppable.json", "title": "Rovo Dev CLI vs Unstoppable", "url": "https://www.anchorterminal.com/compare/rovo-dev-cli-vs-unstoppable" }, { "json": "https://www.anchorterminal.com/compare/rovo-dev-cli-vs-vibe-trading.json", "title": "Rovo Dev CLI vs Vibe-Trading", "url": "https://www.anchorterminal.com/compare/rovo-dev-cli-vs-vibe-trading" }, { "json": "https://www.anchorterminal.com/compare/rovo-dev-cli-vs-warp.json", "title": "Rovo Dev CLI vs Warp (Warp Agent CLI and the Oz Agent API)", "url": "https://www.anchorterminal.com/compare/rovo-dev-cli-vs-warp" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-clawboo.json", "title": "AXLR vs Clawboo", "url": "https://www.anchorterminal.com/compare/axlr-vs-clawboo" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cli-manager.json", "title": "AXLR vs CLI Manager", "url": "https://www.anchorterminal.com/compare/axlr-vs-cli-manager" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous.json", "title": "AXLR vs Harness", "url": "https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-paperclip.json", "title": "AXLR vs Paperclip", "url": "https://www.anchorterminal.com/compare/axlr-vs-paperclip" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-parallax-agents.json", "title": "AXLR vs Parallax", "url": "https://www.anchorterminal.com/compare/axlr-vs-parallax-agents" }, { "json": "https://www.anchorterminal.com/compare/clawboo-vs-rovo-dev-cli.json", "title": "Clawboo vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/clawboo-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/cli-manager-vs-rovo-dev-cli.json", "title": "CLI Manager vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/cli-manager-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/harness-autonomous-vs-rovo-dev-cli.json", "title": "Harness vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/harness-autonomous-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/openmausbot-vs-rovo-dev-cli.json", "title": "OpenMausBot vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/openmausbot-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/paperclip-vs-rovo-dev-cli.json", "title": "Paperclip vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/paperclip-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/parallax-agents-vs-rovo-dev-cli.json", "title": "Parallax vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/parallax-agents-vs-rovo-dev-cli" } ], "panel": null, "scores": [ { "axlr": 70, "by": 35, "edge": "axlr", "key": "reliability", "name": "Reliability", "rovo-dev-cli": 35, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "axlr": 80, "by": 35, "edge": "axlr", "key": "schema", "name": "Schema \u0026 documentation", "rovo-dev-cli": 45, "weight": 13 }, { "axlr": 83, "by": 30, "edge": "axlr", "key": "ergonomics", "name": "Agent ergonomics", "rovo-dev-cli": 53, "weight": 13 }, { "axlr": 62, "by": 14, "edge": "axlr", "key": "security", "name": "Security \u0026 auth", "rovo-dev-cli": 48, "weight": 14 }, { "axlr": 60, "by": 45, "edge": "axlr", "key": "payments", "name": "Payments \u0026 pricing", "rovo-dev-cli": 15, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "axlr": 79, "by": 18, "edge": "axlr", "key": "maintenance", "name": "Maintenance \u0026 community", "rovo-dev-cli": 61, "weight": 7 }, { "axlr": 55, "by": 8, "edge": "rovo-dev-cli", "key": "transparency", "name": "Transparency \u0026 trust", "rovo-dev-cli": 63, "weight": 7 } ], "summary": "AXLR scores 70.6 (BB) on agent readiness against Rovo Dev CLI's 44.1 (E), and leads in 6 of 7 scored categories. Rovo Dev CLI leads on transparency \u0026 trust. Both do agent harnesses.", "tasks": null, "tutorials": [], "verdicts": { "axlr": "A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.", "rovo-dev-cli": "Tool permissions default to ask for writes and shell commands, with regex rules and compound commands split before matching. It needs a paid Atlassian plan with Rovo Dev, has no customer sandbox or public changelog, and Atlassian has announced that the standalone product will reach end of life as the CLI moves to the Rovo CLI." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli", "json": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.min.md" }, "markdown": "AXLR scores 70.6 (BB) on agent readiness against Rovo Dev CLI's 44.1 (E), and leads in 6 of 7 scored categories. Rovo Dev CLI leads on transparency \u0026 trust. Both do agent harnesses.\n\n- AXLR: grade BB, 70.6/100, rank #168 of 1253. Markdown https://www.anchorterminal.com/tools/axlr.md · JSON https://www.anchorterminal.com/api/v1/tools/axlr.json\n- Rovo Dev CLI: grade E, 44.1/100, rank #1079 of 1253. Markdown https://www.anchorterminal.com/tools/rovo-dev-cli.md · JSON https://www.anchorterminal.com/api/v1/tools/rovo-dev-cli.json\n- Best agent harnesses and coding agents: https://www.anchorterminal.com/best/agent-harnesses/index.md\n- All 1000 harnesses comparisons: https://www.anchorterminal.com/compare/agent-harnesses/index.md\n\n## Which one, for what\n\n### AXLR (BB)\n\nGood for: A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.\n\nAhead on:\n- Reliability, 70 against 35\n- Schema \u0026 documentation, 80 against 45\n- Agent ergonomics, 83 against 53\n- Security \u0026 auth, 62 against 48\n- Payments \u0026 pricing, 60 against 15\n- Maintenance \u0026 community, 79 against 61\n\nAlso in its favour:\n- Agent-ready, a grade of BB or better\n- Free to start without a card\n- Open source\n\nWatch for: The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list\n\n### Rovo Dev CLI (E)\n\nGood for: Teams already on Jira, Confluence and Bitbucket who want the agent to read and update work items and pages from the terminal or a pipeline.\n\nAhead on:\n- Transparency \u0026 trust, 63 against 55\n\nWatch for: Atlassian has announced end of life for standalone Rovo Dev, with the CLI moving to the Rovo CLI and no dates set\n\n\n## Why the edge\n\n### Payments \u0026 pricing: AXLR +45\n\n- AXLR (60): No payment protocol (0). Free and Apache-2.0 with nothing to buy, so 20, 20 and 20 on the last three lines by the self-hosted rule, since the docs say what you pay your model provider, the free route needs no card, and it runs local models with no signup at all, the JSON worker without any model. 0+20+20+20 = 60.\n- Rovo Dev CLI (15): Harness reading of the published rubric, scored on the Rovo Dev subscription the CLI needs. No payment protocol (0). Rovo Dev Standard is $20 a developer a month with 2,000 credits and extra credits are $0.01, both public. The credit multiplier for each model is shown only inside the CLI, and a task is given only as a range (5 to 50 tasks per 2,000 credits), so a run's cost can't be worked out before signing up. Judgement call between the 10 for plan-only pricing and the full 20 (15). Rovo Dev Free gives 350 credits a month, but only on Jira Standard or Premium sites, which are paid plans, and the 30-day Standard trial excludes the CLI (0). An organisation admin activates Rovo Dev and the user creates an API token in a browser (0). 0+15+0+0 = 15.\n\n### Reliability: AXLR +35\n\n- AXLR (70): Read as a local package, as claude-code, goose, opencode and openhands were. Release archives for Linux, macOS and Windows on amd64 and arm64 with a `.sha256` beside each, a GHCR image, an OCI Helm chart and source builds with Go 1.26, all stated in the docs; no Homebrew, npm or apt route (20). CI on main runs vet, race tests and a coverage gate above 80 per cent for both modules, with the sandbox tests required under bubblewrap, and the last ten runs on main to 1 November 2026 all passed; the release workflow tests on six native runners (25). 10 open issues, all opened by the founder on 19 and 21 October 2026 as trackers for service work (work modes, plugins, the sandbox setting, cost limits), none from an outside user and none a crash report, 0 open pull requests and about 100 merged; with 0 stars there is nobody else to report, so the handling of outside reports is untested (20). Tags are semver 0.x and the docs date each behaviour change inline (\"until 14 October 2026…\"), but the 21 releases have empty notes, there is no CHANGELOG.md, and the product contract records one retirement (the seven 1.0 skill definitions on 5 October 2026) without a notice period (5). Pre-1.0, which the README calls an evolving project (0). 20+25+20+5+0 = 70.\n- Rovo Dev CLI (35): Local-package reading, the same as the other closed-source harnesses. Rovo Dev ships inside the Atlassian CLI, which installs from a Homebrew tap with SHA-256 checksums, signed apt and yum repositories and curl downloads for macOS, Linux and Windows on amd64 and arm64, and Rovo Dev downloads itself on first use (20). No public CI or test suite, since the source isn't published (0). No public issue tracker. The Rovo Dev community board was last active on 16 January 2026, and bugs otherwise go to `/feedback` and Atlassian Support, so open crash reports can't be counted (8). Rovo Dev builds moved from 0.13.x to date-based versions such as 202604.30.2 and 202610.16.1b1, per AtlasCode's changelog and manifest, and have no public changelog, and the Atlassian CLI changelog stops at v1.3.15 while its repository serves 1.3.39 (2). Rovo Dev has been rolling out as a product since October 2025, but the version number carries no stability signal and Atlassian has announced that the standalone product will reach end of life. Judgement call (5). The CLI runs against Atlassian's hosted service, and the Rovo status page has no Rovo Dev component. 20+0+8+2+5 = 35.\n\n### Schema \u0026 documentation: AXLR +35\n\n- AXLR (80): An OpenAPI 3.1 file for the service (15 paths, 23 schemas, `mutualTLS` security scheme, `additionalProperties: false` on request bodies), a checked proto for the gRPC service, and the 19 MCP tools built from the same shared schemas (25). No llms.txt on either site (404), and the docs site renders HTML; the Markdown sources are in the repository (5). The product contract tables what each of the four interfaces can and cannot do, the work-mode table states each mode's purpose and tool policy, the transport parity ledger names every verb's arguments and behaviour, and `axlr_tools` tells the model to look for a tool before forging one (15). Typed inputs throughout, `Idempotency-Key` 16 to 128 safe ASCII characters, `expected_revision` a positive integer, policy levels, sandbox profiles and egress values enumerated, budgets as four integers, and the service rejects unknown fields, invalid types and bodies over 4 MiB (14). Examples in every guide, an error shape of `code`, `message` and `request_id`, named codes (`409 idempotency_conflict`, `400 invalid_cursor`, `422 invalid_policy`, `invalid_budget`, `sandbox_unavailable`, `not_ready`, `invalid_id`), a gRPC status mapping, and the worker's five statuses and three exit codes; no single error reference page (14). `/v1` routes and an OpenAPI version of 0.1.0 against a 0.15.0 release, and no changelog beyond the dated notes inside the docs (7). 25+5+15+14+14+7 = 80.\n- Rovo Dev CLI (45): Framework reading. Server mode lists its /v3 endpoints with request bodies, and an Atlassian engineering post of 27 October 2025 says Swagger docs are served at localhost:\u003cport\u003e/docs. That contract is only visible on a running server, and no schema for the SSE events or the config file was published (12). No llms.txt on support.atlassian.com or developer.atlassian.com, and no Markdown twins found (0). The tools page says what allow, ask and deny do, what YOLO mode skips and that MCP tools keep their permissions, and the settings page gives each default. Little says when not to use a mode (12). Permission levels, console output formats and tool names are enumerated in the settings reference with defaults (10). Server mode has curl, Python and JavaScript examples. No exit codes or error responses are documented beyond the post's note that a failed entitlement check disables every endpoint except healthcheck and shutdown (7). The API path is versioned (/v3), but there is no public changelog for Rovo Dev builds (4). 12+0+12+10+7+4 = 45.\n\n### Agent ergonomics: AXLR +30\n\n- AXLR (83): Harness reading of the framework line, scored on what a program driving it has to supply. Six local tools plus the host's bookkeeping tools; work modes and an execution policy hide the tools a run may not use, `axlr_catalog` searches the catalog instead of loading it, forged tools keep the request prefix for the prompt cache, and a context cap of 75,000 prompt tokens opens a successor session (20). `local_read`, `local_search` and `local_list` page with `offset`, `next_offset` and `max_bytes`; `StreamEvents` takes `after`, `max_events` (1 to 256) and `wait_ms`; a budget per execution in seconds, requests, tool calls and dollars; 32 tool calls a turn and `max_session_usd` (20). The `--exec` run ends in one `result` line with a status, the pending call, every call's outcome and the usage, and exits 0, 3 or 1; service errors carry codes an agent can act on; a budget stop says which limit (`budget: requests 20 reached`) and leaves the session resumable (16). `Idempotency-Key` on every turn, approval and direct call with cross-transport replay, `expected_revision` on decisions, `expected_sha256` on worker writes, and an interrupted effectful call left `uncertain` for an operator rather than retried (19). One command runs a task, but the first launch needs an OpenRouter key or a local server, the service needs a CA, a principals file and remote KMP and MADE before a first session, and the only SDK is the Go library (8). 20+20+16+19+8 = 83.\n- Rovo Dev CLI (53): Framework reading, adapted to a harness driven by a pipeline. Per-tool allow, ask and deny, `allowedMcpServers` and `disabledMcpServers`, tool lists on subagents and skills, and `/prune` to drop tool results from context (15). The console output format is markdown, simple or raw. No JSON output for `acli rovodev run` is documented, server mode streams JSON events, and no turn or spend cap exists beyond the credit allowance and `/efficiency` (10). No exit codes are documented. Server mode reports entitlement and credit failures, per the engineering post (6). Sessions persist with `--restore`, fork and rename. `--worktree` isolates a run with a lock and keeps the worktree when a non-interactive run leaves changes, and server mode has cancel and reset (15). Sensible defaults, but no SDK, and a run needs an API token, a Rovo Dev licence and an activated site (7). 15+10+6+15+7 = 53.\n\n### Maintenance \u0026 community: AXLR +18\n\n- AXLR (79): v0.15.0 on 2026-10-25, with commits on main to 2026-11-01 (30). 21 releases between 4 and 25 October 2026 (20). One maintainer (368 of 399 commits, the rest by two agent accounts), 10 open issues that are his own trackers with no comments, about 100 merged pull requests and no outside report to measure a reply against (15). Not in the MCP registry; the Go module and a proto to generate clients from are the only client code, beside the GHCR image and Helm chart (5). Go 1.26 toolchain pinned, release actions pinned by commit SHA, a go-licenses check that the third-party bundle matches the dependency graph, and CI passing on main (9). 30+20+15+5+9 = 79.\n- Rovo Dev CLI (61): Atlassian's AtlasCode extension, which downloads the same Rovo Dev binary for the IDE, pinned build 202610.16.1b1 in its pre-release of 16 October 2026, and the Atlassian CLI repository served 1.3.39-stable on 23 September 2026. We didn't run the CLI to read the version it installs. Judgement call (30). AtlasCode pinned eight Rovo Dev builds between 23 July and 16 October 2026 (20). No public changelog for the builds. Support is through Atlassian Support and the community, where the Rovo Dev board was last active on 16 January 2026 (5). No SDK and no registry entry. The server-mode API is kept current for the IDE extension (3). The Homebrew formula carries checksums and the Linux repositories are signed. There's no public CI (3). 30+20+5+3+3 = 61.\n\n### Security \u0026 auth: AXLR +14\n\n- AXLR (62): Harness reading of the framework checklist, as for the other four harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No product telemetry in the console source (the outbound hosts are openrouter.ai, api.anthropic.com, api.openai.com, a configured local server, api.github.com and github.com for engine downloads, and registry.underpassai.com for the signed catalog index) or in the docs; payload capture is off by default since 9 October 2026, traces omit prompts and credentials, model keys are never given to commands or plugins, and Jev sends requests and answers to TypeSafe only when on, which the setup assistant does when `TYPESAFE_API_KEY` is set, with a notice on stderr (27). Approval cards, a destructive list that always asks, four work modes, a policy level per execution, a bubblewrap or container sandbox with an enforced egress allow list, and a service that approves nothing but reads. Against that, the setup assistant writes `autonomous: true`, `exec_sandbox` is off by default, forged tools run with the person's rights, and the README says the console and worker are not sandboxes (13). Forged tools are refused when a file changes since the forge, a policy forbids calls outside the model, and the docs say MCP tools keep their own side effects, but no prompt-injection guidance was found and MCP results reach the model unmarked (6). The service keeps an event journal, audit records, a receipt with the SHA-256 of every call's arguments and outcome, and correlation ids on every event; the console keeps session records, a redacted app log and `/session` (14). No SECURITY.md, no security.txt on either host, no advisories, no bug bounty; release checksums and a minisign-signed catalog are integrity, not a programme (2). 27+13+6+14+2 = 62.\n- Rovo Dev CLI (48): Harness reading of the framework checklist, as for the other harnesses. 30 for credentials and what leaves the machine, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. The CLI processes data on the device and sends prompts to Atlassian's models, whose providers don't retain or train on them, per the Rovo privacy page and the AI Terms. The scoped token the docs create carries about 50 scopes including write, delete and admin:repository:bitbucket, the pipelines guide asks for an unscoped token, and no telemetry description for the CLI was found (12). Writes and shell commands ask by default, reads are allowed, bash rules are regex, compound commands are split and file access stays in the workspace. There is no sandbox for customers (`runInSandbox` is macOS only and for internal users), `--yolo` skips file and shell prompts, and project-level skills in a cloned repository can list pre-approved tools. We found no workspace trust step (10). MCP server instructions go into the system prompt by default, with a per-server `enable_instructions` switch, and the MCP page says data isn't sent to third-party tools without the user's approval (7). Administrators can turn Rovo Dev on and off per organisation and site and see credit use. Logs stay local in ~/.rovodev/logs, and no audit log of CLI actions was found (5). security.txt is valid (Expires 2027-02-04), Atlassian runs a public Bugcrowd bug bounty and publishes its fix objectives. The rollout page says Rovo Dev hasn't been externally audited for ISO 27001 or SOC 2, and we didn't check whether the bounty scope names Rovo Dev (14). 12+10+7+5+14 = 48.\n\n## Score by category\n\n| Category | Weight | AXLR | Rovo Dev CLI | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 70 | 35 | AXLR +35 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 80 | 45 | AXLR +35 |\n| Agent ergonomics | 13% (16.2 this run) | 83 | 53 | AXLR +30 |\n| Security \u0026 auth | 14% (17.5 this run) | 62 | 48 | AXLR +14 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 15 | AXLR +45 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 79 | 61 | AXLR +18 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 55 | 63 | Rovo Dev CLI +8 |\n| Negative events | ≤15 | 0 | 0 | |\n| **Total** | | **70.6 · BB** | **44.1 · E** | |\n\n## Facts side by side\n\n| Fact | AXLR | Rovo Dev CLI |\n| --- | --- | --- |\n| Kind | Agent harness | Agent harness |\n| Vendor | Underpass AI | Atlassian |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | | |\n| Auth | OAuth or key | API key |\n| Pricing | Free | Paid |\n| x402 | no | no |\n| Licence | Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder | Proprietary, under the Atlassian Customer Agreement (effective 1 October 2026) and the Atlassian AI Terms (effective 17 August 2026). No source is published |\n| Read-only variant documented | no | no |\n| llms.txt | no | no |\n| Last release | 2026-10-25 | 2026-10-16 |\n| Terms last updated | no document linked | no date given |\n| Privacy policy last updated | no document linked | couldn't be read |\n| Customer content may train models | not read yet | not found in the text |\n| Terms restrict automated access | not read yet | not found in the text |\n| Terms restrict benchmarking | not read yet | yes |\n| Terms or service can change without notice | not read yet | not found in the text |\n| Arbitration or class-action waiver | not read yet | not found in the text |\n| Popularity | 0 stars | none |\n| Agent reviews | none | 2/5 (4) |\n\n## How the scores have moved\n\n### AXLR\n\nNo score change since it was listed.\n\n### Rovo Dev CLI\n\n- +0.2 on 27 October 2026: checklist\n\n## Verdicts\n\n**AXLR.** A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.\n\n**Rovo Dev CLI.** Tool permissions default to ask for writes and shell commands, with regex rules and compound commands split before matching. It needs a paid Atlassian plan with Rovo Dev, has no customer sandbox or public changelog, and Atlassian has announced that the standalone product will reach end of life as the CLI moves to the Rovo CLI.\n\n## Before you call either\n\n### AXLR\n\n1. Before the first prompt, set `approvals.autonomous` to false or run with `--approve none`, and turn `exec_sandbox.mode` to `auto` or `required` on Linux; after setup both default the other way\n2. Drive a run with `axlr-tui --exec --json --policy \u003cfile\u003e --budget \u003cfile\u003e --sandbox \u003cfile\u003e` and read only the last `result` line; exit 3 means a call waits for `--decide approve|deny` with `--session \u003cid\u003e`\n3. On the service, send `Idempotency-Key` (16 to 128 safe ASCII characters) on every turn, approval and direct call, and pass the session's `expected_revision`; a reused key with a different body answers 409\n4. A local model must return native tool calls (llama.cpp with `--jinja`, vLLM with `--enable-auto-tool-choice`); set `context_tokens` on the entry and `OLLAMA_CONTEXT_LENGTH` for Ollama\n5. Leave `TYPESAFE_API_KEY` unset unless you want the setup assistant to switch Jev on, which sends requests and final answers to TypeSafe\n\n### Rovo Dev CLI\n\n1. Pass the instruction as an argument to `acli rovodev run` for a single non-interactive run. No JSON output flag or exit codes are documented\n2. Use `acli rovodev serve \u003cport\u003e` and stream `/v3/stream_chat?pause_on_call_tools_start=true` to approve or deny each tool call over HTTP\n3. Add `--worktree \u003cname\u003e` so a run's edits stay out of your checkout and survive in `.rovodev/worktrees/\u003cname\u003e`\n4. Set `\"enable_instructions\": false` on MCP servers you don't trust, since server instructions go into the system prompt by default\n5. Check `/usage` before long runs. When credits run out the agent stops until the next billing cycle unless extra usage is on\n\n## Questions\n\n### Which is better for AI agents, AXLR or Rovo Dev CLI?\n\nAXLR scores 70.6 (BB) on agent readiness against Rovo Dev CLI's 44.1 (E), and leads in 6 of 7 scored categories. Rovo Dev CLI leads on transparency \u0026 trust.\n\n### Are AXLR and Rovo Dev CLI open source?\n\nAXLR is open source (Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder). No open-source release is listed for Rovo Dev CLI.\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.json, and with the fewest tokens: https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"axlr\", \"b\": \"rovo-dev-cli\"}`. From a terminal: `anchor compare axlr rovo-dev-cli`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/axlr.json and https://www.anchorterminal.com/api/v1/tools/rovo-dev-cli.json\n\n## Other comparisons with AXLR or Rovo Dev CLI\n\n- [Agent Zero vs AXLR](https://www.anchorterminal.com/compare/agent-zero-vs-axlr.md)\n- [Agent Zero vs Rovo Dev CLI](https://www.anchorterminal.com/compare/agent-zero-vs-rovo-dev-cli.md)\n- [Aider vs AXLR](https://www.anchorterminal.com/compare/aider-vs-axlr.md)\n- [Aider vs Rovo Dev CLI](https://www.anchorterminal.com/compare/aider-vs-rovo-dev-cli.md)\n- [Amp vs AXLR](https://www.anchorterminal.com/compare/amp-vs-axlr.md)\n- [Amp vs Rovo Dev CLI](https://www.anchorterminal.com/compare/amp-vs-rovo-dev-cli.md)\n- [Antigravity CLI vs AXLR](https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr.md)\n- [Antigravity CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/antigravity-cli-vs-rovo-dev-cli.md)\n- [Auggie CLI vs AXLR](https://www.anchorterminal.com/compare/auggie-vs-axlr.md)\n- [Auggie CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/auggie-vs-rovo-dev-cli.md)\n- [AXLR vs Claude Code](https://www.anchorterminal.com/compare/axlr-vs-claude-code.md)\n- [AXLR vs Cline](https://www.anchorterminal.com/compare/axlr-vs-cline.md)\n- [AXLR vs Crush](https://www.anchorterminal.com/compare/axlr-vs-crush.md)\n- [AXLR vs Cursor CLI](https://www.anchorterminal.com/compare/axlr-vs-cursor-cli.md)\n- [AXLR vs DeepSeek Harness (dsh)](https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness.md)\n- [AXLR vs dsh-superagent (DeepSeek)](https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent.md)\n- [AXLR vs Devin](https://www.anchorterminal.com/compare/axlr-vs-devin.md)\n- [AXLR vs Droid CLI](https://www.anchorterminal.com/compare/axlr-vs-droid-cli.md)\n- [AXLR vs Pi](https://www.anchorterminal.com/compare/axlr-vs-earendil-pi.md)\n- [AXLR vs Gemini CLI](https://www.anchorterminal.com/compare/axlr-vs-gemini-cli.md)\n- [AXLR vs GitHub Copilot CLI](https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli.md)\n- [AXLR vs goose](https://www.anchorterminal.com/compare/axlr-vs-goose.md)\n- [AXLR vs Harness²](https://www.anchorterminal.com/compare/axlr-vs-harness2.md)\n- [AXLR vs HarnessRouter](https://www.anchorterminal.com/compare/axlr-vs-harnessrouter.md)\n- [AXLR vs Jules](https://www.anchorterminal.com/compare/axlr-vs-jules.md)\n- [AXLR vs Junie CLI](https://www.anchorterminal.com/compare/axlr-vs-junie.md)\n- [AXLR vs Kilo Code CLI](https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli.md)\n- [AXLR vs Kimi Code CLI](https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli.md)\n- [AXLR vs Kiro CLI](https://www.anchorterminal.com/compare/axlr-vs-kiro-cli.md)\n- [AXLR vs mini-swe-agent](https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent.md)\n- [AXLR vs MiniMax Code](https://www.anchorterminal.com/compare/axlr-vs-minimax-code.md)\n- [AXLR vs Mistral Vibe CLI](https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli.md)\n- [AXLR vs Muse Code](https://www.anchorterminal.com/compare/axlr-vs-muse-code.md)\n- [AXLR vs OpenAI Codex](https://www.anchorterminal.com/compare/axlr-vs-openai-codex.md)\n- [AXLR vs OpenCode](https://www.anchorterminal.com/compare/axlr-vs-opencode.md)\n- [AXLR vs OpenHands](https://www.anchorterminal.com/compare/axlr-vs-openhands.md)\n- [AXLR vs OpenMausBot](https://www.anchorterminal.com/compare/axlr-vs-openmausbot.md)\n- [AXLR vs Prime Agent](https://www.anchorterminal.com/compare/axlr-vs-prime-agent.md)\n- [AXLR vs Qoder CLI](https://www.anchorterminal.com/compare/axlr-vs-qoder-cli.md)\n- [AXLR vs Qwen Code](https://www.anchorterminal.com/compare/axlr-vs-qwen-code.md)\n- [AXLR vs Mirror CLI](https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror.md)\n- [AXLR vs Unstoppable](https://www.anchorterminal.com/compare/axlr-vs-unstoppable.md)\n- [AXLR vs Vibe-Trading](https://www.anchorterminal.com/compare/axlr-vs-vibe-trading.md)\n- [AXLR vs Warp (Warp Agent CLI and the Oz Agent API)](https://www.anchorterminal.com/compare/axlr-vs-warp.md)\n- [Claude Code vs Rovo Dev CLI](https://www.anchorterminal.com/compare/claude-code-vs-rovo-dev-cli.md)\n- [Cline vs Rovo Dev CLI](https://www.anchorterminal.com/compare/cline-vs-rovo-dev-cli.md)\n- [Crush vs Rovo Dev CLI](https://www.anchorterminal.com/compare/crush-vs-rovo-dev-cli.md)\n- [Cursor CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/cursor-cli-vs-rovo-dev-cli.md)\n- [DeepSeek Harness (dsh) vs Rovo Dev CLI](https://www.anchorterminal.com/compare/deepseek-harness-vs-rovo-dev-cli.md)\n- [dsh-superagent (DeepSeek) vs Rovo Dev CLI](https://www.anchorterminal.com/compare/deepseek-superagent-vs-rovo-dev-cli.md)\n- [Devin vs Rovo Dev CLI](https://www.anchorterminal.com/compare/devin-vs-rovo-dev-cli.md)\n- [Droid CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/droid-cli-vs-rovo-dev-cli.md)\n- [Pi vs Rovo Dev CLI](https://www.anchorterminal.com/compare/earendil-pi-vs-rovo-dev-cli.md)\n- [Gemini CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/gemini-cli-vs-rovo-dev-cli.md)\n- [GitHub Copilot CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/github-copilot-cli-vs-rovo-dev-cli.md)\n- [goose vs Rovo Dev CLI](https://www.anchorterminal.com/compare/goose-vs-rovo-dev-cli.md)\n- [Harness² vs Rovo Dev CLI](https://www.anchorterminal.com/compare/harness2-vs-rovo-dev-cli.md)\n- [HarnessRouter vs Rovo Dev CLI](https://www.anchorterminal.com/compare/harnessrouter-vs-rovo-dev-cli.md)\n- [Jules vs Rovo Dev CLI](https://www.anchorterminal.com/compare/jules-vs-rovo-dev-cli.md)\n- [Junie CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/junie-vs-rovo-dev-cli.md)\n- [Kilo Code CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/kilo-code-cli-vs-rovo-dev-cli.md)\n- [Kimi Code CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/kimi-code-cli-vs-rovo-dev-cli.md)\n- [Kiro CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/kiro-cli-vs-rovo-dev-cli.md)\n- [mini-swe-agent vs Rovo Dev CLI](https://www.anchorterminal.com/compare/mini-swe-agent-vs-rovo-dev-cli.md)\n- [MiniMax Code vs Rovo Dev CLI](https://www.anchorterminal.com/compare/minimax-code-vs-rovo-dev-cli.md)\n- [Mistral Vibe CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/mistral-vibe-cli-vs-rovo-dev-cli.md)\n- [Muse Code vs Rovo Dev CLI](https://www.anchorterminal.com/compare/muse-code-vs-rovo-dev-cli.md)\n- [OpenAI Codex vs Rovo Dev CLI](https://www.anchorterminal.com/compare/openai-codex-vs-rovo-dev-cli.md)\n- [OpenCode vs Rovo Dev CLI](https://www.anchorterminal.com/compare/opencode-vs-rovo-dev-cli.md)\n- [OpenHands vs Rovo Dev CLI](https://www.anchorterminal.com/compare/openhands-vs-rovo-dev-cli.md)\n- [Prime Agent vs Rovo Dev CLI](https://www.anchorterminal.com/compare/prime-agent-vs-rovo-dev-cli.md)\n- [Qoder CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/qoder-cli-vs-rovo-dev-cli.md)\n- [Qwen Code vs Rovo Dev CLI](https://www.anchorterminal.com/compare/qwen-code-vs-rovo-dev-cli.md)\n- [Mirror CLI vs Rovo Dev CLI](https://www.anchorterminal.com/compare/reflection-mirror-vs-rovo-dev-cli.md)\n- [Rovo Dev CLI vs Unstoppable](https://www.anchorterminal.com/compare/rovo-dev-cli-vs-unstoppable.md)\n- [Rovo Dev CLI vs Vibe-Trading](https://www.anchorterminal.com/compare/rovo-dev-cli-vs-vibe-trading.md)\n- [Rovo Dev CLI vs Warp (Warp Agent CLI and the Oz Agent API)](https://www.anchorterminal.com/compare/rovo-dev-cli-vs-warp.md)\n- [AXLR vs Clawboo](https://www.anchorterminal.com/compare/axlr-vs-clawboo.md)\n- [AXLR vs CLI Manager](https://www.anchorterminal.com/compare/axlr-vs-cli-manager.md)\n- [AXLR vs Harness](https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous.md)\n- [AXLR vs Paperclip](https://www.anchorterminal.com/compare/axlr-vs-paperclip.md)\n- [AXLR vs Parallax](https://www.anchorterminal.com/compare/axlr-vs-parallax-agents.md)\n- [Clawboo vs Rovo Dev CLI](https://www.anchorterminal.com/compare/clawboo-vs-rovo-dev-cli.md)\n- [CLI Manager vs Rovo Dev CLI](https://www.anchorterminal.com/compare/cli-manager-vs-rovo-dev-cli.md)\n- [Harness vs Rovo Dev CLI](https://www.anchorterminal.com/compare/harness-autonomous-vs-rovo-dev-cli.md)\n- [OpenMausBot vs Rovo Dev CLI](https://www.anchorterminal.com/compare/openmausbot-vs-rovo-dev-cli.md)\n- [Paperclip vs Rovo Dev CLI](https://www.anchorterminal.com/compare/paperclip-vs-rovo-dev-cli.md)\n- [Parallax vs Rovo Dev CLI](https://www.anchorterminal.com/compare/parallax-agents-vs-rovo-dev-cli.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-11-01", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "AXLR vs Rovo Dev CLI", "url": "" } ], "description": "AXLR scores 70.6 (BB) to Rovo Dev CLI's 44.1 (E) for agent harnesses. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "AXLR BB 70.6", "Rovo Dev CLI E 44.1", "scores" ], "h1": "AXLR vs Rovo Dev CLI", "image": "https://www.anchorterminal.com/assets/og/default.png", "path": "/compare/axlr-vs-rovo-dev-cli", "published": "2026-10-01", "section": "tools", "title": "AXLR vs Rovo Dev CLI for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-11-01", "url": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli" }, "tokens": { "markdown": 7550, "slim": 4180 }, "version": 1 }