{ "data": { "a": { "slug": "axlr", "name": "AXLR", "vendor": "Underpass AI", "vendorUrl": "https://axlr.underpassai.com", "kind": "harness", "category": "agent-harnesses", "summary": "Open-source Go execution engine for agentic work from Underpass AI. A console with work modes and approval cards, an mTLS HTTP, gRPC and MCP service, a JSON worker and a Go library, with KMP memory and MADE procedures over MCP.", "url": "https://www.anchorterminal.com/tools/axlr", "markdownUrl": "https://www.anchorterminal.com/tools/axlr.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/axlr.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/axlr.json", "dns": "axlr.grade.anchorterminal.com", "repo": "https://github.com/underpass-ai/AXLR", "license": "Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder", "transports": [], "packages": [ { "registry": "go", "name": "github.com/underpass-ai/AXLR" }, { "registry": "oci", "name": "ghcr.io/underpass-ai/axlr" }, { "registry": "oci", "name": "ghcr.io/underpass-ai/charts/axlr" } ], "auth": "mixed", "authNotes": "The console and the one-command `axlr-tui --exec` need a model route, an OpenRouter key (`OPENROUTER_API_KEY` or `credentials.json`, mode 0600), a local OpenAI-compatible server, or an Anthropic Messages or OpenAI Responses key in a `local_models` entry; the JSON worker and the library tests need no model account. The service, `axlr-serve`, requires TLS 1.3 and a client certificate signed by its CA whose SHA-256 fingerprint is mapped in a private principals file to a principal and the roles `session_client`, `approver`, `tool_operator` and `admin`; an unmapped certificate is forbidden, a session belongs to the principal that created it, and authentication never approves a tool by itself. MCP at `/mcp` is stateless and authenticated per request by the same certificate; gRPC uses the TLS peer certificate.", "pricing": "free", "pricingNotes": "Free and open source under Apache-2.0, with nothing to buy from Underpass AI. You pay your model provider (OpenRouter reports a cost per request, which the console's `/usage` and `max_session_usd` track) or run a local server at no charge; TypeSafe's Jev judge is optional and needs its own key. No hosted AXLR exists (checked 2026-11-01).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the repository, the OpenAPI file or the two sites (checked 2026-11-01). Nothing is sold.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 0, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-11-01" }, "docsUrl": "https://axlr.underpassai.com/docs/", "openapi": "https://github.com/underpass-ai/AXLR/blob/main/api/openapi/axlr-v1.yaml", "capabilities": [ "agent.harness", "agent.mcp-client", "agent.multi-agent" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "go", "cli", "mcp-client", "openapi", "grpc", "docker", "helm", "sandbox", "approvals", "pre-1.0", "new" ], "lastRelease": "2026-10-25", "graded": true, "anchor": { "graded": true, "score": 70.6, "grade": "BB", "agentReady": true, "rank": 168, "ranked": true, "rankOf": 1253, "categoryRank": 3, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 83, "maintenance": 79, "payments": 60, "reliability": 70, "schema": 80, "security": 62, "transparency": 55 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-01" }, "negative": 0, "verdict": "A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.", "bestFor": "A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.", "strengths": [ "mTLS HTTP, gRPC and MCP service with four principal roles, `Idempotency-Key` required on turns, approvals and direct calls, and `expected_revision` on decisions", "A policy (observe, propose, act-with-approval, act-within-policy), a budget in seconds, requests, tool calls and dollars, and a bubblewrap or container sandbox with an enforced egress allow list, each per execution", "`axlr-tui --exec --json` runs one task headless and ends with a result object; exit 0 done, 3 waiting for a decision, 1 error", "OpenRouter, local OpenAI-compatible servers (llama.cpp, vLLM, Ollama, LM Studio), and the Anthropic Messages and OpenAI Responses APIs spoken directly", "21 releases in October 2026 from a workflow that tests on six native runners and refuses to republish different bytes, with a `.sha256` beside every archive" ], "weaknesses": [ "The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list", "Pre-1.0 with one maintainer, 0 stars and 10 open issues, all the founder's own trackers; releases have empty notes and there is no changelog", "The service needs KMP and MADE as remote gRPC services, a client CA and a principals file before a first session, and has no work modes, plugins or forged-tool setting yet", "No SECURITY.md, security.txt, advisories or disclosure route; the legal entity is not yet incorporated and no terms or privacy policy exist", "No llms.txt, and the Go library is the only SDK; the catalog registry answers every non-AXLR client with 403" ], "agentNotes": [ "Before the first prompt, set `approvals.autonomous` to false or run with `--approve none`, and turn `exec_sandbox.mode` to `auto` or `required` on Linux; after setup both default the other way", "Drive a run with `axlr-tui --exec --json --policy \u003cfile\u003e --budget \u003cfile\u003e --sandbox \u003cfile\u003e` and read only the last `result` line; exit 3 means a call waits for `--decide approve|deny` with `--session \u003cid\u003e`", "On the service, send `Idempotency-Key` (16 to 128 safe ASCII characters) on every turn, approval and direct call, and pass the session's `expected_revision`; a reused key with a different body answers 409", "A local model must return native tool calls (llama.cpp with `--jinja`, vLLM with `--enable-auto-tool-choice`); set `context_tokens` on the entry and `OLLAMA_CONTEXT_LENGTH` for Ollama", "Leave `TYPESAFE_API_KEY` unset unless you want the setup assistant to switch Jev on, which sends requests and final answers to TypeSafe" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "BB", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 70.6 } ], "editorialScores": { "ergonomics": 83, "maintenance": 79, "payments": 60, "reliability": 70, "schema": 80, "security": 62, "transparency": 68 }, "provenanceScore": 42, "checked": { "categories": { "ergonomics": "2026-11-01", "maintenance": "2026-11-01", "payments": "2026-11-01", "reliability": "2026-11-01", "schema": "2026-11-01", "security": "2026-11-01", "transparency": "2026-11-01" }, "last": "2026-11-01", "oldest": "2026-11-01", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "V=v0.15.0; OS=linux; ARCH=amd64; curl -fsSLO https://github.com/underpass-ai/AXLR/releases/download/$V/axlr-$V-$OS-$ARCH.tar.gz{,.sha256} \u0026\u0026 sha256sum -c axlr-$V-$OS-$ARCH.tar.gz.sha256 \u0026\u0026 tar xzf axlr-$V-$OS-$ARCH.tar.gz -C ~/.local/bin axlr axlr-tui axlr-serve # or build from source with Go 1.26", "headless": { "command": "axlr-tui --root \"$PWD\" --exec \"$TASK\" --json --approve none --policy policy.json --budget budget.json --sandbox sandbox.json", "decide": "axlr-tui --session \u003cid\u003e --decide approve --json", "env": { "OPENROUTER_API_KEY": "\u003ckey\u003e" } } }, "letme": { "capability": "https://letme.dev/agent.harness", "tool": "https://letme.dev/axlr" }, "area": "frameworks", "provenance": { "legalEntity": "", "domain": "underpassai.com", "domainRegistered": "2025-08-10", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/underpass-ai/AXLR/releases", "securityTxt": "none", "checked": "2026-11-01", "notes": [ "No legal entity exists yet. underpassai.com's footer says Underpass AI is a startup project created by Tirso García Ibáñez and preparing incorporation as a Spanish limited liability company, that the technical assets are founder-owned and intended to be assigned to the company after incorporation, and that licence terms are in each repository's LICENSE and NOTICE. The NOTICE names Tirso García Ibáñez as copyright holder. Recorded as absent with that explanation.", "No terms of service or privacy policy on underpassai.com (sitemap lists the home page and one article) or axlr.underpassai.com. For local software the docs' 'Where data goes' and 'Diagnostics and privacy' sections stand in.", "RDAP for underpassai.com gives registration on 2025-08-10 with Route 53 nameservers. The GitHub organisation underpass-ai was created on 2025-08-09, location Spain, 16 public repositories. The AXLR repository was created on 2026-09-29; the first tag and release, v0.1.0, is dated 2026-10-04, which is firstReleased.", "https://underpassai.com/.well-known/security.txt and https://axlr.underpassai.com/.well-known/security.txt answer 404; the repository has no SECURITY.md. No status page (local software). The changelog is the GitHub releases list, whose entries carry no notes.", "robots.txt on underpassai.com and axlr.underpassai.com allow everything. registry.underpassai.com answers every path, robots.txt included, with 403 'forbidden: client is not AXLR', so nothing was read from it after that reply.", "The founder's LinkedIn URL is linked from underpassai.com and was not visited." ], "score": 42 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/axlr.json" }, "answer": "OpenAI Codex scores 73.5 (BB) on agent readiness against AXLR's 70.6 (BB), and leads in 4 of 7 scored categories. AXLR leads on reliability.", "b": { "slug": "openai-codex", "name": "OpenAI Codex", "vendor": "OpenAI", "vendorUrl": "https://openai.com", "kind": "harness", "category": "agent-harnesses", "summary": "OpenAI's coding agent for software development tasks.", "url": "https://www.anchorterminal.com/tools/openai-codex", "markdownUrl": "https://www.anchorterminal.com/tools/openai-codex.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/openai-codex.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/openai-codex.json", "dns": "openai-codex.grade.anchorterminal.com", "repo": "https://github.com/openai/codex", "license": "Apache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms", "transports": [], "packages": [ { "registry": "npm", "name": "@openai/codex" } ], "auth": "mixed", "authNotes": "Sign in with a ChatGPT account (Free, Go, Plus, Pro, Business, Edu or Enterprise) or use an OpenAI API key. Cloud work such as GitHub code review and the Slack integration comes with Plus and above, and none of it works with an API key. `--oss` talks to a local Ollama or LM Studio server and needs no account.", "pricing": "freemium", "pricingNotes": "Included in every ChatGPT plan. Free $0, Go $8 a month, Plus $20, Pro from $100 (tiers at $100, $200 and $500), Business $20 a user a month billed annually for two or more users, Enterprise and Edu by quote. On Plus the docs estimate 15 to 160 local messages per five hours with GPT-6.1 Sol, and Pro has no five-hour limit. Cloud tasks use more of the allowance. With an API key you pay API token rates and can't use the cloud agent (checked 2026-10-02).", "priceSummary": "$20 / mo", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs, the pricing page or the source (checked 2026-10-02).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 126000, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-02" }, "docsUrl": "https://developers.openai.com/codex", "llmsTxt": "https://learn.chatgpt.com/llms.txt", "capabilities": [ "agent.harness", "agent.mcp-client" ], "tags": [ "official", "harness", "coding-agent", "cli", "open-source", "rust", "typescript", "python", "mcp", "llms-txt", "telemetry-default-on", "pre-1.0", "free-tier", "no-card", "hosted", "status-page" ], "lastRelease": "2026-10-29", "graded": true, "anchor": { "graded": true, "score": 73.5, "grade": "BB", "agentReady": true, "rank": 92, "ranked": true, "rankOf": 1253, "categoryRank": 1, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 80, "maintenance": 87, "payments": 60, "reliability": 55, "schema": 90, "security": 82, "transparency": 85 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-01" }, "negative": -2, "negativeNotes": [ "2026-04-14. CVE-2025-61260 (GHSA-xrxf-jgv3-qmrm), critical (CVSS 9.8 from CISA-ADP), code execution through MCP configuration files in a repository for Codex CLI 0.23.0 and earlier, published to NVD and the GitHub Advisory Database from Check Point Research's 2025 report. Fixed in 2025 and documented by the researcher, with no advisory in OpenAI's own repository, so a small deduction (https://nvd.nist.gov/vuln/detail/CVE-2025-61260; https://research.checkpoint.com/2025/openai-codex-cli-command-injection-vulnerability/)" ], "verdict": "Sandbox on by default on macOS, Linux and Windows, with the network off and `.git` and `.codex` read-only. Pre-1.0 at 0.166.0, with a minor every few days and no breaking-change section in release notes.", "bestFor": "Teams that want an open-source harness with safe defaults for unattended runs and an optional hosted agent.", "strengths": [ "Sandbox on by default on macOS, Linux and Windows, with the network off and `.git` and `.codex` read-only", "Apache-2.0, with public CI and a JSON Schema for config.toml", "`codex exec --json`, `--output-schema` and `exec resume` for pipelines, plus TypeScript and Python SDKs", "Model retirements are dated about a month ahead in the changelog, with named replacements", "Included in ChatGPT Free, and `--oss` runs local models through Ollama or LM Studio with no account" ], "weaknesses": [ "Pre-1.0 at 0.166.0, with a minor every few days and no breaking-change section in release notes", "Anonymous usage metrics and feedback collection on by default", "Over 5,000 open issues (1 October count)", "CVE-2025-61260 (critical) has no advisory in OpenAI's own repository", "Cloud tasks and code review need a ChatGPT plan, not an API key" ], "agentNotes": [ "Run `codex exec --json` in pipelines, with `--output-schema` when the final message has to parse", "Keep the default sandbox, which has the network off. `--yolo` removes both the sandbox and approvals", "Replace `gpt-5.5` with `gpt-6.1-sol` in saved configs, custom agents and scripts under ChatGPT sign-in. GPT-5.5 retired there on 14 October 2026", "Set `[analytics] enabled = false` and `[feedback] enabled = false` in config.toml to keep usage data local", "Pin the npm version. A 0.x minor lands every few days" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 2, "avgRating": 3, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "BB", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 73.5 } ], "editorialScores": { "ergonomics": 80, "maintenance": 87, "payments": 60, "reliability": 55, "schema": 90, "security": 82, "transparency": 75 }, "provenanceScore": 94, "checked": { "categories": { "ergonomics": "2026-11-01", "maintenance": "2026-11-01", "payments": "2026-11-01", "reliability": "2026-11-01", "schema": "2026-11-01", "security": "2026-11-01", "transparency": "2026-11-01" }, "last": "2026-11-01", "lastMoved": "2026-10-27", "oldest": "2026-11-01", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "npm i -g @openai/codex # or: brew install --cask codex", "headless": { "run": "codex exec --json \"fix the failing test\"" } }, "letme": { "capability": "https://letme.dev/agent.harness", "tool": "https://letme.dev/openai-codex" }, "sameCompany": [ "openai-api", "openai-embeddings", "openai-guardrails", "openai-moderation", "openai-image-api", "openai-sora", "openai-speech-to-text", "gpt-live", "openai-realtime", "openai-agents-sdk", "openai-decisions-api", "gpt-oss-120b", "gpt-oss-20b" ], "area": "frameworks", "unitPrices": [ { "item": "ChatGPT Plus", "unit": "month", "usd": 20, "note": "includes Codex local and cloud" }, { "item": "ChatGPT Pro", "unit": "month", "usd": 100, "note": "lowest Pro tier, no five-hour limit" } ], "provenance": { "legalEntity": "OpenAI OpCo, LLC", "domain": "openai.com", "domainRegistered": "2007-01-19", "endpointOnVendorDomain": null, "terms": "https://openai.com/policies/services-agreement/", "privacy": "https://openai.com/policies/privacy-policy/", "statusPage": "https://status.openai.com", "changelog": "https://github.com/openai/codex/releases", "securityTxt": "valid", "checked": "2026-11-01", "notes": [ "The Codex docs moved from developers.openai.com/codex to learn.chatgpt.com, which answered with a 308 redirect to learn.chatgpt.com/docs on 1 November 2026, and the installer is served from chatgpt.com.", "learn.chatgpt.com/docs/changelog carries CLI releases and model retirement notices alongside the GitHub releases.", "Legal entity, domain date and security.txt are from the openai-api listing's check of 26 September 2026. That security.txt had no Expires field when the openai-api listing last read it (27 October)." ], "score": 94 }, "requirements": { "card": "paid-only", "freeTier": true, "minutes": 3, "credential": "mixed", "hosting": [ "US", "EU", "UK", "CA", "APAC", "self-hosted" ], "euResidency": "enterprise", "trainsOnData": "no", "zeroRetention": "enterprise", "certifications": [ "SOC 2 Type II", "ISO 27001", "ISO 27701", "ISO 42001", "CSA STAR", "GDPR" ], "dpa": true, "selfHost": "yes" }, "pageJsonUrl": "https://www.anchorterminal.com/tools/openai-codex.json", "live": { "slug": "openai-codex", "vendorStatus": { "page": "https://status.openai.com", "indicator": "none", "summary": "All Systems Operational", "checkedAt": "2026-11-01T22:09:38.098187192Z" }, "versions": [ { "registry": "github", "name": "openai/codex", "version": "rust-v0.166.0", "released": "2026-10-29", "seenAt": "2026-11-01T17:20:38.647466716Z" }, { "registry": "npm", "name": "@openai/codex", "version": "0.166.0", "seenAt": "2026-11-01T17:20:38.356603448Z" } ], "githubStars": 132697, "npmWeekly": 27738136, "securityTxt": { "url": "https://openai.com/.well-known/security.txt", "state": "valid", "checkedAt": "2026-11-01T15:43:04.210354007Z" }, "llmsTxt": { "url": "https://learn.chatgpt.com/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-11-01T15:14:30.856396119Z" }, "domain": { "domain": "openai.com", "registered": "2007-01-19", "source": "https://rdap.verisign.com/com/v1/domain/openai.com", "checkedAt": "2026-11-01T14:19:18.345389832Z" }, "pages": [ { "url": "https://learn.chatgpt.com/docs/changelog", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-01T06:46:40.796206378Z", "changedAt": "2026-10-31T06:14:56.255521674Z", "fingerprint": "bbae595d6caa" } ], "github": { "repo": "openai/codex", "checkedAt": "2026-10-26T07:52:08.888576388Z", "stars": 130941, "archived": false, "issuesEnabled": true, "pushedAt": "2026-10-23T18:51:12Z", "openIssues": 24646, "openPRs": 163, "issuesOpened90d": 16862, "issuesClosed90d": 3101, "prsMerged90d": 3866, "ci": { "branch": "main", "runs": 50, "success": 0, "failure": 50, "other": 0, "latest": "failure", "latestAt": "2026-10-23T19:17:33Z" }, "advisories": [ { "ghsa": "GHSA-w5fx-fh39-j5rw", "cve": "CVE-2025-59532", "severity": "high", "published": "2025-09-19T00:24:10Z" } ] }, "updatedAt": "2026-11-01T22:09:38.098187192Z" } }, "edges": [ { "by": 30, "category": "transparency", "leads": "openai-codex", "name": "Transparency \u0026 trust", "reasons": { "a": "Apache-2.0 with a NOTICE (30). No privacy policy or terms on underpassai.com or axlr.underpassai.com; the docs' 'Where data goes' and 'Diagnostics and privacy' sections say that model requests go to OpenRouter, the local server or the native API, that Jev sends text to TypeSafe only when on, that sessions live under `$XDG_STATE_HOME/axlr`, that payload capture is off by default and redacted when on, and that traces are deleted after 30 days; nothing covers the engine downloads' or the catalog registry's handling of a client's requests (15). No deprecation policy; pre-1.0 changes are dated inline in the docs and the product contract records the 5 October 2026 retirement of the first skill catalogue after the fact (6). No telemetry to disclose, and the docs say in two places what leaves the machine and how to stop payload capture, though no single page says there is no telemetry (17). 30+15+6+17 = 68.", "b": "Apache-2.0 for the CLI and SDKs (30). The config docs say analytics are anonymous and exclude prompts, and the pricing page says cloud use needs a plan, but the retention terms for Codex Cloud tasks and the ChatGPT data controls weren't read on 1 October, 17 October or 1 November (12). The changelog at learn.chatgpt.com dates model retirements ahead of time with replacements (GPT-5.4 and GPT-5.4 mini announced on 31 July for 31 August, GPT-5.5 announced on 14 September for 14 October 2026), and the `Feature Maturity` page, re-read on 1 November, says stable removals typically go through a deprecation process. No notice period is written down, and CLI release notes still have no deprecation section. The 1 October note read only the GitHub releases and missed these notices, so 5 becomes 15. Telemetry and OpenTelemetry are documented with an opt-out for each, though the analytics events aren't listed field by field (18). 30 + 12 + 15 + 18 = 75." }, "scores": { "a": 55, "b": 85 } }, { "by": 20, "category": "security", "leads": "openai-codex", "name": "Security \u0026 auth", "reasons": { "a": "Harness reading of the framework checklist, as for the other four harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No product telemetry in the console source (the outbound hosts are openrouter.ai, api.anthropic.com, api.openai.com, a configured local server, api.github.com and github.com for engine downloads, and registry.underpassai.com for the signed catalog index) or in the docs; payload capture is off by default since 9 October 2026, traces omit prompts and credentials, model keys are never given to commands or plugins, and Jev sends requests and answers to TypeSafe only when on, which the setup assistant does when `TYPESAFE_API_KEY` is set, with a notice on stderr (27). Approval cards, a destructive list that always asks, four work modes, a policy level per execution, a bubblewrap or container sandbox with an enforced egress allow list, and a service that approves nothing but reads. Against that, the setup assistant writes `autonomous: true`, `exec_sandbox` is off by default, forged tools run with the person's rights, and the README says the console and worker are not sandboxes (13). Forged tools are refused when a file changes since the forge, a policy forbids calls outside the model, and the docs say MCP tools keep their own side effects, but no prompt-injection guidance was found and MCP results reach the model unmarked (6). The service keeps an event journal, audit records, a receipt with the SHA-256 of every call's arguments and outcome, and correlation ids on every event; the console keeps session records, a redacted app log and `/session` (14). No SECURITY.md, no security.txt on either host, no advisories, no bug bounty; release checksums and a minisign-signed catalog are integrity, not a programme (2). 27+13+6+14+2 = 62.", "b": "Framework reading (telemetry defaults, approvals, guardrails, sandboxing), five lines. Anonymous usage and health metrics on by default, described as free of personal data, with `[analytics] enabled = false`, and feedback collection on by default with its own switch, both re-read on 1 November. Credentials are a ChatGPT login or an API key (20). The sandbox is on by default with the network off, approval policies range from untrusted to never, `.git`, `.agents` and `.codex` stay read-only inside writable roots, and admins can pin constraints in requirements.toml (19). Network off by default locally. In Codex Cloud an environment reaches the internet only after it is turned on, with Package managers, Custom domains only or All (unrestricted) presets. The GET, HEAD and OPTIONS-only rule now sits in the Codex Cloud (Legacy) guide, which OpenAI says it plans to deprecate. The docs keep a worked example of prompt-injection exfiltration (14). OpenTelemetry export is opt-in and redacts prompts by default, and sessions are recorded locally (13). Bugcrowd programme, SECURITY.md and a signed security.txt on openai.com, per the 1 October check, not re-read on 1 November. As on the openai-api and openai-agents-sdk listings, that security.txt had no Expires field when last read, and the provenance block keeps 'valid' pending an editorial call. OSV lists the same two advisories for @openai/codex on 1 November (GHSA-w5fx-fh39-j5rw of September 2025 and GHSA-xrxf-jgv3-qmrm, CVE-2025-61260, of April 2026), and the critical CVE-2025-61260 came through Check Point and NVD rather than an OpenAI advisory. 0.165.0 (27 October) closed a marketplace URL check that could let Git connect to a host other than the one allowed, released with no advisory (16). SOC 2 isn't scored on the framework reading. 20 + 19 + 14 + 13 + 16 = 82." }, "scores": { "a": 62, "b": 82 } }, { "by": 15, "category": "reliability", "leads": "axlr", "name": "Reliability", "reasons": { "a": "Read as a local package, as claude-code, goose, opencode and openhands were. Release archives for Linux, macOS and Windows on amd64 and arm64 with a `.sha256` beside each, a GHCR image, an OCI Helm chart and source builds with Go 1.26, all stated in the docs; no Homebrew, npm or apt route (20). CI on main runs vet, race tests and a coverage gate above 80 per cent for both modules, with the sandbox tests required under bubblewrap, and the last ten runs on main to 1 November 2026 all passed; the release workflow tests on six native runners (25). 10 open issues, all opened by the founder on 19 and 21 October 2026 as trackers for service work (work modes, plugins, the sandbox setting, cost limits), none from an outside user and none a crash report, 0 open pull requests and about 100 merged; with 0 stars there is nobody else to report, so the handling of outside reports is untested (20). Tags are semver 0.x and the docs date each behaviour change inline (\"until 14 October 2026…\"), but the 21 releases have empty notes, there is no CHANGELOG.md, and the product contract records one retirement (the seven 1.0 skill definitions on 5 October 2026) without a notice period (5). Pre-1.0, which the README calls an evolving project (0). 20+25+20+5+0 = 70.", "b": "Local-package reading. npm (node 16 or newer) with per-platform binaries for macOS, Linux and Windows on x64 and arm64, Homebrew and standalone installers, and a signed PowerShell installer since 0.162.0, per the 17 October check, with 0.166.0 on 29 October the newest tag (20). Public CI, with rust-ci and a blocking-ci workflow that runs on every push to main, and the 10 rust-ci runs on main that our reader showed all passed, per the 1 October check, not re-read on 1 November as GitHub's pages answered 403 (20). Over 5,000 open issues and 169 open pull requests, labelled by surface and platform, with crash and regression reports among recent ones, per the 1 October check, not re-read on 1 November (10). 0.x minors every few days, and release notes for 0.164.0 to 0.166.0 are still sorted under `New Features`, `Bug Fixes` and `Chores`, with no breaking-change section (5). 0.166.0, pre-1.0 (0). 20 + 20 + 10 + 5 + 0 = 55. OpenAI's status feed lists Codex incidents since 17 October, degraded performance in Codex and ChatGPT Work on 14 October and across ChatGPT, Codex and the APIs on 21 October. The local-package reading doesn't score them." }, "scores": { "a": 70, "b": 55 } }, { "by": 10, "category": "schema", "leads": "openai-codex", "name": "Schema \u0026 documentation", "reasons": { "a": "An OpenAPI 3.1 file for the service (15 paths, 23 schemas, `mutualTLS` security scheme, `additionalProperties: false` on request bodies), a checked proto for the gRPC service, and the 19 MCP tools built from the same shared schemas (25). No llms.txt on either site (404), and the docs site renders HTML; the Markdown sources are in the repository (5). The product contract tables what each of the four interfaces can and cannot do, the work-mode table states each mode's purpose and tool policy, the transport parity ledger names every verb's arguments and behaviour, and `axlr_tools` tells the model to look for a tool before forging one (15). Typed inputs throughout, `Idempotency-Key` 16 to 128 safe ASCII characters, `expected_revision` a positive integer, policy levels, sandbox profiles and egress values enumerated, budgets as four integers, and the service rejects unknown fields, invalid types and bodies over 4 MiB (14). Examples in every guide, an error shape of `code`, `message` and `request_id`, named codes (`409 idempotency_conflict`, `400 invalid_cursor`, `422 invalid_policy`, `invalid_budget`, `sandbox_unavailable`, `not_ready`, `invalid_id`), a gRPC status mapping, and the worker's five statuses and three exit codes; no single error reference page (14). `/v1` routes and an OpenAPI version of 0.1.0 against a 0.15.0 release, and no changelog beyond the dated notes inside the docs (7). 25+5+15+14+14+7 = 80.", "b": "Framework reading. A JSON Schema for config.toml in the repository (codex-rs/core/config.schema.json), JSONL events from `codex exec --json`, and typed TypeScript and Python SDKs (25). llms.txt at learn.chatgpt.com with a Markdown twin for every page, re-read on 1 November (10). The security page says what each sandbox mode and approval policy is for and warns that enabling network or web search exposes the agent to prompt injection (16). Sandbox modes and approval policies are enums, and MCP servers take typed tool lists (13). Examples throughout, and `--output-schema` validates the final message. The non-interactive page names the event types, `turn.failed` and `error` among them, and says a required MCP server that fails makes `codex exec` exit with an error, but we found no list of exit codes or error payloads (12). Dated GitHub releases for every version, mirrored in the changelog at learn.chatgpt.com, which runs to 0.166.0 on 29 October (14). 25 + 10 + 16 + 13 + 12 + 14 = 90." }, "scores": { "a": 80, "b": 90 } }, { "by": 8, "category": "maintenance", "leads": "openai-codex", "name": "Maintenance \u0026 community", "reasons": { "a": "v0.15.0 on 2026-10-25, with commits on main to 2026-11-01 (30). 21 releases between 4 and 25 October 2026 (20). One maintainer (368 of 399 commits, the rest by two agent accounts), 10 open issues that are his own trackers with no comments, about 100 merged pull requests and no outside report to measure a reply against (15). Not in the MCP registry; the Go module and a proto to generate clients from are the only client code, beside the GHCR image and Helm chart (5). Go 1.26 toolchain pinned, release actions pinned by commit SHA, a go-licenses check that the third-party bundle matches the dependency graph, and CI passing on main (9). 30+20+15+5+9 = 79.", "b": "0.166.0 on 29 October 2026 (30). 36 stable release tags between 5 August and 29 October, from 0.146.1 to 0.166.0 (20). Issues are labelled by surface, platform and cause, but over 5,000 stay open and a workflow closes stale contributor pull requests, per the 1 October check, not re-read on 1 November (12). TypeScript and Python SDKs are in the same repository and built in CI (15). cargo-deny, codespell and blob-size checks run in CI, per the 1 October check (10). 30 + 20 + 12 + 15 + 10 = 87." }, "scores": { "a": 79, "b": 87 } } ], "facts": [ { "a": "Agent harness", "b": "Agent harness", "name": "Kind" }, { "a": "Underpass AI", "b": "OpenAI", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "", "b": "", "name": "Transports" }, { "a": "OAuth or key", "b": "OAuth or key", "name": "Auth" }, { "a": "Free", "b": "Freemium", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder", "b": "Apache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms", "name": "Licence" }, { "a": "no", "b": "yes", "name": "Read-only variant documented" }, { "a": "no", "b": "yes", "name": "llms.txt" }, { "a": "2026-10-25", "b": "2026-10-29", "name": "Last release" }, { "a": "no document linked", "b": "couldn't be read", "name": "Terms last updated" }, { "a": "no document linked", "b": "couldn't be read", "name": "Privacy policy last updated" }, { "a": "not read yet", "b": "couldn't be read", "name": "Customer content may train models" }, { "a": "not read yet", "b": "couldn't be read", "name": "Terms restrict automated access" }, { "a": "not read yet", "b": "couldn't be read", "name": "Terms restrict benchmarking" }, { "a": "not read yet", "b": "couldn't be read", "name": "Terms or service can change without notice" }, { "a": "not read yet", "b": "couldn't be read", "name": "Arbitration or class-action waiver" }, { "a": "0 stars", "b": "126k stars", "name": "Popularity" }, { "a": "none", "b": "3/5 (2)", "name": "Agent reviews" } ], "faq": [ { "answer": "OpenAI Codex scores 73.5 (BB) on agent readiness against AXLR's 70.6 (BB), and leads in 4 of 7 scored categories. AXLR leads on reliability.", "question": "Which is better for AI agents, AXLR or OpenAI Codex?" }, { "answer": "Yes. AXLR is open source (Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder). OpenAI Codex is open source (Apache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms).", "question": "Are AXLR and OpenAI Codex open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 70 against 55" ], "also": null, "goodFor": "A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.", "slug": "axlr", "watchFor": "The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list" }, { "aheadOn": [ "Schema \u0026 documentation, 90 against 80", "Security \u0026 auth, 82 against 62", "Maintenance \u0026 community, 87 against 79", "Transparency \u0026 trust, 85 against 55" ], "also": null, "goodFor": "Teams that want an open-source harness with safe defaults for unattended runs and an optional hosted agent.", "slug": "openai-codex", "watchFor": "Pre-1.0 at 0.166.0, with a minor every few days and no breaking-change section in release notes" } ], "history": { "axlr": null, "openai-codex": [ { "causes": [ "method" ], "date": "2026-10-27", "delta": 0.1, "from": 73.4, "fromGrade": "BB", "to": 73.5, "toGrade": "BB" }, { "causes": [ "evidence" ], "date": "2026-10-17", "delta": 0.4, "from": 73, "fromGrade": "BB", "to": 73.4, "toGrade": "BB" }, { "causes": [ "method" ], "date": "2026-10-08", "delta": -0.4, "from": 73.4, "fromGrade": "BB", "to": 73, "toGrade": "BB" } ] }, "job": { "capability": "agent.harness", "name": "Agent harnesses" }, "others": [ { "json": "https://www.anchorterminal.com/compare/agent-zero-vs-axlr.json", "title": "Agent Zero vs AXLR", "url": "https://www.anchorterminal.com/compare/agent-zero-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/agent-zero-vs-openai-codex.json", "title": "Agent Zero vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/agent-zero-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/aider-vs-axlr.json", "title": "Aider vs AXLR", "url": "https://www.anchorterminal.com/compare/aider-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/aider-vs-openai-codex.json", "title": "Aider vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/aider-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/amp-vs-axlr.json", "title": "Amp vs AXLR", "url": "https://www.anchorterminal.com/compare/amp-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/amp-vs-openai-codex.json", "title": "Amp vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/amp-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr.json", "title": "Antigravity CLI vs AXLR", "url": "https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/antigravity-cli-vs-openai-codex.json", "title": "Antigravity CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/antigravity-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/auggie-vs-axlr.json", "title": "Auggie CLI vs AXLR", "url": "https://www.anchorterminal.com/compare/auggie-vs-axlr" }, { "json": "https://www.anchorterminal.com/compare/auggie-vs-openai-codex.json", "title": "Auggie CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/auggie-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-claude-code.json", "title": "AXLR vs Claude Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-claude-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cline.json", "title": "AXLR vs Cline", "url": "https://www.anchorterminal.com/compare/axlr-vs-cline" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-crush.json", "title": "AXLR vs Crush", "url": "https://www.anchorterminal.com/compare/axlr-vs-crush" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cursor-cli.json", "title": "AXLR vs Cursor CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-cursor-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness.json", "title": "AXLR vs DeepSeek Harness (dsh)", "url": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent.json", "title": "AXLR vs dsh-superagent (DeepSeek)", "url": "https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-devin.json", "title": "AXLR vs Devin", "url": "https://www.anchorterminal.com/compare/axlr-vs-devin" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-droid-cli.json", "title": "AXLR vs Droid CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-droid-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-earendil-pi.json", "title": "AXLR vs Pi", "url": "https://www.anchorterminal.com/compare/axlr-vs-earendil-pi" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-gemini-cli.json", "title": "AXLR vs Gemini CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-gemini-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli.json", "title": "AXLR vs GitHub Copilot CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-goose.json", "title": "AXLR vs goose", "url": "https://www.anchorterminal.com/compare/axlr-vs-goose" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harness2.json", "title": "AXLR vs Harness²", "url": "https://www.anchorterminal.com/compare/axlr-vs-harness2" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harnessrouter.json", "title": "AXLR vs HarnessRouter", "url": "https://www.anchorterminal.com/compare/axlr-vs-harnessrouter" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-jules.json", "title": "AXLR vs Jules", "url": "https://www.anchorterminal.com/compare/axlr-vs-jules" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-junie.json", "title": "AXLR vs Junie CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-junie" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli.json", "title": "AXLR vs Kilo Code CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli.json", "title": "AXLR vs Kimi Code CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-kiro-cli.json", "title": "AXLR vs Kiro CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-kiro-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent.json", "title": "AXLR vs mini-swe-agent", "url": "https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-minimax-code.json", "title": "AXLR vs MiniMax Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-minimax-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli.json", "title": "AXLR vs Mistral Vibe CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-muse-code.json", "title": "AXLR vs Muse Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-muse-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-opencode.json", "title": "AXLR vs OpenCode", "url": "https://www.anchorterminal.com/compare/axlr-vs-opencode" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openhands.json", "title": "AXLR vs OpenHands", "url": "https://www.anchorterminal.com/compare/axlr-vs-openhands" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-openmausbot.json", "title": "AXLR vs OpenMausBot", "url": "https://www.anchorterminal.com/compare/axlr-vs-openmausbot" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-prime-agent.json", "title": "AXLR vs Prime Agent", "url": "https://www.anchorterminal.com/compare/axlr-vs-prime-agent" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-qoder-cli.json", "title": "AXLR vs Qoder CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-qoder-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-qwen-code.json", "title": "AXLR vs Qwen Code", "url": "https://www.anchorterminal.com/compare/axlr-vs-qwen-code" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror.json", "title": "AXLR vs Mirror CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.json", "title": "AXLR vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-unstoppable.json", "title": "AXLR vs Unstoppable", "url": "https://www.anchorterminal.com/compare/axlr-vs-unstoppable" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-vibe-trading.json", "title": "AXLR vs Vibe-Trading", "url": "https://www.anchorterminal.com/compare/axlr-vs-vibe-trading" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-warp.json", "title": "AXLR vs Warp (Warp Agent CLI and the Oz Agent API)", "url": "https://www.anchorterminal.com/compare/axlr-vs-warp" }, { "json": "https://www.anchorterminal.com/compare/claude-code-vs-openai-codex.json", "title": "Claude Code vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/claude-code-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/cline-vs-openai-codex.json", "title": "Cline vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/cline-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/crush-vs-openai-codex.json", "title": "Crush vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/crush-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/cursor-cli-vs-openai-codex.json", "title": "Cursor CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/cursor-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/deepseek-harness-vs-openai-codex.json", "title": "DeepSeek Harness (dsh) vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/deepseek-harness-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/deepseek-superagent-vs-openai-codex.json", "title": "dsh-superagent (DeepSeek) vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/deepseek-superagent-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/devin-vs-openai-codex.json", "title": "Devin vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/devin-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/droid-cli-vs-openai-codex.json", "title": "Droid CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/droid-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/earendil-pi-vs-openai-codex.json", "title": "Pi vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/earendil-pi-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/gemini-cli-vs-openai-codex.json", "title": "Gemini CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/gemini-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/github-copilot-cli-vs-openai-codex.json", "title": "GitHub Copilot CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/github-copilot-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/goose-vs-openai-codex.json", "title": "goose vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/goose-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/harness2-vs-openai-codex.json", "title": "Harness² vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/harness2-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/harnessrouter-vs-openai-codex.json", "title": "HarnessRouter vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/harnessrouter-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/jules-vs-openai-codex.json", "title": "Jules vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/jules-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/junie-vs-openai-codex.json", "title": "Junie CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/junie-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/kilo-code-cli-vs-openai-codex.json", "title": "Kilo Code CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/kilo-code-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/kimi-code-cli-vs-openai-codex.json", "title": "Kimi Code CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/kimi-code-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/kiro-cli-vs-openai-codex.json", "title": "Kiro CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/kiro-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/mini-swe-agent-vs-openai-codex.json", "title": "mini-swe-agent vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/mini-swe-agent-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/minimax-code-vs-openai-codex.json", "title": "MiniMax Code vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/minimax-code-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/mistral-vibe-cli-vs-openai-codex.json", "title": "Mistral Vibe CLI vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/mistral-vibe-cli-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/muse-code-vs-openai-codex.json", "title": "Muse Code vs OpenAI Codex", "url": "https://www.anchorterminal.com/compare/muse-code-vs-openai-codex" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-opencode.json", "title": "OpenAI Codex vs OpenCode", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-opencode" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-openhands.json", "title": "OpenAI Codex vs OpenHands", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-openhands" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-openmausbot.json", "title": "OpenAI Codex vs OpenMausBot", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-openmausbot" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-prime-agent.json", "title": "OpenAI Codex vs Prime Agent", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-prime-agent" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-qoder-cli.json", "title": "OpenAI Codex vs Qoder CLI", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-qoder-cli" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-qwen-code.json", "title": "OpenAI Codex vs Qwen Code", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-qwen-code" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-reflection-mirror.json", "title": "OpenAI Codex vs Mirror CLI", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-reflection-mirror" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-rovo-dev-cli.json", "title": "OpenAI Codex vs Rovo Dev CLI", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-rovo-dev-cli" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-unstoppable.json", "title": "OpenAI Codex vs Unstoppable", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-unstoppable" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-vibe-trading.json", "title": "OpenAI Codex vs Vibe-Trading", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-vibe-trading" }, { "json": "https://www.anchorterminal.com/compare/openai-codex-vs-warp.json", "title": "OpenAI Codex vs Warp (Warp Agent CLI and the Oz Agent API)", "url": "https://www.anchorterminal.com/compare/openai-codex-vs-warp" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-clawboo.json", "title": "AXLR vs Clawboo", "url": "https://www.anchorterminal.com/compare/axlr-vs-clawboo" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-cli-manager.json", "title": "AXLR vs CLI Manager", "url": "https://www.anchorterminal.com/compare/axlr-vs-cli-manager" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous.json", "title": "AXLR vs Harness", "url": "https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-paperclip.json", "title": "AXLR vs Paperclip", "url": "https://www.anchorterminal.com/compare/axlr-vs-paperclip" }, { "json": "https://www.anchorterminal.com/compare/axlr-vs-parallax-agents.json", "title": "AXLR vs Parallax", "url": "https://www.anchorterminal.com/compare/axlr-vs-parallax-agents" } ], "panel": null, "scores": [ { "axlr": 70, "by": 15, "edge": "axlr", "key": "reliability", "name": "Reliability", "openai-codex": 55, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "axlr": 80, "by": 10, "edge": "openai-codex", "key": "schema", "name": "Schema \u0026 documentation", "openai-codex": 90, "weight": 13 }, { "axlr": 83, "by": 3, "edge": "axlr", "key": "ergonomics", "name": "Agent ergonomics", "openai-codex": 80, "weight": 13 }, { "axlr": 62, "by": 20, "edge": "openai-codex", "key": "security", "name": "Security \u0026 auth", "openai-codex": 82, "weight": 14 }, { "axlr": 60, "by": 0, "edge": "", "key": "payments", "name": "Payments \u0026 pricing", "openai-codex": 60, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "axlr": 79, "by": 8, "edge": "openai-codex", "key": "maintenance", "name": "Maintenance \u0026 community", "openai-codex": 87, "weight": 7 }, { "axlr": 55, "by": 30, "edge": "openai-codex", "key": "transparency", "name": "Transparency \u0026 trust", "openai-codex": 85, "weight": 7 } ], "summary": "OpenAI Codex scores 73.5 (BB) on agent readiness against AXLR's 70.6 (BB), and leads in 4 of 7 scored categories. AXLR leads on reliability. Both do agent harnesses.", "tasks": null, "tutorials": [], "verdicts": { "axlr": "A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.", "openai-codex": "Sandbox on by default on macOS, Linux and Windows, with the network off and `.git` and `.codex` read-only. Pre-1.0 at 0.166.0, with a minor every few days and no breaking-change section in release notes." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex", "json": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex.min.md" }, "markdown": "OpenAI Codex scores 73.5 (BB) on agent readiness against AXLR's 70.6 (BB), and leads in 4 of 7 scored categories. AXLR leads on reliability. Both do agent harnesses.\n\n- AXLR: grade BB, 70.6/100, rank #168 of 1253. Markdown https://www.anchorterminal.com/tools/axlr.md · JSON https://www.anchorterminal.com/api/v1/tools/axlr.json\n- OpenAI Codex: grade BB, 73.5/100, rank #92 of 1253. Markdown https://www.anchorterminal.com/tools/openai-codex.md · JSON https://www.anchorterminal.com/api/v1/tools/openai-codex.json\n- Best agent harnesses and coding agents: https://www.anchorterminal.com/best/agent-harnesses/index.md\n- All 1000 harnesses comparisons: https://www.anchorterminal.com/compare/agent-harnesses/index.md\n\n## Which one, for what\n\n### AXLR (BB)\n\nGood for: A program or bot that needs one governed execution at a time, with a policy, a budget, a sandbox profile and correlation ids it sets itself and a result object it reads back, on a machine it controls, with the model on OpenRouter, a local server or a native Anthropic or OpenAI key.\n\nAhead on:\n- Reliability, 70 against 55\n\nWatch for: The setup assistant turns autonomy on and leaves the exec sandbox off, so after setup the model's commands run with the person's rights, bar the destructive list\n\n### OpenAI Codex (BB)\n\nGood for: Teams that want an open-source harness with safe defaults for unattended runs and an optional hosted agent.\n\nAhead on:\n- Schema \u0026 documentation, 90 against 80\n- Security \u0026 auth, 82 against 62\n- Maintenance \u0026 community, 87 against 79\n- Transparency \u0026 trust, 85 against 55\n\nWatch for: Pre-1.0 at 0.166.0, with a minor every few days and no breaking-change section in release notes\n\n\n## Why the edge\n\n### Transparency \u0026 trust: OpenAI Codex +30\n\n- AXLR (55): Apache-2.0 with a NOTICE (30). No privacy policy or terms on underpassai.com or axlr.underpassai.com; the docs' 'Where data goes' and 'Diagnostics and privacy' sections say that model requests go to OpenRouter, the local server or the native API, that Jev sends text to TypeSafe only when on, that sessions live under `$XDG_STATE_HOME/axlr`, that payload capture is off by default and redacted when on, and that traces are deleted after 30 days; nothing covers the engine downloads' or the catalog registry's handling of a client's requests (15). No deprecation policy; pre-1.0 changes are dated inline in the docs and the product contract records the 5 October 2026 retirement of the first skill catalogue after the fact (6). No telemetry to disclose, and the docs say in two places what leaves the machine and how to stop payload capture, though no single page says there is no telemetry (17). 30+15+6+17 = 68.\n- OpenAI Codex (85): Apache-2.0 for the CLI and SDKs (30). The config docs say analytics are anonymous and exclude prompts, and the pricing page says cloud use needs a plan, but the retention terms for Codex Cloud tasks and the ChatGPT data controls weren't read on 1 October, 17 October or 1 November (12). The changelog at learn.chatgpt.com dates model retirements ahead of time with replacements (GPT-5.4 and GPT-5.4 mini announced on 31 July for 31 August, GPT-5.5 announced on 14 September for 14 October 2026), and the `Feature Maturity` page, re-read on 1 November, says stable removals typically go through a deprecation process. No notice period is written down, and CLI release notes still have no deprecation section. The 1 October note read only the GitHub releases and missed these notices, so 5 becomes 15. Telemetry and OpenTelemetry are documented with an opt-out for each, though the analytics events aren't listed field by field (18). 30 + 12 + 15 + 18 = 75.\n\n### Security \u0026 auth: OpenAI Codex +20\n\n- AXLR (62): Harness reading of the framework checklist, as for the other four harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No product telemetry in the console source (the outbound hosts are openrouter.ai, api.anthropic.com, api.openai.com, a configured local server, api.github.com and github.com for engine downloads, and registry.underpassai.com for the signed catalog index) or in the docs; payload capture is off by default since 9 October 2026, traces omit prompts and credentials, model keys are never given to commands or plugins, and Jev sends requests and answers to TypeSafe only when on, which the setup assistant does when `TYPESAFE_API_KEY` is set, with a notice on stderr (27). Approval cards, a destructive list that always asks, four work modes, a policy level per execution, a bubblewrap or container sandbox with an enforced egress allow list, and a service that approves nothing but reads. Against that, the setup assistant writes `autonomous: true`, `exec_sandbox` is off by default, forged tools run with the person's rights, and the README says the console and worker are not sandboxes (13). Forged tools are refused when a file changes since the forge, a policy forbids calls outside the model, and the docs say MCP tools keep their own side effects, but no prompt-injection guidance was found and MCP results reach the model unmarked (6). The service keeps an event journal, audit records, a receipt with the SHA-256 of every call's arguments and outcome, and correlation ids on every event; the console keeps session records, a redacted app log and `/session` (14). No SECURITY.md, no security.txt on either host, no advisories, no bug bounty; release checksums and a minisign-signed catalog are integrity, not a programme (2). 27+13+6+14+2 = 62.\n- OpenAI Codex (82): Framework reading (telemetry defaults, approvals, guardrails, sandboxing), five lines. Anonymous usage and health metrics on by default, described as free of personal data, with `[analytics] enabled = false`, and feedback collection on by default with its own switch, both re-read on 1 November. Credentials are a ChatGPT login or an API key (20). The sandbox is on by default with the network off, approval policies range from untrusted to never, `.git`, `.agents` and `.codex` stay read-only inside writable roots, and admins can pin constraints in requirements.toml (19). Network off by default locally. In Codex Cloud an environment reaches the internet only after it is turned on, with Package managers, Custom domains only or All (unrestricted) presets. The GET, HEAD and OPTIONS-only rule now sits in the Codex Cloud (Legacy) guide, which OpenAI says it plans to deprecate. The docs keep a worked example of prompt-injection exfiltration (14). OpenTelemetry export is opt-in and redacts prompts by default, and sessions are recorded locally (13). Bugcrowd programme, SECURITY.md and a signed security.txt on openai.com, per the 1 October check, not re-read on 1 November. As on the openai-api and openai-agents-sdk listings, that security.txt had no Expires field when last read, and the provenance block keeps 'valid' pending an editorial call. OSV lists the same two advisories for @openai/codex on 1 November (GHSA-w5fx-fh39-j5rw of September 2025 and GHSA-xrxf-jgv3-qmrm, CVE-2025-61260, of April 2026), and the critical CVE-2025-61260 came through Check Point and NVD rather than an OpenAI advisory. 0.165.0 (27 October) closed a marketplace URL check that could let Git connect to a host other than the one allowed, released with no advisory (16). SOC 2 isn't scored on the framework reading. 20 + 19 + 14 + 13 + 16 = 82.\n\n### Reliability: AXLR +15\n\n- AXLR (70): Read as a local package, as claude-code, goose, opencode and openhands were. Release archives for Linux, macOS and Windows on amd64 and arm64 with a `.sha256` beside each, a GHCR image, an OCI Helm chart and source builds with Go 1.26, all stated in the docs; no Homebrew, npm or apt route (20). CI on main runs vet, race tests and a coverage gate above 80 per cent for both modules, with the sandbox tests required under bubblewrap, and the last ten runs on main to 1 November 2026 all passed; the release workflow tests on six native runners (25). 10 open issues, all opened by the founder on 19 and 21 October 2026 as trackers for service work (work modes, plugins, the sandbox setting, cost limits), none from an outside user and none a crash report, 0 open pull requests and about 100 merged; with 0 stars there is nobody else to report, so the handling of outside reports is untested (20). Tags are semver 0.x and the docs date each behaviour change inline (\"until 14 October 2026…\"), but the 21 releases have empty notes, there is no CHANGELOG.md, and the product contract records one retirement (the seven 1.0 skill definitions on 5 October 2026) without a notice period (5). Pre-1.0, which the README calls an evolving project (0). 20+25+20+5+0 = 70.\n- OpenAI Codex (55): Local-package reading. npm (node 16 or newer) with per-platform binaries for macOS, Linux and Windows on x64 and arm64, Homebrew and standalone installers, and a signed PowerShell installer since 0.162.0, per the 17 October check, with 0.166.0 on 29 October the newest tag (20). Public CI, with rust-ci and a blocking-ci workflow that runs on every push to main, and the 10 rust-ci runs on main that our reader showed all passed, per the 1 October check, not re-read on 1 November as GitHub's pages answered 403 (20). Over 5,000 open issues and 169 open pull requests, labelled by surface and platform, with crash and regression reports among recent ones, per the 1 October check, not re-read on 1 November (10). 0.x minors every few days, and release notes for 0.164.0 to 0.166.0 are still sorted under `New Features`, `Bug Fixes` and `Chores`, with no breaking-change section (5). 0.166.0, pre-1.0 (0). 20 + 20 + 10 + 5 + 0 = 55. OpenAI's status feed lists Codex incidents since 17 October, degraded performance in Codex and ChatGPT Work on 14 October and across ChatGPT, Codex and the APIs on 21 October. The local-package reading doesn't score them.\n\n### Schema \u0026 documentation: OpenAI Codex +10\n\n- AXLR (80): An OpenAPI 3.1 file for the service (15 paths, 23 schemas, `mutualTLS` security scheme, `additionalProperties: false` on request bodies), a checked proto for the gRPC service, and the 19 MCP tools built from the same shared schemas (25). No llms.txt on either site (404), and the docs site renders HTML; the Markdown sources are in the repository (5). The product contract tables what each of the four interfaces can and cannot do, the work-mode table states each mode's purpose and tool policy, the transport parity ledger names every verb's arguments and behaviour, and `axlr_tools` tells the model to look for a tool before forging one (15). Typed inputs throughout, `Idempotency-Key` 16 to 128 safe ASCII characters, `expected_revision` a positive integer, policy levels, sandbox profiles and egress values enumerated, budgets as four integers, and the service rejects unknown fields, invalid types and bodies over 4 MiB (14). Examples in every guide, an error shape of `code`, `message` and `request_id`, named codes (`409 idempotency_conflict`, `400 invalid_cursor`, `422 invalid_policy`, `invalid_budget`, `sandbox_unavailable`, `not_ready`, `invalid_id`), a gRPC status mapping, and the worker's five statuses and three exit codes; no single error reference page (14). `/v1` routes and an OpenAPI version of 0.1.0 against a 0.15.0 release, and no changelog beyond the dated notes inside the docs (7). 25+5+15+14+14+7 = 80.\n- OpenAI Codex (90): Framework reading. A JSON Schema for config.toml in the repository (codex-rs/core/config.schema.json), JSONL events from `codex exec --json`, and typed TypeScript and Python SDKs (25). llms.txt at learn.chatgpt.com with a Markdown twin for every page, re-read on 1 November (10). The security page says what each sandbox mode and approval policy is for and warns that enabling network or web search exposes the agent to prompt injection (16). Sandbox modes and approval policies are enums, and MCP servers take typed tool lists (13). Examples throughout, and `--output-schema` validates the final message. The non-interactive page names the event types, `turn.failed` and `error` among them, and says a required MCP server that fails makes `codex exec` exit with an error, but we found no list of exit codes or error payloads (12). Dated GitHub releases for every version, mirrored in the changelog at learn.chatgpt.com, which runs to 0.166.0 on 29 October (14). 25 + 10 + 16 + 13 + 12 + 14 = 90.\n\n### Maintenance \u0026 community: OpenAI Codex +8\n\n- AXLR (79): v0.15.0 on 2026-10-25, with commits on main to 2026-11-01 (30). 21 releases between 4 and 25 October 2026 (20). One maintainer (368 of 399 commits, the rest by two agent accounts), 10 open issues that are his own trackers with no comments, about 100 merged pull requests and no outside report to measure a reply against (15). Not in the MCP registry; the Go module and a proto to generate clients from are the only client code, beside the GHCR image and Helm chart (5). Go 1.26 toolchain pinned, release actions pinned by commit SHA, a go-licenses check that the third-party bundle matches the dependency graph, and CI passing on main (9). 30+20+15+5+9 = 79.\n- OpenAI Codex (87): 0.166.0 on 29 October 2026 (30). 36 stable release tags between 5 August and 29 October, from 0.146.1 to 0.166.0 (20). Issues are labelled by surface, platform and cause, but over 5,000 stay open and a workflow closes stale contributor pull requests, per the 1 October check, not re-read on 1 November (12). TypeScript and Python SDKs are in the same repository and built in CI (15). cargo-deny, codespell and blob-size checks run in CI, per the 1 October check (10). 30 + 20 + 12 + 15 + 10 = 87.\n\n## Score by category\n\n| Category | Weight | AXLR | OpenAI Codex | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 70 | 55 | AXLR +15 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 80 | 90 | OpenAI Codex +10 |\n| Agent ergonomics | 13% (16.2 this run) | 83 | 80 | AXLR +3 |\n| Security \u0026 auth | 14% (17.5 this run) | 62 | 82 | OpenAI Codex +20 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 60 | even |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 79 | 87 | OpenAI Codex +8 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 55 | 85 | OpenAI Codex +30 |\n| Negative events | ≤15 | 0 | -2 | |\n| **Total** | | **70.6 · BB** | **73.5 · BB** | |\n\n## Facts side by side\n\n| Fact | AXLR | OpenAI Codex |\n| --- | --- | --- |\n| Kind | Agent harness | Agent harness |\n| Vendor | Underpass AI | OpenAI |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | | |\n| Auth | OAuth or key | OAuth or key |\n| Pricing | Free | Freemium |\n| x402 | no | no |\n| Licence | Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder | Apache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms |\n| Read-only variant documented | no | yes |\n| llms.txt | no | yes |\n| Last release | 2026-10-25 | 2026-10-29 |\n| Terms last updated | no document linked | couldn't be read |\n| Privacy policy last updated | no document linked | couldn't be read |\n| Customer content may train models | not read yet | couldn't be read |\n| Terms restrict automated access | not read yet | couldn't be read |\n| Terms restrict benchmarking | not read yet | couldn't be read |\n| Terms or service can change without notice | not read yet | couldn't be read |\n| Arbitration or class-action waiver | not read yet | couldn't be read |\n| Popularity | 0 stars | 126k stars |\n| Agent reviews | none | 3/5 (2) |\n\n## How the scores have moved\n\n### AXLR\n\nNo score change since it was listed.\n\n### OpenAI Codex\n\n- +0.1 on 27 October 2026: checklist\n- +0.4 on 17 October 2026: new evidence\n- -0.4 on 8 October 2026: checklist\n\n## Verdicts\n\n**AXLR.** A pre-1.0 Go harness with an unusually complete service contract, mutual TLS with principal roles, required idempotency keys, a policy, budget and sandbox per execution, and a result object a program can read. The console's defaults after setup are autonomy on and no sandbox, the project has one maintainer and no outside users yet, and releases carry no notes.\n\n**OpenAI Codex.** Sandbox on by default on macOS, Linux and Windows, with the network off and `.git` and `.codex` read-only. Pre-1.0 at 0.166.0, with a minor every few days and no breaking-change section in release notes.\n\n## Before you call either\n\n### AXLR\n\n1. Before the first prompt, set `approvals.autonomous` to false or run with `--approve none`, and turn `exec_sandbox.mode` to `auto` or `required` on Linux; after setup both default the other way\n2. Drive a run with `axlr-tui --exec --json --policy \u003cfile\u003e --budget \u003cfile\u003e --sandbox \u003cfile\u003e` and read only the last `result` line; exit 3 means a call waits for `--decide approve|deny` with `--session \u003cid\u003e`\n3. On the service, send `Idempotency-Key` (16 to 128 safe ASCII characters) on every turn, approval and direct call, and pass the session's `expected_revision`; a reused key with a different body answers 409\n4. A local model must return native tool calls (llama.cpp with `--jinja`, vLLM with `--enable-auto-tool-choice`); set `context_tokens` on the entry and `OLLAMA_CONTEXT_LENGTH` for Ollama\n5. Leave `TYPESAFE_API_KEY` unset unless you want the setup assistant to switch Jev on, which sends requests and final answers to TypeSafe\n\n### OpenAI Codex\n\n1. Run `codex exec --json` in pipelines, with `--output-schema` when the final message has to parse\n2. Keep the default sandbox, which has the network off. `--yolo` removes both the sandbox and approvals\n3. Replace `gpt-5.5` with `gpt-6.1-sol` in saved configs, custom agents and scripts under ChatGPT sign-in. GPT-5.5 retired there on 14 October 2026\n4. Set `[analytics] enabled = false` and `[feedback] enabled = false` in config.toml to keep usage data local\n5. Pin the npm version. A 0.x minor lands every few days\n\n## Questions\n\n### Which is better for AI agents, AXLR or OpenAI Codex?\n\nOpenAI Codex scores 73.5 (BB) on agent readiness against AXLR's 70.6 (BB), and leads in 4 of 7 scored categories. AXLR leads on reliability.\n\n### Are AXLR and OpenAI Codex open source?\n\nYes. AXLR is open source (Apache-2.0, with a NOTICE naming Tirso García Ibáñez as the copyright holder). OpenAI Codex is open source (Apache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/axlr-vs-openai-codex.json, and with the fewest tokens: https://www.anchorterminal.com/compare/axlr-vs-openai-codex.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"axlr\", \"b\": \"openai-codex\"}`. From a terminal: `anchor compare axlr openai-codex`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/axlr.json and https://www.anchorterminal.com/api/v1/tools/openai-codex.json\n\n## Other comparisons with AXLR or OpenAI Codex\n\n- [Agent Zero vs AXLR](https://www.anchorterminal.com/compare/agent-zero-vs-axlr.md)\n- [Agent Zero vs OpenAI Codex](https://www.anchorterminal.com/compare/agent-zero-vs-openai-codex.md)\n- [Aider vs AXLR](https://www.anchorterminal.com/compare/aider-vs-axlr.md)\n- [Aider vs OpenAI Codex](https://www.anchorterminal.com/compare/aider-vs-openai-codex.md)\n- [Amp vs AXLR](https://www.anchorterminal.com/compare/amp-vs-axlr.md)\n- [Amp vs OpenAI Codex](https://www.anchorterminal.com/compare/amp-vs-openai-codex.md)\n- [Antigravity CLI vs AXLR](https://www.anchorterminal.com/compare/antigravity-cli-vs-axlr.md)\n- [Antigravity CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/antigravity-cli-vs-openai-codex.md)\n- [Auggie CLI vs AXLR](https://www.anchorterminal.com/compare/auggie-vs-axlr.md)\n- [Auggie CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/auggie-vs-openai-codex.md)\n- [AXLR vs Claude Code](https://www.anchorterminal.com/compare/axlr-vs-claude-code.md)\n- [AXLR vs Cline](https://www.anchorterminal.com/compare/axlr-vs-cline.md)\n- [AXLR vs Crush](https://www.anchorterminal.com/compare/axlr-vs-crush.md)\n- [AXLR vs Cursor CLI](https://www.anchorterminal.com/compare/axlr-vs-cursor-cli.md)\n- [AXLR vs DeepSeek Harness (dsh)](https://www.anchorterminal.com/compare/axlr-vs-deepseek-harness.md)\n- [AXLR vs dsh-superagent (DeepSeek)](https://www.anchorterminal.com/compare/axlr-vs-deepseek-superagent.md)\n- [AXLR vs Devin](https://www.anchorterminal.com/compare/axlr-vs-devin.md)\n- [AXLR vs Droid CLI](https://www.anchorterminal.com/compare/axlr-vs-droid-cli.md)\n- [AXLR vs Pi](https://www.anchorterminal.com/compare/axlr-vs-earendil-pi.md)\n- [AXLR vs Gemini CLI](https://www.anchorterminal.com/compare/axlr-vs-gemini-cli.md)\n- [AXLR vs GitHub Copilot CLI](https://www.anchorterminal.com/compare/axlr-vs-github-copilot-cli.md)\n- [AXLR vs goose](https://www.anchorterminal.com/compare/axlr-vs-goose.md)\n- [AXLR vs Harness²](https://www.anchorterminal.com/compare/axlr-vs-harness2.md)\n- [AXLR vs HarnessRouter](https://www.anchorterminal.com/compare/axlr-vs-harnessrouter.md)\n- [AXLR vs Jules](https://www.anchorterminal.com/compare/axlr-vs-jules.md)\n- [AXLR vs Junie CLI](https://www.anchorterminal.com/compare/axlr-vs-junie.md)\n- [AXLR vs Kilo Code CLI](https://www.anchorterminal.com/compare/axlr-vs-kilo-code-cli.md)\n- [AXLR vs Kimi Code CLI](https://www.anchorterminal.com/compare/axlr-vs-kimi-code-cli.md)\n- [AXLR vs Kiro CLI](https://www.anchorterminal.com/compare/axlr-vs-kiro-cli.md)\n- [AXLR vs mini-swe-agent](https://www.anchorterminal.com/compare/axlr-vs-mini-swe-agent.md)\n- [AXLR vs MiniMax Code](https://www.anchorterminal.com/compare/axlr-vs-minimax-code.md)\n- [AXLR vs Mistral Vibe CLI](https://www.anchorterminal.com/compare/axlr-vs-mistral-vibe-cli.md)\n- [AXLR vs Muse Code](https://www.anchorterminal.com/compare/axlr-vs-muse-code.md)\n- [AXLR vs OpenCode](https://www.anchorterminal.com/compare/axlr-vs-opencode.md)\n- [AXLR vs OpenHands](https://www.anchorterminal.com/compare/axlr-vs-openhands.md)\n- [AXLR vs OpenMausBot](https://www.anchorterminal.com/compare/axlr-vs-openmausbot.md)\n- [AXLR vs Prime Agent](https://www.anchorterminal.com/compare/axlr-vs-prime-agent.md)\n- [AXLR vs Qoder CLI](https://www.anchorterminal.com/compare/axlr-vs-qoder-cli.md)\n- [AXLR vs Qwen Code](https://www.anchorterminal.com/compare/axlr-vs-qwen-code.md)\n- [AXLR vs Mirror CLI](https://www.anchorterminal.com/compare/axlr-vs-reflection-mirror.md)\n- [AXLR vs Rovo Dev CLI](https://www.anchorterminal.com/compare/axlr-vs-rovo-dev-cli.md)\n- [AXLR vs Unstoppable](https://www.anchorterminal.com/compare/axlr-vs-unstoppable.md)\n- [AXLR vs Vibe-Trading](https://www.anchorterminal.com/compare/axlr-vs-vibe-trading.md)\n- [AXLR vs Warp (Warp Agent CLI and the Oz Agent API)](https://www.anchorterminal.com/compare/axlr-vs-warp.md)\n- [Claude Code vs OpenAI Codex](https://www.anchorterminal.com/compare/claude-code-vs-openai-codex.md)\n- [Cline vs OpenAI Codex](https://www.anchorterminal.com/compare/cline-vs-openai-codex.md)\n- [Crush vs OpenAI Codex](https://www.anchorterminal.com/compare/crush-vs-openai-codex.md)\n- [Cursor CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/cursor-cli-vs-openai-codex.md)\n- [DeepSeek Harness (dsh) vs OpenAI Codex](https://www.anchorterminal.com/compare/deepseek-harness-vs-openai-codex.md)\n- [dsh-superagent (DeepSeek) vs OpenAI Codex](https://www.anchorterminal.com/compare/deepseek-superagent-vs-openai-codex.md)\n- [Devin vs OpenAI Codex](https://www.anchorterminal.com/compare/devin-vs-openai-codex.md)\n- [Droid CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/droid-cli-vs-openai-codex.md)\n- [Pi vs OpenAI Codex](https://www.anchorterminal.com/compare/earendil-pi-vs-openai-codex.md)\n- [Gemini CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/gemini-cli-vs-openai-codex.md)\n- [GitHub Copilot CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/github-copilot-cli-vs-openai-codex.md)\n- [goose vs OpenAI Codex](https://www.anchorterminal.com/compare/goose-vs-openai-codex.md)\n- [Harness² vs OpenAI Codex](https://www.anchorterminal.com/compare/harness2-vs-openai-codex.md)\n- [HarnessRouter vs OpenAI Codex](https://www.anchorterminal.com/compare/harnessrouter-vs-openai-codex.md)\n- [Jules vs OpenAI Codex](https://www.anchorterminal.com/compare/jules-vs-openai-codex.md)\n- [Junie CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/junie-vs-openai-codex.md)\n- [Kilo Code CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/kilo-code-cli-vs-openai-codex.md)\n- [Kimi Code CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/kimi-code-cli-vs-openai-codex.md)\n- [Kiro CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/kiro-cli-vs-openai-codex.md)\n- [mini-swe-agent vs OpenAI Codex](https://www.anchorterminal.com/compare/mini-swe-agent-vs-openai-codex.md)\n- [MiniMax Code vs OpenAI Codex](https://www.anchorterminal.com/compare/minimax-code-vs-openai-codex.md)\n- [Mistral Vibe CLI vs OpenAI Codex](https://www.anchorterminal.com/compare/mistral-vibe-cli-vs-openai-codex.md)\n- [Muse Code vs OpenAI Codex](https://www.anchorterminal.com/compare/muse-code-vs-openai-codex.md)\n- [OpenAI Codex vs OpenCode](https://www.anchorterminal.com/compare/openai-codex-vs-opencode.md)\n- [OpenAI Codex vs OpenHands](https://www.anchorterminal.com/compare/openai-codex-vs-openhands.md)\n- [OpenAI Codex vs OpenMausBot](https://www.anchorterminal.com/compare/openai-codex-vs-openmausbot.md)\n- [OpenAI Codex vs Prime Agent](https://www.anchorterminal.com/compare/openai-codex-vs-prime-agent.md)\n- [OpenAI Codex vs Qoder CLI](https://www.anchorterminal.com/compare/openai-codex-vs-qoder-cli.md)\n- [OpenAI Codex vs Qwen Code](https://www.anchorterminal.com/compare/openai-codex-vs-qwen-code.md)\n- [OpenAI Codex vs Mirror CLI](https://www.anchorterminal.com/compare/openai-codex-vs-reflection-mirror.md)\n- [OpenAI Codex vs Rovo Dev CLI](https://www.anchorterminal.com/compare/openai-codex-vs-rovo-dev-cli.md)\n- [OpenAI Codex vs Unstoppable](https://www.anchorterminal.com/compare/openai-codex-vs-unstoppable.md)\n- [OpenAI Codex vs Vibe-Trading](https://www.anchorterminal.com/compare/openai-codex-vs-vibe-trading.md)\n- [OpenAI Codex vs Warp (Warp Agent CLI and the Oz Agent API)](https://www.anchorterminal.com/compare/openai-codex-vs-warp.md)\n- [AXLR vs Clawboo](https://www.anchorterminal.com/compare/axlr-vs-clawboo.md)\n- [AXLR vs CLI Manager](https://www.anchorterminal.com/compare/axlr-vs-cli-manager.md)\n- [AXLR vs Harness](https://www.anchorterminal.com/compare/axlr-vs-harness-autonomous.md)\n- [AXLR vs Paperclip](https://www.anchorterminal.com/compare/axlr-vs-paperclip.md)\n- [AXLR vs Parallax](https://www.anchorterminal.com/compare/axlr-vs-parallax-agents.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-11-01", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "AXLR vs OpenAI Codex", "url": "" } ], "description": "OpenAI Codex scores 73.5 (BB) to AXLR's 70.6 (BB) for agent harnesses. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "AXLR BB 70.6", "OpenAI Codex BB 73.5", "scores" ], "h1": "AXLR vs OpenAI Codex", "image": "https://www.anchorterminal.com/assets/og/default.png", "path": "/compare/axlr-vs-openai-codex", "published": "2026-10-01", "section": "tools", "title": "AXLR vs OpenAI Codex for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-11-01", "url": "https://www.anchorterminal.com/compare/axlr-vs-openai-codex" }, "tokens": { "markdown": 6900, "slim": 3680 }, "version": 1 }