Head to head · Agent harnesses · October 2026 research run

Agent Zero vs OpenAI Agents API

OpenAI Agents API scores 73.3 (BB) on agent readiness against Agent Zero's 46 (D), and leads in 6 of 7 scored categories. Agent Zero leads on payments & pricing. Both do agent harnesses.

Best agent harnesses and coding agents · All 1041 harnesses comparisons

Which one, for what

Agent Zero D

Best for A technical owner who wants an agent with its own Linux machine, reachable from Telegram, WhatsApp or email, with scheduled tasks and editable memory.

Ahead on

  • Payments & pricing, 60 against 30

Also in its favour

  • No key needed to call it
  • Open source

Watch for

No approval step before shell commands, file changes or outgoing messages. Tool Access defaults to allow

OpenAI Agents API BB

Best for Teams that want OpenAI to run the agent loop, with sandboxes, MCP tools and subagents, and are fine with a beta API, US-only data residency and no Zero Data Retention.

Ahead on

  • Schema & documentation, 88 against 64
  • Agent ergonomics, 80 against 62
  • Security & auth, 87 against 54
  • Maintenance & community, 87 against 75
  • Transparency & trust, 85 against 64

Also in its favour

  • Agent-ready, a grade of BB or better
  • A hosted endpoint, with nothing to install
  • No incidents deducted, where Agent Zero loses 15 points for them

Watch for

Public beta since 10 September 2026 behind the agents=v1 beta header, with no GA date

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth OpenAI Agents API +33

Agent Zero 54

Harness reading of the framework checklist, the one the Goose calibration dossier uses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No usage telemetry was found in the source. An update check, on by default, posts the version and a 20-character SHA-256 hash of a random per-install id to api.agent-zero.ai. The Update Checker settings page says only that ID and the version are sent and has an off switch. Something still leaves the machine by default, so the partial is kept (22). The agent works inside a Docker container built on Kali Linux and runs as root there. Tool Access can block tools by project or profile and defaults to allow, host access through the A0 CLI is scoped by read, write and execute permissions, and no approval step was found before a shell command, a file deletion or an outgoing message. The web interface has no login until a username is set (10). Infection Check audits the agent's reasoning with a second model before each tool call and ships disabled. Scanners check plugins, skills and MCP servers before install. The channel allow-lists accept every sender when empty, and the email filter matches the claimed From address only, which the plugin README states (7). Chat logs, visible tool steps and Time Travel snapshots, with no per-call audit log. Per-process log files were removed in v2.5 (9). No SECURITY.md on 4 November, security.txt answered 404 on 12 October, and none of the eight CVEs published from 17 March to 22 October 2026 came from the vendor (VulDB, VulnCheck, MITRE and CISA assigned them). A security-review ledger in the repository records two findings, and the v2.12 notes name both fixes (6, a partial kept).

OpenAI Agents API 87

Project keys with restricted per-endpoint permissions, service accounts and workload identity, per the openai-api listing; we didn't confirm a key can be limited to /v1/agents (27 of 30). Automatic review for approvals, a sandbox network restricted to a host allowlist, vaults for secrets and a sandbox security guide (17 of 20). The agent reads web pages, MCP results and browser content; the sandbox security guide and approval flow are the mitigations, with no prompt-injection guide of its own found (8 of 15). Tracing, observability and usage per session and admin audit logs (15). SOC 2 Type 2, ISO 27001 family, Bugcrowd bounty and a disclosure policy, per the openai-api listing (20). Not ZDR-eligible and US residency only, recorded under transparency. 27 + 17 + 8 + 15 + 20 = 87.

Payments & pricing Agent Zero +30

Agent Zero 60

Read with the self-hosted rule. No payment protocol in the source (0). Free under MIT with nothing to buy for the software, so 20, 20 and 20 on the last three lines. It starts with one Docker command and no account. Model usage is billed by whichever provider the owner configures, or costs nothing with a local model. The vendor's site also describes a beta LLM API whose daily quota depends on staking its A0T token. That is separate from the software and not scored.

OpenAI Agents API 30

No machine payment protocol (0). Model, tool and container prices published without a login, and no fee for the API itself (20). The Free tier reading of the openai-api listing, half (10). Sign-up in a browser (0). 0 + 20 + 10 + 0 = 30.

Schema & documentation OpenAI Agents API +24

Agent Zero 64

Harness reading of the lines, as the Goose calibration dossier does. No OpenAPI file. The connectivity page lists five external endpoints and the X-API-KEY header, then sends readers to the source or DeepWiki for request and response details. Each API handler and tool has a .dox.md contract file in the repository, and the MCP client JSON shape is documented (10 of 25). llms.txt at www.agent-zero.ai, and AGENTS.md contract files across the repository (10). Guides say which path to use for a need, with tables that separate the browser, the host connector, MCP and A2A (14 of 20). The v2.12 notes say 15 bundled tools gained argument descriptions in non-strict schemas, and plugin settings are typed YAML with commented examples (8 of 15). Guides carry worked examples and a troubleshooting page, with no documented error responses for the external API (9 of 15). Dated notes on every GitHub release and a release article for each version on the site, with no version prefix on API routes (13 of 15).

OpenAI Agents API 88

The reference is linked from the overview and the SDKs carry beta.agents types; we didn't confirm /agents/sessions in OpenAI's public OpenAPI file, so 15 of 25. llms.txt with every Agents API page and Markdown twins (10). The overview, architecture page and the agents guide that compares the Agents API, Agents SDK and Responses API say when to use it (20). Typed configuration with enumerated container sizes, network modes and environment types (13 of 15). Examples in six languages and an errors page with codes per HTTP status, turn and session (15). Dated changelog entries and a versioned beta header (15). 15 + 10 + 20 + 13 + 15 + 15 = 88.

Transparency & trust OpenAI Agents API +21

Agent Zero 64

MIT, copyright Agent Zero, s.r.o. (30). No privacy policy for the software was found. The site's cookie notice covers the website, and its terms (14 May 2026) cover the community platform. The docs say where data lives (chats, memory, secrets and settings under /a0/usr) and warn that model providers see what is sent to them only in general terms, with no retention statement (8 of 30). Release notes list breaking changes and removals with the release date, and one deprecated alias is named. No deprecation policy or notice period was found (8 of 20, a partial kept). No usage telemetry was found in the source. The update check is described on its settings page, which says it sends only a randomised, hashed install ID and the version number, and the same page turns it off. The ID is a hash of a random per-install token, a pseudonym under this run's reading, so the statement holds (20). 30 + 8 + 8 + 20 = 66.

OpenAI Agents API 85

Closed service with clear terms, Apache-2.0 SDKs (15). Session state retained until deleted, deletable sessions and artifacts, not ZDR-eligible, US residency only, and the data-controls guide agrees; no retention period for artifacts after a sandbox expires (25 of 30). Dated deprecation notices with minimum periods for GA models; a beta API can change faster (15 of 20). Subprocessors and processing countries listed, per the openai-api listing (20). 15 + 25 + 15 + 20 = 75.

Agent ergonomics OpenAI Agents API +18

Agent Zero 62

Harness reading, scored on what a person or program driving it must supply. Skills load on demand, blocked tools are removed from the prompt, chats can be compacted, and the v2.12 notes report Codex input falling from about 16.4K to 11.3K tokens, a vendor figure (18 of 25). An MCP tool timeout of 120 seconds, a limit of five consecutive unusable responses and context-window handling are set by default. No turn or spend limit was found in the reviewed docs (11 of 20). Other programs reach it through POST /api_message, an optional MCP server, A2A and an ACP bridge, with request and response shapes left to the source (11 of 20). An error-retry plugin, saved chats, a message queue, backups and Time Travel snapshots with diff and revert (14 of 20). One Docker command starts it and a wizard sets the model, but there is no SDK and the default has no login (8 of 15).

OpenAI Agents API 80

Read as an API an agent drives. Context is compacted automatically, and session budgets and streamed events keep output sized (20 of 25). Sessions can be listed, continued and steered, events streamed or sent by webhook, artifacts fetched (15 of 20). Actionable error codes with recovery steps (20). No idempotency key; a documented check-then-retry procedure (10 of 20). One session call with defaults (medium sandbox, network enabled), SDKs in five languages (15). 20 + 15 + 20 + 10 + 15 = 80.

Maintenance & community OpenAI Agents API +12

Agent Zero 75

v2.15 was tagged on 1 November 2026, 3 days before this check (30). Seven releases from 6 August, v2.9 on 12 August to v2.15, read from the clone's tags (20). Of the 40 newest open items read on 12 October, 16 are issues and 14 of those have no comment. Three security reports filed as issues were closed as completed, one in five days and two after three months. GitHub's issue pages weren't read on 4 November, so this is per the 12 October check (10 of 25). The Docker image, the desktop Launcher, the install scripts and the A0 CLI connector come from the same organisation, and the v2.14 notes point the README's Launcher links to v1.9 (10 of 15). A Docker publish workflow builds images from tags, and the v2.14 notes raise dependency security floors for aiohttp, anyio, urllib3, filelock, fsspec and multidict. No public test CI (5 of 10). 30 + 20 + 10 + 10 + 5 = 75.

OpenAI Agents API 87

Closed API. Last dated change 16 October 2026, Ultrafast mode and document skills (30). Four dated changelog entries in the 57 days since release, 10 September, 29 September, 9 October and 16 October (20). Changelog and help centre, as the openai-api listing reads them (12 of 15). Official SDKs carry beta.agents (15). SDK CI, per the openai-api listing (10). 30 + 20 + 12 + 15 + 10 = 87.

Score by category

CategoryWeight this runAgent ZeroOpenAI Agents APIEdge
Reliability16%205760OpenAI Agents API +3
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26488OpenAI Agents API +24
Agent ergonomics13%16.26280OpenAI Agents API +18
Security & auth14%17.55487OpenAI Agents API +33
Payments & pricing10%12.56030Agent Zero +30
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87587OpenAI Agents API +12
Transparency & trust7%8.86485OpenAI Agents API +21
Negative events≤15-150
TotalD 46/100BB 73.3/100

Facts side by side

FactAgent ZeroOpenAI Agents API
KindAgent harnessHTTP API
VendorAgent Zero, s.r.o.OpenAI
Hosted endpointno (local only)https://api.openai.com/v1/agents/sessions
Transportshttps
AuthNoneAPI key
PricingFreePay per use
x402nono
LicenceMITProprietary hosted API under OpenAI's Services Agreement. The SDKs are Apache 2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-11-012026-10-16
Terms last updatedno document linkedcouldn't be read
Privacy policy last updatedno document linkedcouldn't be read
Customer content may train modelsnot read yetcouldn't be read
Terms restrict automated accessnot read yetcouldn't be read
Terms restrict benchmarkingnot read yetcouldn't be read
Terms or service can change without noticenot read yetcouldn't be read
Arbitration or class-action waivernot read yetcouldn't be read
Popularity19k starsnone

How the scores have moved

Verdicts

Agent Zero

Self-hosted under the MIT licence, with seven releases from 12 August to 1 November 2026 and breaking changes listed in minor-release notes. The agent runs shell commands in its container with no approval step, the web interface has no login by default, and eight CVEs from the past year were published by third parties with no vendor advisory.

OpenAI Agents API

OpenAI's hosted agent runtime, the Codex harness behind one session call, with MCP, functions, web search, computer use, subagents and sandboxes on OpenAI or your own infrastructure. Documentation, errors and SDKs are thorough. It's still public beta, can't use Zero Data Retention and keeps data in the United States only.

Before you call either

Agent Zero

  1. Set a UI login and password in Settings before publishing the port or opening a tunnel. The default has none
  2. Fill allowed_users, allowed_numbers or sender_whitelist before enabling a channel. An empty list accepts every sender
  3. Enable the Infection Check plugin when the agent reads mail, web pages or MCP results. It ships disabled
  4. Run v2.12 or later. It fixes a Telegram webhook authentication bypass and a WhatsApp media path traversal
  5. Call POST /api_message with the X-API-KEY header. The token changes when the UI login or password changes

OpenAI Agents API

  1. POST https://api.openai.com/v1/agents/sessions with a project key and the header OpenAI-Beta: agents=v1, or use client.beta.agents in the SDKs
  2. Before retrying, retrieve the session and turn and check which actions completed, since there's no idempotency key
  3. Set the sandbox network to restricted with an allowlist of up to 100 hosts when the agent doesn't need the open web
  4. Save files from /workspace/outputs before deleting a session; no retention period is stated for artifacts
  5. Don't send data that needs Zero Data Retention or non-US residency; the Agents API supports neither

Questions

Which is better for AI agents, Agent Zero or OpenAI Agents API?

OpenAI Agents API scores 73.3 (BB) on agent readiness against Agent Zero's 46 (D), and leads in 6 of 7 scored categories. Agent Zero leads on payments & pricing.

Can an agent call Agent Zero and OpenAI Agents API without installing anything?

No hosted endpoint is listed for Agent Zero. OpenAI Agents API has a hosted endpoint at https://api.openai.com/v1/agents/sessions.

Are Agent Zero and OpenAI Agents API open source?

Agent Zero is open source (MIT). No open-source release is listed for OpenAI Agents API.

Other comparisons with Agent Zero or OpenAI Agents API

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.