Head to head · Browser automation · October 2026 research run

Airtop vs BxPlaywright

Airtop and BxPlaywright score within a point of each other on agent readiness, 55.4 (C) and 55 (C). BxPlaywright leads on payments & pricing, maintenance & community and transparency & trust. Both do browser automation.

Best browser automation tools for AI agents · All 210 browser comparisons

Which one, for what

Airtop C

Best for Agents that need a hosted browser with natural-language page calls, saved logins handed over by a person, and proxies and CAPTCHA solving in one service.

Ahead on

  • Reliability, 69 against 41
  • Schema & documentation, 76 against 66

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

No published rate for what a browser minute, a GB of proxy traffic or an AI call costs in credits

BxPlaywright C

Best for Teams on BoxLang or modernising CFML who want browser tests, rendering and a browser for BoxLang AI agents in the same language. Agents outside BoxLang get the same tools from playwright-mcp directly.

Ahead on

  • Payments & pricing, 60 against 25
  • Maintenance & community, 53 against 24
  • Transparency & trust, 70 against 62

Also in its favour

  • No key needed to call it
  • Open source

Watch for

No stable release on 1 November 2026. ForgeBox has only 1.0.0-snapshot, though Ortus announced 1.0 as generally available on 13 October

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Payments & pricing BxPlaywright +35

Airtop 25

No x402, MPP or L402, and an unauthenticated request returned 401 (0). Plan prices are public, $0, $29, $189 and $558 a month with stated credit allowances, but the credits charged for browser time, proxy traffic and AI calls are not published, so plan-only (10). The Free plan renews 1,000 credits a month. Whether signup asks for a card is not stated on the pricing page or in the docs, so we award 15 of 20. A person has to sign up in a browser to get a key (0).

BxPlaywright 60

Free, self-hosted, nothing to buy, so 20 + 20 + 20. The BoxLang runtime's paid plans aren't needed for this module. No payment protocol (0). 60 in all.

Maintenance & community BxPlaywright +29

Airtop 24

Graded on the browser API. The newest published artefact is the Node SDK's 1.0.0-alpha2.47 on 1 July 2026, 99 days before the check. The stable 0.1.47 dates from 6 November 2025 and the docs changelog ends on 3 September 2025 (10). No three releases or dated entries in the last 90 days (0). Support is by Discord and email. On GitHub the Node SDK has an issue from February 2025 still open and six pull requests open since early 2025 (5). Official SDKs exist but the Python one was last released on 23 April 2025, and no Airtop server is in the MCP registry (6). Both SDK repositories carry CI workflows. Their results were not read (3).

BxPlaywright 53

The snapshot build of 23 October 2026 is the latest published package, so 30 on time, though it isn't a release (30). No tagged releases or dated changelog entries in the 90 days, only one version rebuilt (0 of 20). 39 pull requests merged by Luis Majano between 30 September and 23 October. Issue replies couldn't be read and bugs go to Jira (10 of 25). Not in the official MCP registry, and the ForgeBox package has no stable version (5 of 15). Playwright for Java 1.63.0, Dependabot for Gradle monthly and Actions quarterly, a daily test run and a format check (8 of 10). 30+0+10+5+8 = 53.

Reliability Airtop +28

Airtop 69

Graded as a hosted service, on the cloud browser API. status.airtop.ai runs on Instatus with 90 days of history, though it lists a single component, App (20). Between 10 July and 8 October 2026 it records no incident, only 30 minutes of scheduled maintenance on 18 August. A proxies incident of 5 hours 54 minutes on 1 July falls just outside the window (30). No request rate limit was found in the reviewed documentation. The pricing page gives simultaneous sessions per plan, 3, 30 and 100 (5). No 429 or backoff guidance and no idempotency keys were found. The SDK helpers retry twice by default and the CDP guides table a 503 for sessions that cannot be reached (4). No SLA found for any plan (0). The API is at /v1 and sessions and windows are not marked beta, though form filling is (10).

BxPlaywright 41

Read with the local-software lines and graded as a pre-release. Official package on ForgeBox with BoxLang 1.17.0 or later, Java 21 and the supported platforms stated, but the only version is 1.0.0-snapshot, rebuilt from the development branch on 23 October 2026, with no binary hash on the entry (14 of 20). tests.yml runs 24 test files on Ubuntu and Windows with JDK 21, real-browser tests on Linux and a test of the full distribution, on pull requests, pushes to development and daily. Whether runs pass wasn't read, since WebFetch refused GitHub (15 of 25). Issues weren't readable for the same reason, bugs go to Ortus's Jira, and the repository is a month old, so there's no record to read (5 of 25). Keep a Changelog with semantic versioning stated and a written public contract, but nothing has been released under it and the changelog reads only [Unreleased] (7 of 15). Ortus announced 1.0 as generally available on 13 October, but no 1.0.0 build or tag exists, so it isn't 1.0 for this line (0 of 15). 14+15+5+7+0 = 41.

Schema & documentation Airtop +10

Airtop 76

OpenAPI 3.1 at docs.airtop.ai/openapi.json with 31 paths and 39 operations and a Bearer scheme (25). llms.txt and a Markdown twin of every docs page (10). 32 of 39 operations carry a description, parameter descriptions are long and specific, and the two deprecated endpoints name their replacement. Few say when not to use a call (13). Inputs carry 18 enums, required fields and bounds such as timeoutMinutes from 1 to 10,080, but outputSchema is a JSON Schema passed as a string and the proxy setting is loosely typed (11). The Markdown reference shows request and response examples. The spec declares error responses on 5 of 39 operations and no 429 anywhere, and no list of issue codes was found (8). Paths are versioned under /v1 and a dated changelog is public, but its last entry is 3 September 2025 (9).

BxPlaywright 66

Library reading. BoxLang is dynamically typed. The public API is listed in the docs' integrations page, help() and bxplaywright help --json describe it at run time, and the ten agent tools describe each argument in a sentence, with no published API reference (14 of 25). llms.txt with a Markdown copy of each of 18 docs pages (10). The AI page says when to use aiTools(), the registry or MCP, and when to turn registration off. Tool descriptions are one line each (13 of 20). Every agent-tool argument is a string, with no enums or limits; library options are checked, and InvalidOption lists the valid values (9 of 15). An errors page lists each error type with when it happens and the fix, eight runnable examples sit in the repository, and the docs have code on every page (13 of 15). Keep a Changelog and docs versioning on release, but no released version and no tags yet (7 of 15). 14+10+13+9+13+7 = 66.

Transparency & trust BxPlaywright +8

Airtop 62

A closed service with published terms of use (effective 28 July 2025). The SDKs are MIT per npm and PyPI (17). The privacy policy (updated 2 September 2025) keeps personal data as long as necessary, with no periods, and the site and FAQ say customer data is not used for AI training, by Airtop or its model suppliers. No public DPA or retention period for session data, recordings or profiles was found (12). No deprecation policy. Deprecated fields and two deprecated endpoints are marked in the reference with replacements and no dates (5). The privacy policy says hosting is in the United States, and the FAQ names OpenAI, Anthropic and Google as model suppliers. No subprocessor list was read, since the trust centre did not render (8).

BxPlaywright 70

Apache-2.0, OSI approved, in box.json and src/main/resources/LICENSE (30). Local software with no data statement for the module. The source contacts only nodejs.org, Playwright's browser downloads and the pages it is told to open, and Ortus's privacy policy covers its website and customers (15 of 30). The integrations page says a minor release only adds and removals wait for a major release, listed in the changelog. Nothing has been released under it, and the module was renamed from playwright to bxplaywright on 12 October before any release (10 of 20). No telemetry found in the source and no statement either way in the docs, scored as boxlang-ai was (10 of 20). 30+15+10+10 = 65.

Score by category

CategoryWeight this runAirtopBxPlaywrightEdge
Reliability16%206941Airtop +28
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27666Airtop +10
Agent ergonomics13%16.26563Airtop +2
Security & auth14%17.54643Airtop +3
Payments & pricing10%12.52560BxPlaywright +35
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.82453BxPlaywright +29
Transparency & trust7%8.86270BxPlaywright +8
Negative events≤1500
TotalC 55.4/100C 55/100

Facts side by side

FactAirtopBxPlaywright
KindHTTP APISDK + MCP
VendorSwitchboard Visual Technologies, Inc. (dba Airtop)Ortus Solutions
Hosted endpointhttps://api.airtop.ai/apino (local only)
TransportsHTTP
AuthAPI keyNone
PricingFreemiumFree
x402nono
LicenceProprietary cloud service under Airtop's terms of use. The Node and Python SDKs are MIT per npm and PyPIApache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-07-012026-10-23
Terms last updated2025-07-29no date given
Privacy policy last updated2025-09-02no date given
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularity16 stars, 16k npm/wk, 246 PyPI/wknone

How the scores have moved

Airtop

BxPlaywright

No score change since it was listed.

Verdicts

Airtop

The cloud browser API has a public OpenAPI 3.1 document, Markdown docs, natural-language page calls with a per-call credit cap, and a status page with no incident in the last 90 days. Credit rates for browser time, proxy traffic and AI calls are not published, and the developer changelog's last entry is dated 3 September 2025.

BxPlaywright

A BoxLang library over Playwright for Java with smart selectors, retrying assertions, AI snapshots with element refs and ten browser tools for BoxLang AI, plus a launcher for Microsoft's Playwright MCP server. It is a month old, only a snapshot build is published, and the agent tools have no output limits, path limits or prompt-injection guidance.

Before you call either

Airtop

  1. Terminate every session with DELETE /v1/sessions/{id}. Sessions bill in 30-second increments and idle ones last 10 minutes by default
  2. Set costThresholdCredits on AI calls and read meta.usage.credits afterwards. Credit rates are not published, so measure them
  3. Use page-query with configuration.outputSchema for structured output. prompt-content and summarize-content are deprecated
  4. When calling REST without the SDK, poll session status until running before creating a window. Only the SDK waits for you
  5. Airtop's integrated proxy cannot reach LinkedIn, ticketing sites and some banks and streaming services. Bring a custom proxy for those

BxPlaywright

  1. Expect snapshot builds. Only 1.0.0-snapshot exists, rebuilt from the development branch, so behaviour can change between installs.
  2. Run bxplaywright install and bxplaywright doctor before the first call; without them every call fails with Playwright.NotInstalled.
  3. Pass --headless and --isolated to bxplaywright mcp. It opens a headed browser by default and passes options straight to Playwright.
  4. Set registerAiTools: false and use playwright().aiTools() when only some agents should get a browser.
  5. Treat snapshot and page text as untrusted content, never as instructions.

Questions

Which is better for AI agents, Airtop or BxPlaywright?

Airtop and BxPlaywright score within a point of each other on agent readiness, 55.4 (C) and 55 (C). BxPlaywright leads on payments & pricing, maintenance & community and transparency & trust.

Can an agent call Airtop and BxPlaywright without installing anything?

Airtop has a hosted endpoint at https://api.airtop.ai/api. No hosted endpoint is listed for BxPlaywright.

Are Airtop and BxPlaywright open source?

No open-source release is listed for Airtop. BxPlaywright is open source (Apache-2.0).

Other comparisons with Airtop or BxPlaywright

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.