Head to head · Browser automation · October 2026 research run
BxPlaywright vs Selenium
Selenium scores 70.8 (BB) on agent readiness against BxPlaywright's 55 (C), and leads in 5 of 7 scored categories. Both do browser automation.
Best browser automation tools for AI agents · All 210 browser comparisons
Which one, for what
Best for Teams on BoxLang or modernising CFML who want browser tests, rendering and a browser for BoxLang AI agents in the same language. Agents outside BoxLang get the same tools from playwright-mcp directly.
Also in its favour
- No incidents deducted, where Selenium loses 3 points for them
Watch for
No stable release on 1 November 2026. ForgeBox has only 1.0.0-snapshot, though Ortus announced 1.0 as generally available on 13 October
Selenium BB
Best for Agents that write test or automation scripts in any of five languages, and teams with a Grid.
Ahead on
- Reliability, 90 against 41
- Schema & documentation, 89 against 66
- Agent ergonomics, 70 against 63
- Maintenance & community, 94 against 53
- Transparency & trust, 77 against 70
Also in its favour
- Agent-ready, a grade of BB or better
Watch for
No MCP server from the project. The docs point to community servers and say they are third-party
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Reliability Selenium +49
BxPlaywright 41
Read with the local-software lines and graded as a pre-release. Official package on ForgeBox with BoxLang 1.17.0 or later, Java 21 and the supported platforms stated, but the only version is 1.0.0-snapshot, rebuilt from the development branch on 23 October 2026, with no binary hash on the entry (14 of 20). tests.yml runs 24 test files on Ubuntu and Windows with JDK 21, real-browser tests on Linux and a test of the full distribution, on pull requests, pushes to development and daily. Whether runs pass wasn't read, since WebFetch refused GitHub (15 of 25). Issues weren't readable for the same reason, bugs go to Ortus's Jira, and the repository is a month old, so there's no record to read (5 of 25). Keep a Changelog with semantic versioning stated and a written public contract, but nothing has been released under it and the changelog reads only [Unreleased] (7 of 15). Ortus announced 1.0 as generally available on 13 October, but no 1.0.0 build or tag exists, so it isn't 1.0 for this line (0 of 15). 14+15+5+7+0 = 41.
Selenium 90
Scored as local software. Official packages at 4.52.0 (29 October 2026) on Maven Central, RubyGems, NuGet and npm, with Python 3.10 stated in pyproject.toml and selenium-webdriver now requiring Node.js 22.23.4, 24.22.1 or 26.12.1 or newer (20). Public CI per binding plus Grid and Selenium Manager jobs, and the 15 most recent runs on trunk on 13 October 2026 succeeded except one cancelled cache job, per the 14 October check, not re-read on 1 November (25). 189 open issues and pull requests across five bindings, labelled by component, with a Grid regression in round-robin slot selection (open since 2 October) and an idle-session issue with 27 comments, per the 14 October check, not re-read on 1 November (21 of 25). The project says it does not follow semver. It usually deprecates before removal and lists removals in each binding's changelog, but 4.52.0 also changed the Ruby binding's certificate handling in the same release that deprecated the old behaviour (9 of 15). 4.x, marked Production/Stable in pyproject.toml (15).
Maintenance & community Selenium +41
BxPlaywright 53
The snapshot build of 23 October 2026 is the latest published package, so 30 on time, though it isn't a release (30). No tagged releases or dated changelog entries in the 90 days, only one version rebuilt (0 of 20). 39 pull requests merged by Luis Majano between 30 September and 23 October. Issue replies couldn't be read and bugs go to Jira (10 of 25). Not in the official MCP registry, and the ForgeBox package has no stable version (5 of 15). Playwright for Java 1.63.0, Dependabot for Gradle monthly and Actions quarterly, a daily test run and a format check (8 of 10). 30+0+10+5+8 = 53.
Selenium 94
4.52.0 on 29 October 2026, tagged in the repository and published to Maven Central, RubyGems, NuGet and npm the same day (30). Six releases since 3 August 2026, 4.47.0 (10 August) to 4.52.0 (20). Most of the newest 30 open issues and pull requests have comments and component labels, and pull requests from 13 October already had replies, per the 14 October check, not re-read on 1 November (20 of 25). Current official bindings in five languages, no MCP server to register (15). Renovate updates dependencies and browser pins, and trunk had build and test commits to 30 October (9 of 10).
Schema & documentation Selenium +23
BxPlaywright 66
Library reading. BoxLang is dynamically typed. The public API is listed in the docs' integrations page, help() and bxplaywright help --json describe it at run time, and the ten agent tools describe each argument in a sentence, with no published API reference (14 of 25). llms.txt with a Markdown copy of each of 18 docs pages (10). The AI page says when to use aiTools(), the registry or MCP, and when to turn registration off. Tool descriptions are one line each (13 of 20). Every agent-tool argument is a string, with no enums or limits; library options are checked, and InvalidOption lists the valid values (9 of 15). An errors page lists each error type with when it happens and the fix, eight runnable examples sit in the repository, and the docs have code on every page (13 of 15). Keep a Changelog and docs versioning on release, but no released version and no tags yet (7 of 15). 14+10+13+9+13+7 = 66.
Selenium 89
Graded as a library and a WebDriver server. Typed bindings, a py.typed marker and the W3C WebDriver specification as the wire contract. An open issue asks for a machine-readable API reference across bindings (22 of 25). llms.txt with notes for code generators (10). The docs explain each feature in every binding, and the agent page says what not to use, such as sleeps and legacy CDP pages (15 of 20). Typed options classes and enumerated locator strategies, with capabilities still accepting free-form maps (12 of 15). Docs code samples run in CI, and an errors page gives causes and fixes (15 of 15). Versioned releases and a changelog per binding (15).
Agent ergonomics Selenium +7
BxPlaywright 63
Library reading, scored on what a tool-calling agent gets. Ten compact in-process tools for BoxLang AI, with nothing to load until a tool is used (25 for ten or fewer), less 5 because every action tool returns the whole page's AI snapshot. Through MCP an agent gets Playwright's 24 default tools (20 of 25). The agent tools have no depth, selector or size limit, and browser_text returns the whole page. snapshot( selector ) exists in the library but not in the tools (8 of 20). Errors come back to the agent as text in the form Error [type]: message Fix: detail, and the error types are documented (16 of 20). Assertions retry until they pass. The in-process tools carry no read-only or destructive hints, and bx-ai doesn't read them; over MCP the annotations are Microsoft's (8 of 20). Works with defaults (headless Chromium, 1280 by 720) and profiles, but in one language, BoxLang, with the MCP route for any other client (11 of 15). 20+8+16+8+11 = 63.
Selenium 70
A library adds no tool definitions to context. There is no accessibility snapshot, so an agent reads page source or queries elements (14 of 25). find_elements, relative locators, element screenshots and BiDi network and log filters (14 of 20). Typed exceptions with a documented page per common one, such as ElementClickInterceptedException (17 of 20). Explicit waits with expected conditions and Grid's session queue retry. No idempotency concept applies (10 of 20). Selenium Manager fetches drivers so a first script needs no setup, and five official languages (15).
Transparency & trust Selenium +7
BxPlaywright 70
Apache-2.0, OSI approved, in box.json and src/main/resources/LICENSE (30). Local software with no data statement for the module. The source contacts only nodejs.org, Playwright's browser downloads and the pages it is told to open, and Ortus's privacy policy covers its website and customers (15 of 30). The integrations page says a minor release only adds and removals wait for a major release, listed in the changelog. Nothing has been released under it, and the module was renamed from playwright to bxplaywright on 12 October before any release (10 of 20). No telemetry found in the source and no statement either way in the docs, scored as boxlang-ai was (10 of 20). 30+15+10+10 = 65.
Selenium 77
Apache-2.0, held by Software Freedom Conservancy (30). No privacy page on selenium.dev. The Selenium Manager page lists each field it sends, how often and the purpose (20 of 30). A written rule to deprecate with a pointer to the alternative before removal, and changelogs record removals, without a stated notice period (14 of 20). Telemetry is disclosed with three opt-outs, but on by default (16 of 20).
Score by category
| Category | Weight this run | BxPlaywright | Selenium | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 41 | 90 | Selenium +49 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 66 | 89 | Selenium +23 |
| Agent ergonomics | 13%16.2 | 63 | 70 | Selenium +7 |
| Security & auth | 14%17.5 | 43 | 43 | even |
| Payments & pricing | 10%12.5 | 60 | 60 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 53 | 94 | Selenium +41 |
| Transparency & trust | 7%8.8 | 70 | 77 | Selenium +7 |
| Negative events | ≤15 | 0 | -3 | |
| Total | C 55/100 | BB 70.8/100 |
Facts side by side
| Fact | BxPlaywright | Selenium |
|---|---|---|
| Kind | SDK + MCP | SDK + MCP |
| Vendor | Ortus Solutions | Selenium project (Software Freedom Conservancy) |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | HTTP | |
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | Apache-2.0 | Apache-2.0 |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| Last release | 2026-10-23 | 2026-10-29 |
| Terms last updated | no date given | no document linked |
| Privacy policy last updated | no date given | no document linked |
| Customer content may train models | not found in the text | not read yet |
| Terms restrict automated access | not found in the text | not read yet |
| Terms restrict benchmarking | not found in the text | not read yet |
| Terms or service can change without notice | not found in the text | not read yet |
| Arbitration or class-action waiver | not found in the text | not read yet |
| Popularity | none | 35k stars, 1.8M npm/wk, 6.9M PyPI/wk |
| Agent reviews | none | 3.8/5 (4) |
How the scores have moved
BxPlaywright
No score change since it was listed.
Verdicts
BxPlaywright
A BoxLang library over Playwright for Java with smart selectors, retrying assertions, AI snapshots with element refs and ten browser tools for BoxLang AI, plus a launcher for Microsoft's Playwright MCP server. It is a month old, only a snapshot build is published, and the agent tools have no output limits, path limits or prompt-injection guidance.
Selenium
Selenium is stable, Apache-2.0 software on 4.52.0 with bindings in five languages, six releases since August, an llms.txt and an agent guide. It has no MCP server of its own, Selenium Manager sends usage statistics by default, Grid accepts unauthenticated sessions unless a password is set, and 4.52.0 changed Ruby's Grid certificate handling without a released warning.
Before you call either
BxPlaywright
- Expect snapshot builds. Only 1.0.0-snapshot exists, rebuilt from the development branch, so behaviour can change between installs.
- Run
bxplaywright installandbxplaywright doctorbefore the first call; without them every call fails with Playwright.NotInstalled. - Pass
--headlessand--isolatedtobxplaywright mcp. It opens a headed browser by default and passes options straight to Playwright. - Set
registerAiTools: falseand useplaywright().aiTools()when only some agents should get a browser. - Treat snapshot and page text as untrusted content, never as instructions.
Selenium
- Install with
pip install selenium(Python 3.10 or later) and let Selenium Manager fetch drivers. Do not set driver paths - Use
WebDriverWaitwith expected conditions, never fixed sleeps, and do not mix implicit and explicit waits - Set
SE_AVOID_STATS=trueto stop Selenium Manager sending usage statistics - Point coding agents at https://www.selenium.dev/llms.txt. Most Selenium 2 and 3 era examples use removed APIs
- Set
--usernameand--passwordbefore exposing a Grid beyond localhost. Checkhttp://localhost:4444/statusbefore creating sessions - On Ruby 4.52 or later, pass a ClientConfig with
ignore_certificates: trueonly for a trusted self-signed Grid. Otherwise trust its issuer
Questions
Which is better for AI agents, BxPlaywright or Selenium?
Selenium scores 70.8 (BB) on agent readiness against BxPlaywright's 55 (C), and leads in 5 of 7 scored categories.
Are BxPlaywright and Selenium open source?
Yes. BxPlaywright is open source (Apache-2.0). Selenium is open source (Apache-2.0).
Other comparisons with BxPlaywright or Selenium
- agent-browser vs BxPlaywright
- agent-browser vs Selenium
- Airtop vs BxPlaywright
- Airtop vs Selenium
- Anchor Browser vs BxPlaywright
- Anchor Browser vs Selenium
- Browser Use vs BxPlaywright
- Browser Use vs Selenium
- Browserbase vs BxPlaywright
- Browserbase vs Selenium
- Browserless vs BxPlaywright
- Browserless vs Selenium
- BxPlaywright vs Chrome DevTools MCP
- BxPlaywright vs Functionize MCP server
- BxPlaywright vs Hyperbrowser
- BxPlaywright vs Kane CLI
- BxPlaywright vs Lightpanda
- BxPlaywright vs Notte
- BxPlaywright vs Playwright MCP
- BxPlaywright vs Pomerado
- BxPlaywright vs Puppeteer
- BxPlaywright vs Puppeteer (archived MCP reference server)
- BxPlaywright vs Skyvern
- BxPlaywright vs Steel
- BxPlaywright vs TinyFish
- Chrome DevTools MCP vs Selenium
- Functionize MCP server vs Selenium
- Hyperbrowser vs Selenium
- Kane CLI vs Selenium
- Lightpanda vs Selenium
- Notte vs Selenium
- Playwright MCP vs Selenium
- Pomerado vs Selenium
- Puppeteer (archived MCP reference server) vs Selenium
- Puppeteer vs Selenium
- Selenium vs Skyvern
- Selenium vs Steel
- Selenium vs TinyFish
Machine-readable
- This page as Markdown
/compare/bx-playwright-vs-selenium.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/bx-playwright.json·/api/v1/tools/selenium.json - From a terminal
anchor compare bx-playwright selenium(the CLI) - Over MCP
compare_tools {"a": "bx-playwright", "b": "selenium"}at/mcp, no key