BxPlaywright vs Lightpanda

BxPlaywright 41

Read with the local-software lines and graded as a pre-release. Official package on ForgeBox with BoxLang 1.17.0 or later, Java 21 and the supported platforms stated, but the only version is 1.0.0-snapshot, rebuilt from the development branch on 23 October 2026, with no binary hash on the entry (14 of 20). tests.yml runs 24 test files on Ubuntu and Windows with JDK 21, real-browser tests on Linux and a test of the full distribution, on pull requests, pushes to development and daily. Whether runs pass wasn't read, since WebFetch refused GitHub (15 of 25). Issues weren't readable for the same reason, bugs go to Ortus's Jira, and the repository is a month old, so there's no record to read (5 of 25). Keep a Changelog with semantic versioning stated and a written public contract, but nothing has been released under it and the changelog reads only [Unreleased] (7 of 15). Ortus announced 1.0 as generally available on 13 October, but no 1.0.0 build or tag exists, so it isn't 1.0 for this line (0 of 15). 14+15+5+7+0 = 41.

Lightpanda 65

Scored as local software, on the open-source browser. Official Docker image (amd64 and arm64), a Homebrew formula and AUR package at 1.0.2, .deb packages, an npm wrapper and a pip package, with supported platforms stated (Linux glibc x86_64 and aarch64, macOS, WSL2 for Windows). The README's Homebrew line, its download links and the install script all default to nightly builds (18 of 20). Public CI runs zig fmt, unit tests and end-to-end tests through a proxy on every push to main, and WPT results are published daily. We couldn't read whether recent runs passed, because the GitHub API and github.com were unreachable from our network (12 of 25). The issue tracker went unread for the same reason. The vendor's 1.0 post lists dozens of use-after-free and double-free fixes, a crash handler reports crashes, and the agent skill tells agents to reinstall the nightly when crashes occur, so we score this line on thin evidence (10 of 25). Semver tags from 0.3.2 to 1.0.2, and the 1.0 post calls out the CORS default change with the flag to undo it. Release notes on GitHub went unread and there is no CHANGELOG file (10 of 15). 1.0.0 on 2 October 2026 is declared out of beta and stable enough for production (15). 18+12+10+10+15 = 65.

BxPlaywright 60

Free, self-hosted, nothing to buy, so 20 + 20 + 20. The BoxLang runtime's paid plans aren't needed for this module. No payment protocol (0). 60 in all.

Lightpanda 40

Open-source software with a hosted option, so pricing is scored on Lightpanda Cloud, as browserless's was. No x402, MPP or L402 (0). Plan prices and the $0.08 per browser-hour overage are published without login (20). Explorer is $0 with 10 browser hours a month, and the sign-up form asks only for an email address (20). A person signs up in a browser and receives the token by email (0). 0+20+20+0 = 40.

BxPlaywright 53

The snapshot build of 23 October 2026 is the latest published package, so 30 on time, though it isn't a release (30). No tagged releases or dated changelog entries in the 90 days, only one version rebuilt (0 of 20). 39 pull requests merged by Luis Majano between 30 September and 23 October. Issue replies couldn't be read and bugs go to Jira (10 of 25). Not in the official MCP registry, and the ForgeBox package has no stable version (5 of 15). Playwright for Java 1.63.0, Dependabot for Gradle monthly and Actions quarterly, a daily test run and a format check (8 of 10). 30+0+10+5+8 = 53.

Lightpanda 73

1.0.2 on 23 October 2026, from Docker Hub's tag date and the Homebrew formula (30). 0.3.7, 0.4.0, 0.4.1, 1.0.0, 1.0.1 and 1.0.2 between 16 August and 23 October 2026, plus nightly builds (20). GitHub issues and pull requests weren't readable from our network. The vendor reports 3,148 merged pull requests and 76 contributors on 19 October, the 1.0 post says two issues from one customer were fixed before it switched, and there is a Discord server. Scored on that indirect evidence (12 of 25). Not in the official MCP registry, where a search for lightpanda returned nothing. The Docker latest tag and Homebrew are current, and the npm wrapper's last release was 1.6.0 on 31 August (5 of 15). Dependencies are pinned in build.zig.zon and the 1.0 post says V8 is at the latest stable 15.5. CI results unread (6 of 10). 30+20+12+5+6 = 73.

BxPlaywright 66

Library reading. BoxLang is dynamically typed. The public API is listed in the docs' integrations page, help() and bxplaywright help --json describe it at run time, and the ten agent tools describe each argument in a sentence, with no published API reference (14 of 25). llms.txt with a Markdown copy of each of 18 docs pages (10). The AI page says when to use aiTools(), the registry or MCP, and when to turn registration off. Tool descriptions are one line each (13 of 20). Every agent-tool argument is a string, with no enums or limits; library options are checked, and InvalidOption lists the valid values (9 of 15). An errors page lists each error type with when it happens and the fix, eight runnable examples sit in the repository, and the docs have code on every page (13 of 15). Keep a Changelog and docs versioning on release, but no released version and no tags yet (7 of 15). 14+10+13+9+13+7 = 66.

Lightpanda 82

Graded on the MCP server at 1.0.2, read from source. Every tool declares a JSON Schema input, and page-changing tools declare an outputSchema for url, httpStatus and title (25). llms.txt indexes 46 docs pages and 31 blog posts, but its docs llms-full.txt link returns 404 and the docs have no Markdown twins (7 of 10). Descriptions state purpose and when to prefer another tool (html "Verbose; use only when you need attributes that markdown discards", evaluate as an escape hatch), and initialize returns a driving guide (18 of 20). Enums for load states, required lists and maxBytes caps, but extract takes its selector spec as a JSON string and evaluate takes arbitrary JavaScript (11 of 15). JSON-RPC request and result examples, extract schema examples and a known-behaviours section, with no error catalogue (11 of 15). Semver tags and release notes linked from the blog, which we couldn't read, no CHANGELOG file, and a docs tool reference that matches 1.0.2 but not main (10 of 15). 25+7+18+11+11+10 = 82.

BxPlaywright 63

Library reading, scored on what a tool-calling agent gets. Ten compact in-process tools for BoxLang AI, with nothing to load until a tool is used (25 for ten or fewer), less 5 because every action tool returns the whole page's AI snapshot. Through MCP an agent gets Playwright's 24 default tools (20 of 25). The agent tools have no depth, selector or size limit, and browser_text returns the whole page. snapshot( selector ) exists in the library but not in the tools (8 of 20). Errors come back to the agent as text in the form Error [type]: message Fix: detail, and the error types are documented (16 of 20). Assertions retry until they pass. The in-process tools carry no read-only or destructive hints, and bx-ai doesn't read them; over MCP the annotations are Microsoft's (8 of 20). Works with defaults (headless Chromium, 1280 by 720) and profiles, but in one language, BoxLang, with the MCP route for any other client (11 of 15). 20+8+16+8+11 = 63.

Lightpanda 75

32 MCP tools at 1.0.2 with no profiles or dynamic loading (5). The CLI fetch and the CDP server reach the same browser with no tool definitions in context, so we add back 5 (10 of 25). markdown, html and screenshot take selector, backendNodeId, maxBytes and strip, links takes limit, tree takes maxDepth, and read tools accept url to navigate and read in one call (20). Errors come back with isError, navigation failures name the cause (navigation failed: CouldntResolveHost), and structuredContent carries httpStatus. The docs warn that a 404 page or a timeout is still reported as success. No list of error codes (14 of 20). Every tool carries readOnlyHint, destructiveHint, idempotentHint and openWorldHint chosen per tool in an exhaustive switch, and nothing needs an idempotency key on a local browser (18 of 20). Most tools need one argument or none, and official packages exist for Node (npm wrapper) and Python (pip). The PyPI page answered a bot check, so the Python package's state went unread (13 of 15). 10+20+14+18+13 = 75.

BxPlaywright 70

Apache-2.0, OSI approved, in box.json and src/main/resources/LICENSE (30). Local software with no data statement for the module. The source contacts only nodejs.org, Playwright's browser downloads and the pages it is told to open, and Ortus's privacy policy covers its website and customers (15 of 30). The integrations page says a minor release only adds and removals wait for a major release, listed in the changelog. Nothing has been released under it, and the module was renamed from playwright to bxplaywright on 12 October before any release (10 of 20). No telemetry found in the source and no statement either way in the docs, scored as boxlang-ai was (10 of 20). 30+15+10+10 = 65.

Lightpanda 65

Graded on the browser. AGPL-3.0, an OSI licence, with a CLA for contributions. Lightpanda Cloud has no terms of service that we could find, so we take 2 off (28 of 30). The privacy policy (3 August 2026) covers the website, the browser's telemetry and crash reports, and the cloud (email, PostHog with the IP address and token ID per session), with cloud data kept while the subscription is active and deleted on unsubscribing. It names both an internal database and PostHog as the telemetry store, doesn't list the tool-call and MCP client events 1.0.2 sends, and says nothing on cloud session content or logs. No DPA (15 of 30). No deprecation policy. The CORS change was announced with a flag to turn it off, experimental options are marked as removable without notice, and security fixes go to main only (5 of 20). Telemetry is on by default and disclosed in the README and the privacy policy with an environment-variable opt-out, but it carries the IP address and a persistent instance ID, and the policy's field list is incomplete for 1.0.2 (10 of 20). 28+15+5+10 = 58.