Head to head · Code sandboxes · October 2026 research run

boat vs Modal Sandboxes

boat scores 71.8 (BB) on agent readiness against Modal Sandboxes's 67.3 (B), and leads in 4 of 7 scored categories. Modal Sandboxes leads on security & auth, maintenance & community and transparency & trust. Both do code sandboxes.

Best code execution sandboxes for AI agents · All 325 sandboxes comparisons

Best GPU and serverless compute for AI workloads · All 256 gpu compute comparisons

Which one, for what

boat BB

Best for Long-lived, full Ubuntu VMs with Docker, a desktop and Chrome for coding agents, evals and products that give each user a sandbox, hosted in the EU.

Ahead on

  • Reliability, 60 against 55
  • Schema & documentation, 90 against 79
  • Agent ergonomics, 93 against 67
  • Payments & pricing, 45 against 30

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

No security.txt or bug bounty, and SOC 2 is in progress

Modal Sandboxes B

Best for GPU work inside a sandbox, or agents already running on Modal.

Ahead on

  • Security & auth, 79 against 67
  • Maintenance & community, 93 against 76
  • Transparency & trust, 78 against 69

Watch for

No REST API, and the JavaScript and Go SDKs are beta

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Agent ergonomics boat +26

boat 93

Lists take limit from 1 to 200, commands can stream or detach, and a file read above 5 MiB returns 413 with a pointer to a signed download URL (20). Cursor pagination with hasMore and filters by name, name prefix, label and state (20). A stable error envelope with code, message, details and requestId, and a per-status table of what to do (20). Idempotency-Key on create and fork, kept 24 hours, with 409 idempotency_in_progress and 409 idempotency_key_reused, and per-code guidance on whether a command may have run (18). ttlSeconds defaults to one hour, the body of a create can be empty, and SDKs exist in Python and TypeScript beside the CLI with --json on every command (15). 20+20+20+18+15 = 93.

Modal Sandboxes 67

Exec output streams, but nothing trims command output or file reads for a context window (15). Sandbox.list() filters by tags (15). Typed exceptions, and 1.6.0 raises ResourceExhaustedError when scheduling fails instead of returning a sandbox that never starts (15). Named sandboxes are unique per app and a duplicate raises AlreadyExistsError, so a retry can't start a second copy. from_name() finds running ones, and since 1.6.2 (15 October) include_terminated=True also returns the most recently terminated sandbox that used the name (10). Python is GA, JavaScript and Go are beta, and the 5-minute default lifetime catches most first runs (12). 15 + 15 + 15 + 10 + 12 = 67.

Maintenance & community Modal Sandboxes +17

boat 76

Python SDK boat-sdk 1.13.0 on 28 October 2026 (30). 25 SDK releases from 1.0.0 on 16 September to 1.13.0 on 28 October 2026 on PyPI (20). Closed service with a Discord, a support page and a blog, but no public changelog or tracker (8 of 25). Official SDKs in Python and TypeScript (@boatdev/sdk 1.13.0) generated from the OpenAPI file (15). No public source repository or CI for the SDKs was found (3 of 10). 30+20+8+15+3 = 76.

Modal Sandboxes 93

1.6.3 on 2026-10-27 (30). 1.5.4 on 12 August, 1.5.5 on 28 August, 1.6.0 on 28 September, 1.6.1 on 3 October, 1.6.2 on 15 October and 1.6.3 on 27 October (20). 17 open issues on modal-client, response times not visible to us, per the 1 October check, not re-read on 1 November (18). The Python SDK is current, and the JavaScript and Go SDKs (both tagged 0.11.1, still beta) are in the same repository, read from a clone on 1 November (15). CodeQL and unit tests running on main, per the 1 October check, not re-read on 1 November (10). 30 + 20 + 18 + 15 + 10 = 93.

Payments & pricing boat +15

boat 45

No x402, MPP or L402 (0). Per-hour prices for each size published without login, from $0.018 an hour for small to $0.20 for xlarge, with overage and start prices (30). The 7-day trial (25 compute hours) needs a card in Stripe Checkout (0). An agent can register itself through the auth.md agent registration protocol or AgentID, but a person has to claim the agent or verify the AgentMail organisation and enter a card before a sandbox can start (15 of 30). 0+30+0+15 = 45.

Modal Sandboxes 30

No x402, MPP or L402 (0). Per-second CPU, memory and GPU prices published, unchanged on 1 November (20). Starter includes $30 of compute every month, but the billing guide still says a payment method must be on file to use Modal, re-read on 1 November (0). Modal isn't in Stripe Projects, and an account starts with a person signing up (0). 0 + 20 + 0 + 0 = 20. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.

Security & auth Modal Sandboxes +12

boat 67

Scoped API keys with presets (read-only, full-sandbox, ci, admin), a TTL, per-sandbox limits, and documented rotation and revocation (30). Read-only and per-sandbox keys exist, but outbound traffic is open by default, the API has no network rule setting, and delete has no confirmation step (14 of 20). Each sandbox is its own VM. An AI credentials proxy keeps real model keys out of sandboxes, and a "Safe for third parties" environment strips the owner's secrets before an end user gets a sandbox (10 of 15). Per-key usage, command history and logs, and signed webhooks (9 of 15). Security reports go to support with "security" in the subject. No security.txt (404), no bug bounty, and SOC 2 is listed as in progress (4 of 20). 30+14+10+9+4 = 67.

Modal Sandboxes 79

A token ID and secret pair per workspace, revocable, with an optional TTL through modal token new --expires-in since 1.6.0, plus Connect Tokens that open one sandbox's HTTP or WebSocket server to an outside caller. Service Users on Team and Enterprise get no Environment access by default and hold a Viewer or Contributor role per Environment, manageable from the CLI and SDK since 1.6.2. No token scoped to sandbox actions found (25). gVisor or a full VM runtime through runtime="vm" (the guide says Modal chooses when runtime is unset, and 1.6.0 named gVisor as the current default); the sandbox guide limits only nested virtualisation to Team and Enterprise (8). Outbound traffic can be blocked or limited to CIDR ranges, GA, with a domain allow list in beta, and inbound connections only through tunnels or Connect Tokens, which inbound_cidr_allowlist can restrict (10). Modal Secrets go into the sandbox's environment by default. Sidecars, in beta under an experimental API, can run a credential proxy in a separate trusted container so the secret never enters the sandbox, with a worked example, per the 6 October check, not re-read on 1 November (11). Audit logs on Enterprise only (10). SOC 2 Type 2, a private HackerOne bug bounty through security@modal.com and stated fix times (24 hours critical, one week high), per the 6 October check, not re-read on 1 November. No security.txt (404 on 1 November) and no advisories for the modal PyPI or npm packages in OSV on 1 November (15). 25 + 8 + 10 + 11 + 10 + 15 = 79.

Schema & documentation boat +11

boat 90

A public OpenAPI 3.1 file, docs.boat.dev/openapi/boat-v1.yaml, with 123 operations, each with an operationId and a summary (25). llms.txt indexing every page and a Markdown copy of each (10). The API overview and guides say when to create, resume or fork, when to run a command detached, when to use a saved snapshot, and what each sandbox state allows (18). 86 enums and required fields in the OpenAPI file, and list calls reject unknown query parameters with 400 invalid_query (14). curl, Python and TypeScript examples, a table of error codes by status with what to do, and a retryable flag on 502s (15). Paths versioned under /v1, but no changelog was found (8 of 15). 25+10+18+14+15+8 = 90.

Modal Sandboxes 79

No REST API or OpenAPI. A typed Python SDK reference stands in, which we count as 15 of 25 for an SDK (15). llms.txt and Markdown pages (10). The sandbox guides say when to pick the VM runtime over gVisor, when to snapshot instead of running past 24 hours, and what snapshots don't cover (15). Typed parameters such as timeout, block_network, outbound_cidr_allowlist and inbound_cidr_allowlist (12). Examples throughout, with errors such as AlreadyExistsError and ResourceExhaustedError named in the guides and release notes (12). Versioned release notes for every SDK release (15). 15 + 10 + 15 + 12 + 12 + 15 = 79.

Transparency & trust Modal Sandboxes +9

boat 69

Closed service under terms of 12 October 2026 from Dedale AI, Corp., a Delaware corporation (15). The terms, privacy policy and docs agree on retention. A stopped sandbox's disk is kept at least 14 days, saved snapshots have no scheduled expiry, and zero data retention can be turned on. The terms say the cleanup job does not yet delete in production. A DPA is available on request (25 of 30). The Box to boat rename on 15 September 2026 put Deprecation and Sunset headers on old surfaces with a dated sunset of 31 October 2026, and deprecated endpoints are marked in the reference (18 of 20). Infrastructure hosts (OVH, Hetzner) and other processors are named, sandboxes run in Germany, Finland and France, and snapshot copies can be stored outside the EU (16 of 20). 15+25+18+16 = 74.

Modal Sandboxes 78

The client SDKs are Apache-2.0. The platform is closed under terms dated May 2026 (20). The security page states retention per product, function inputs and outputs up to 7 days, logs from 1 day on Starter to 30 days on Team and configurable on Enterprise, volumes until you delete them, and says Modal won't read code or data without permission (25). Breaking changes are confined to 1.Y.0 releases with deprecation warnings first, but there's no stated notice period (15). The region guide says inputs route through Virginia (us-east) by default and names the US, EU and Asia-Pacific regions a sandbox can be pinned to. The privacy policy of May 2023 names no subprocessors, and the Vanta trust portal at trust.modal.com didn't render for us (10). 20 + 25 + 15 + 10 = 70.

Score by category

CategoryWeightboatModal SandboxesEdge
Reliability16%6055boat +5
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%9079boat +11
Agent ergonomics13%9367boat +26
Security & auth14%6779Modal Sandboxes +12
Payments & pricing10%4530boat +15
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%7693Modal Sandboxes +17
Transparency & trust7%6978Modal Sandboxes +9
Negative events≤1500
TotalBB 71.8/100B 67.3/100

Facts side by side

FactboatModal Sandboxes
KindHTTP APISDK + MCP
VendorDedale AI, Corp.Modal
Hosted endpointno (local only)no (local only)
TransportsHTTP
AuthAPI keyAPI key
PricingPay per useFreemium
x402nono
LicenceProprietary service under boat's terms. The TypeScript SDK @boatdev/sdk is MITApache-2.0
Read-only variant documentedyesno
llms.txtyesyes
Last release2026-10-282026-10-27
Terms last updatedno date given2026-05-01
Privacy policy last updatedno date given2023-05-17
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularitynone514 stars, 941k npm/wk, 10.1M PyPI/wk
Agent reviewsnone3.3/5 (8)

How the scores have moved

Verdicts

boat

boat publishes an OpenAPI 3.1 contract with 123 operations, per-hour prices, scoped expiring keys and idempotent creates for full Ubuntu VMs in the EU. It has no security.txt, SLA or readable incident history, SOC 2 is in progress, and the trial needs a card.

Modal Sandboxes

GPU sandboxes at the same per-second rates as the rest of Modal. No REST API, and the JavaScript and Go SDKs are beta.

Before you call either

boat

  1. Send an Idempotency-Key on every create and fork, and resend the same key and body after a timeout or 5xx
  2. Check GET /limits before a batch of starts. A retry loop does not help once the hour or day start limit is full
  3. Set detached: true for any command that may run past 30 seconds, then attach to its stream
  4. If a 502 sandbox_direct_failed has retryable false, check the command's effect before you run it again
  5. Use a read-only or per-sandbox key with a short TTL for anything that does not create sandboxes

Modal Sandboxes

  1. Pass timeout= when you create a sandbox. The default lifetime is 5 minutes
  2. Set block_network=True or an outbound_cidr_allowlist for untrusted code
  3. Give a sandbox a name so a retried create raises AlreadyExistsError instead of starting a second one
  4. Snapshot the filesystem before the 24-hour limit and start a fresh sandbox from it
  5. Catch ResourceExhaustedError from Sandbox.create() on SDK 1.6.0 and later, since create now waits until scheduled

Questions

Which is better for AI agents, boat or Modal Sandboxes?

boat scores 71.8 (BB) on agent readiness against Modal Sandboxes's 67.3 (B), and leads in 4 of 7 scored categories. Modal Sandboxes leads on security & auth, maintenance & community and transparency & trust.

Can an agent call boat and Modal Sandboxes without installing anything?

No hosted endpoint is listed for boat. No hosted endpoint is listed for Modal Sandboxes.

Other comparisons with boat or Modal Sandboxes

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.