Head to head · Persistent sandboxes · October 2026 research run

Agent 37 Cloud vs boat

boat scores 71.8 (BB) on agent readiness against Agent 37 Cloud's 55.7 (C), and leads in 6 of 7 scored categories. Both do persistent sandboxes.

Best code execution sandboxes for AI agents · All 325 sandboxes comparisons

Which one, for what

Agent 37 Cloud C

Best for A product that gives each end user a long-lived agent machine that is idle most of the day and needs a harness preinstalled.

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

The status page is new, with history only from October 2026, and the terms promise no uptime level

boat BB

Best for Long-lived, full Ubuntu VMs with Docker, a desktop and Chrome for coding agents, evals and products that give each user a sandbox, hosted in the EU.

Ahead on

  • Schema & documentation, 90 against 57
  • Agent ergonomics, 93 against 60
  • Security & auth, 67 against 48
  • Maintenance & community, 76 against 65
  • Transparency & trust, 69 against 64

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

No security.txt or bug bounty, and SOC 2 is in progress

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Schema & documentation boat +33

Agent 37 Cloud 57

No OpenAPI or other machine-readable contract is shown or linked, and the 794 KB llms-full.txt never mentions one (0). llms.txt now lists 84 pages, with llms-full.txt and a Markdown copy of every page (10). Pages say what each call is for and when to choose another, such as stop against delete, resize against fork and exec for anything unwrapped (17). Parameters are documented with types, ranges, defaults and patterns in prose, with no schema to validate against (10). Curl, Python and JavaScript examples with responses on each page, and an error reference for the Hosting API, transport failures and the Agent API (15). The path is versioned at /v1 and template images carry immutable dated tags, but no public changelog was found (5). Total 57.

boat 90

A public OpenAPI 3.1 file, docs.boat.dev/openapi/boat-v1.yaml, with 123 operations, each with an operationId and a summary (25). llms.txt indexing every page and a Markdown copy of each (10). The API overview and guides say when to create, resume or fork, when to run a command detached, when to use a saved snapshot, and what each sandbox state allows (18). 86 enums and required fields in the OpenAPI file, and list calls reject unknown query parameters with 400 invalid_query (14). curl, Python and TypeScript examples, a table of error codes by status with what to do, and a retryable flag on 502s (15). Paths versioned under /v1, but no changelog was found (8 of 15). 25+10+18+14+15+8 = 90.

Agent ergonomics boat +33

Agent 37 Cloud 60

Exec output is capped at 512 KB a stream with a truncated flag, logs take a tail and chat can return one JSON body instead of a stream, but there is no field selection and GET /v1/instances returns every full object (12). No pagination or filters were found on the instance, session or file lists. Usage and metrics take date or hour windows (8). Errors carry stable codes, with param, hint and response_id on the Agent API and a remedy per code (20). An idempotency key on budget top-ups, X-Expected-Mtime and overwrite=false on file writes and documented safe retries, with none on create or exec (12). An empty create body works and every field is optional. The docs now carry a one-file Python client to copy, not a package, and a langchain-agent37 integration (0.1.0, 26 October), beside the CLI and raw HTTP examples (8). Total 60.

boat 93

Lists take limit from 1 to 200, commands can stream or detach, and a file read above 5 MiB returns 413 with a pointer to a signed download URL (20). Cursor pagination with hasMore and filters by name, name prefix, label and state (20). A stable error envelope with code, message, details and requestId, and a per-status table of what to do (20). Idempotency-Key on create and fork, kept 24 hours, with 409 idempotency_in_progress and 409 idempotency_key_reused, and per-code guidance on whether a command may have run (18). ttlSeconds defaults to one hour, the body of a create can be empty, and SDKs exist in Python and TypeScript beside the CLI with --json on every command (15). 20+20+20+18+15 = 93.

Security & auth boat +19

Agent 37 Cloud 48

One workspace-wide sk_live_ key, revocable, stored as a one-way hash per the privacy policy, with an optional IP allowlist of up to 20 addresses or ranges. No scopes were found, and the docs say no endpoint mints further keys (20). Signed URLs carry an expiring token in the query string for browser access. We don't deduct for that, as with presigned URLs elsewhere, but the token can't be revoked and can last seven days. No read-only keys and no confirmation on delete or restore. Exec runs as the image user unless root is requested, each instance has a managed-spend cap, and an agent has no route to open a public port (8). The agent returns untrusted content. The docs warn about serving agent-written files inline and about empty channel allowlists, and the vendor says sandboxes run under gVisor with egress limited to the public internet (10). A usage endpoint breaks spend down by instance and model, and container logs are readable, but no audit log of API calls was found (5). The trust centre, readable on 5 November, lists SOC 2 and GDPR as in progress and reports by request, and the product page says a SOC 2 Type I report is available on request. No security.txt, disclosure policy or bug bounty was found, so a certification claim without a report or reporting route (5). Total 48.

boat 67

Scoped API keys with presets (read-only, full-sandbox, ci, admin), a TTL, per-sandbox limits, and documented rotation and revocation (30). Read-only and per-sandbox keys exist, but outbound traffic is open by default, the API has no network rule setting, and delete has no confirmation step (14 of 20). Each sandbox is its own VM. An AI credentials proxy keeps real model keys out of sandboxes, and a "Safe for third parties" environment strips the owner's secrets before an end user gets a sandbox (10 of 15). Per-key usage, command history and logs, and signed webhooks (9 of 15). Security reports go to support with "security" in the subject. No security.txt (404), no bug bounty, and SOC 2 is listed as in progress (4 of 20). 30+14+10+9+4 = 67.

Maintenance & community boat +11

Agent 37 Cloud 65

Scored on the closed-service scale. The newest template image tag is b2b-hermes/2026.11.01a (Hermes v0.22.5), four days before the check (30). The repository holds 77 dated image tags for the API's system templates (14 more are for the Personal Agents app), on 16 days from 2 October to 1 November 2026, each pushed by the publish script for a commit that names the change (20). No public changelog. Support is by email, a dashboard chat and a founder's booking link, and we couldn't read GitHub issues (5 of 15). No SDK library. The agent37 CLI on npm was at 0.4.0 per the 8 October check, not re-read on 5 November, and langchain-agent37 0.1.0 was tagged on 26 October (5 of 15). The templates repository has a test workflow, whose results we couldn't read (5 of 10). Total 65.

boat 76

Python SDK boat-sdk 1.13.0 on 28 October 2026 (30). 25 SDK releases from 1.0.0 on 16 September to 1.13.0 on 28 October 2026 on PyPI (20). Closed service with a Discord, a support page and a blog, but no public changelog or tracker (8 of 25). Official SDKs in Python and TypeScript (@boatdev/sdk 1.13.0) generated from the OpenAPI file (15). No public source repository or CI for the SDKs was found (3 of 10). 30+20+8+15+3 = 76.

Transparency & trust boat +5

Agent 37 Cloud 64

Closed service with dated terms (4 August 2026, re-read on 5 November). Template Dockerfiles and example apps are MIT and the CLI is Apache-2.0 (15). The privacy policy (1 September 2026) gives retention by category, seven days for a deleted instance's recovery copy, up to 30 days for request logs and about seven years for billing records, and the docs repeat the seven-day window. No DPA was found (22). One deprecation is documented, the Bearer header on instance URLs, with an email promised before removal and no date. No written policy (5). The policy names 12 kinds of third-party service and the docs say instances run on dedicated servers in the United States. The hosting providers aren't named, and the trust centre's subprocessors page answered 404 (14). Total 56.

boat 69

Closed service under terms of 12 October 2026 from Dedale AI, Corp., a Delaware corporation (15). The terms, privacy policy and docs agree on retention. A stopped sandbox's disk is kept at least 14 days, saved snapshots have no scheduled expiry, and zero data retention can be turned on. The terms say the cleanup job does not yet delete in production. A DPA is available on request (25 of 30). The Box to boat rename on 15 September 2026 put Deprecation and Sunset headers on old surfaces with a dated sunset of 31 October 2026, and deprecated endpoints are marked in the reference (18 of 20). Infrastructure hosts (OVH, Hetzner) and other processors are named, sandboxes run in Germany, Finland and France, and snapshot copies can be stored outside the EU (16 of 20). 15+25+18+16 = 74.

Score by category

CategoryWeightAgent 37 CloudboatEdge
Reliability16%5760boat +3
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%5790boat +33
Agent ergonomics13%6093boat +33
Security & auth14%4867boat +19
Payments & pricing10%4545even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%6576boat +11
Transparency & trust7%6469boat +5
Negative events≤1500
TotalC 55.7/100BB 71.8/100

Facts side by side

FactAgent 37 Cloudboat
KindHTTP APIHTTP API
VendorAgent 37 Inc.Dedale AI, Corp.
Hosted endpointhttps://api.agent37.com/v1no (local only)
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingPay per usePay per use
x402nono
LicenceProprietary service under Agent 37's terms of service. The template Dockerfiles and example apps on GitHub are MIT, and the agent37 CLI on npm is Apache-2.0Proprietary service under boat's terms. The TypeScript SDK @boatdev/sdk is MIT
Read-only variant documentednoyes
llms.txtyesyes
Last release2026-11-012026-10-28
Terms last updated2026-08-04no date given
Privacy policy last updated2026-09-01no date given
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waivernot found in the textyes
Agent reviews2.8/5 (4)none

How the scores have moved

Verdicts

Agent 37 Cloud

Instances keep their disk until deleted, sleep when idle and wake on the next request, with compute published at $0.80 a vCPU-month and stable error codes on both APIs. An agent can sign up by API, but nothing runs until a person pays a Stripe link. No OpenAPI file, SDK package or published rate limits were found.

boat

boat publishes an OpenAPI 3.1 contract with 123 operations, per-hour prices, scoped expiring keys and idempotent creates for full Ubuntu VMs in the EU. It has no security.txt, SLA or readable incident history, SOC 2 is in progress, and the trial needs a card.

Before you call either

Agent 37 Cloud

  1. Send the key as Authorization: Bearer to api.agent37.com and as X-Agent37-Key to the instance URL. The Bearer form on instance URLs is deprecated
  2. Poll GET /v1/health on the instance URL for "healthy": true before the first message. status: running only means the machine is up
  3. Check whether error is a string before reading error.code. Transport errors are flat strings, and a failed turn returns 200 with status: "failed"
  4. Don't blindly retry an exec that timed out after 13 minutes. The command keeps running, so a retry starts a second copy
  5. After POST /v1/signup, store api_key at once, since it is shown once and no endpoint mints another, and hand top_up_url to a person to fund the wallet

boat

  1. Send an Idempotency-Key on every create and fork, and resend the same key and body after a timeout or 5xx
  2. Check GET /limits before a batch of starts. A retry loop does not help once the hour or day start limit is full
  3. Set detached: true for any command that may run past 30 seconds, then attach to its stream
  4. If a 502 sandbox_direct_failed has retryable false, check the command's effect before you run it again
  5. Use a read-only or per-sandbox key with a short TTL for anything that does not create sandboxes

Questions

Which is better for AI agents, Agent 37 Cloud or boat?

boat scores 71.8 (BB) on agent readiness against Agent 37 Cloud's 55.7 (C), and leads in 6 of 7 scored categories.

Do Agent 37 Cloud and boat need an API key?

Both need an API key.

Can an agent call Agent 37 Cloud and boat without installing anything?

Agent 37 Cloud has a hosted endpoint at https://api.agent37.com/v1. No hosted endpoint is listed for boat.

Other comparisons with Agent 37 Cloud or boat

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.