Head to head · Code sandboxes · October 2026 research run

boat vs Freestyle

boat scores 71.8 (BB) on agent readiness against Freestyle's 62.4 (B), and leads in 6 of 7 scored categories. Freestyle leads on payments & pricing. Both do code sandboxes.

Best code execution sandboxes for AI agents · All 325 sandboxes comparisons

Which one, for what

boat BB

Best for Long-lived, full Ubuntu VMs with Docker, a desktop and Chrome for coding agents, evals and products that give each user a sandbox, hosted in the EU.

Ahead on

  • Reliability, 60 against 47
  • Agent ergonomics, 93 against 69
  • Security & auth, 67 against 53
  • Maintenance & community, 76 against 71
  • Transparency & trust, 69 against 44

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

No security.txt or bug bounty, and SOC 2 is in progress

Freestyle B

Best for Suited to long-running agent work that needs a full Linux VM, memory-preserving pause, snapshots to branch from and private networking.

Ahead on

  • Payments & pricing, 68 against 45

Also in its favour

  • A hosted endpoint, with nothing to install
  • Free to start without a card

Watch for

No terms of service or service agreement found on the site, and the privacy policy covers the website only

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Transparency & trust boat +25

boat 69

Closed service under terms of 12 October 2026 from Dedale AI, Corp., a Delaware corporation (15). The terms, privacy policy and docs agree on retention. A stopped sandbox's disk is kept at least 14 days, saved snapshots have no scheduled expiry, and zero data retention can be turned on. The terms say the cleanup job does not yet delete in production. A DPA is available on request (25 of 30). The Box to boat rename on 15 September 2026 put Deprecation and Sunset headers on old surfaces with a dated sunset of 31 October 2026, and deprecated endpoints are marked in the reference (18 of 20). Infrastructure hosts (OVH, Hetzner) and other processors are named, sandboxes run in Germany, Finland and France, and snapshot copies can be stored outside the EU (16 of 20). 15+25+18+16 = 74.

Freestyle 44

The platform is closed. The SDK and CLI are MIT on npm, and no terms of service or service agreement was found on www.freestyle.sh (/terms, /tos and /legal still answer 404 on 4 November), so the terms of use are unclear (8 of 30). The privacy policy, last updated 15 June 2025, covers the website only, and no DPA, retention period or statement on customer VM data was found (3 of 30). The 9 September 2026 changelog deprecates the Git, code execution, web deployment and scheduled trigger APIs, and the OpenAPI file marks every unversioned route deprecated, in both cases without a removal date (6 of 20). The privacy policy names Google Analytics and PostHog for the website. No sub-processor list or data location for VMs was found (3 of 20). 8 + 3 + 6 + 3 = 20.

Agent ergonomics boat +24

boat 93

Lists take limit from 1 to 200, commands can stream or detach, and a file read above 5 MiB returns 413 with a pointer to a signed download URL (20). Cursor pagination with hasMore and filters by name, name prefix, label and state (20). A stable error envelope with code, message, details and requestId, and a per-status table of what to do (20). Idempotency-Key on create and fork, kept 24 hours, with 409 idempotency_in_progress and 409 idempotency_key_reused, and per-code guidance on whether a command may have run (18). ttlSeconds defaults to one hour, the body of a create can be empty, and SDKs exist in Python and TypeScript beside the CLI with --json on every command (15). 20+20+20+18+15 = 93.

Freestyle 69

List calls take limit and offset, file reads take byte ranges, and paused VMs can be read without starting compute. exec-await returns whole stdout and stderr with no documented size control (15 of 25). VM lists filter by state, slug, search, snapshot, VPC and metadata, and snapshot lists by source VM and search (18 of 20). Every error has a stable code in SCREAMING_SNAKE_CASE and a message, and limit errors name the limit reached (18 of 20). No idempotency keys. A slug is unique per account and a repeated create answers 409, and the spec says which failures are safe to retry and warns against retrying an exec that returned VM_NON_RESPONSIVE (10 of 20). A create call needs only firewall, with defaults of 4 vCPU, 8 GiB and 32 GB. The only SDK is TypeScript, shipped with the CLI in one npm package (8 of 15). Per the 8 October check for the OpenAPI lines. The 14 October changelog adds vm.exec() timeouts up to 24 hours on VMs with an updated guest agent and recovery of a running command after a service interruption. 15 + 18 + 18 + 10 + 8 = 69.

Payments & pricing Freestyle +23

boat 45

No x402, MPP or L402 (0). Per-hour prices for each size published without login, from $0.018 an hour for small to $0.20 for xlarge, with overage and start prices (30). The 7-day trial (25 compute hours) needs a card in Stripe Checkout (0). An agent can register itself through the auth.md agent registration protocol or AgentID, but a person has to claim the agent or verify the AgentMail organisation and enter a card before a sandbox can start (15 of 30). 0+30+0+15 = 45.

Freestyle 68

No x402, MPP or L402 found in the docs, the OpenAPI file or the pricing page (0). Per-unit prices are public, $0.04032 a vCPU-hour, $0.0129 a GiB-hour of memory, $0.000086 a GiB-hour of storage and $0.02 a GB of data transfer (20). The Free plan costs $0 with 200 vCPU-hours and 400 GiB-hours of memory a month and needs no card (20). A person has to sign in through a browser first. After that an agent can mint its own key with freestyle tokens create --output json, so 5 of 20 (5). Pricing re-read on 4 November, unchanged. 0 + 20 + 20 + 5 = 45. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 45 is 68.

Security & auth boat +14

boat 67

Scoped API keys with presets (read-only, full-sandbox, ci, admin), a TTL, per-sandbox limits, and documented rotation and revocation (30). Read-only and per-sandbox keys exist, but outbound traffic is open by default, the API has no network rule setting, and delete has no confirmation step (14 of 20). Each sandbox is its own VM. An AI credentials proxy keeps real model keys out of sandboxes, and a "Safe for third parties" environment strips the owner's secrets before an end user gets a sandbox (10 of 15). Per-key usage, command history and logs, and signed webhooks (9 of 15). Security reports go to support with "security" in the subject. No security.txt (404), no bug bounty, and SOC 2 is listed as in progress (4 of 20). 30+14+10+9+4 = 67.

Freestyle 53

Account API keys are named, shown once, listed and revoked from the CLI, with no scopes or expiry found. Identity access tokens are separate, limited to granted VMs and named Linux users and to the exec and terminal routes, and revocable one by one, and since the 14 October changelog they take an expiration time (22 of 30). No documented option carries a secret in a URL query string. A new VM has no inbound or outbound network until firewall rules allow it, and identity tokens cannot create team resources. Deleting a VM takes one call with no confirmation step (14 of 20). Credential injection at the edge puts API keys, Postgres passwords and Git tokens on outbound requests without storing them in the VM, and forward auth keeps session cookies out of the guest (12 of 15). Audit logs are listed for Enterprise only, and the April 2026 changelog describes a logs dashboard (5 of 15). /.well-known/security.txt answers 404, and no disclosure policy, bug bounty, SOC 2 or ISO 27001 statement was found, re-read on 4 November (0 of 20). 22 + 14 + 12 + 5 + 0 = 53.

Reliability boat +13

boat 60

Hosted reading. A status page at status.ascii.dev, linked from the docs, draws its system status and metrics in a script our reader could not run, so component history was not confirmed (15 of 20). No readable incident history (5). Limits published per plan with numbers, from 12 starts a minute and 100 sandboxes at once on the $20 plan to 90 a minute and 2,000 on the $2,000 plan, plus 10,000 requests a minute per IP (15). Every 429 sends Retry-After, RateLimit headers carry the remaining starts, 503s carry retryAfterSeconds, the docs give a backoff example, and create and fork take an Idempotency-Key (15). No SLA found. The docs cite a measured 99.95% sandbox uptime, and the terms disclaim uptime warranties (0). The API is v1 with no beta label (10). 15+5+15+15+0+10 = 60.

Freestyle 47

Graded on the hosted lines. www.freestyle.sh/status is the vendor's own page with three components (Freestyle VMs, API, Dashboard), all operational, last updated 25 October 2026 on 4 November, with no incident list or component history (10 of 20). No readable history (5). Plan limits are published with numbers (10, 40 and 400 concurrent VMs, per-VM and total resource budgets), but no request rate limit for the API was found in the reviewed documentation (5 of 15). The OpenAPI file documents 429 LIMIT_EXCEEDED on VM creation and resize and marks which 409s are safe to retry, per the 8 October check (the file wasn't re-read on 4 November), resumable uploads take retryable chunks, and the SDK's terminal sessions reconnect with exponential backoff and jitter without rerunning a command. No Retry-After header or idempotency keys found. That is safe-retry guidance without idempotency keys, 12 in this run, where 8 was given on 8 October (12 of 15). The pricing page lists a 99.99% SLA for Enterprise with no SLA document published (5 of 10). The API is served under /v5 with no beta label (10). 10 + 5 + 5 + 12 + 5 + 10 = 47.

Maintenance & community boat +5

boat 76

Python SDK boat-sdk 1.13.0 on 28 October 2026 (30). 25 SDK releases from 1.0.0 on 16 September to 1.13.0 on 28 October 2026 on PyPI (20). Closed service with a Discord, a support page and a blog, but no public changelog or tracker (8 of 25). Official SDKs in Python and TypeScript (@boatdev/sdk 1.13.0) generated from the OpenAPI file (15). No public source repository or CI for the SDKs was found (3 of 10). 30+20+8+15+3 = 76.

Freestyle 71

The newest dated change is the 14 October 2026 changelog entry (browser terminals, expiring identity tokens, 24-hour commands, scoped S3 access), 21 days before this check. freestyle 0.2.16 was published to npm on 27 September 2026, per the 8 October check (30). 25 npm versions between 13 August and 27 September 2026 per the 8 October check, and changelog entries on 9 September and 14 October, all inside the 90 days from 6 August. npm couldn't be re-read on 4 November (20). Closed service with a public changelog of four entries in 2026 and a Discord server, whose response times we did not check (8 of 15). One current official SDK, TypeScript, with the CLI in the same package (10 of 15). The package has three dependencies and no repository field, and no public CI was found, per the 8 October check (3 of 10). 30 + 20 + 8 + 10 + 3 = 71.

Score by category

CategoryWeightboatFreestyleEdge
Reliability16%6047boat +13
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%9086boat +4
Agent ergonomics13%9369boat +24
Security & auth14%6753boat +14
Payments & pricing10%4568Freestyle +23
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%7671boat +5
Transparency & trust7%6944boat +25
Negative events≤1500
TotalBB 71.8/100B 62.4/100

Facts side by side

FactboatFreestyle
KindHTTP APIHTTP API
VendorDedale AI, Corp.Freestyle Cloud Inc.
Hosted endpointno (local only)https://api.freestyle.sh/v5
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingPay per useFreemium
x402nono
LicenceProprietary service under boat's terms. The TypeScript SDK @boatdev/sdk is MITProprietary service with no published terms of service found. The freestyle SDK and CLI package on npm is MIT
Read-only variant documentedyesno
llms.txtyesyes
Last release2026-10-282026-09-27
Terms last updatedno date givenno document linked
Privacy policy last updatedno date givenno document linked
Customer content may train modelsnot found in the textnot read yet
Terms restrict automated accessnot found in the textnot read yet
Terms restrict benchmarkingnot found in the textnot read yet
Terms or service can change without noticenot found in the textnot read yet
Arbitration or class-action waiveryesnot read yet
Popularitynone72k npm/wk

How the scores have moved

Verdicts

boat

boat publishes an OpenAPI 3.1 contract with 123 operations, per-hour prices, scoped expiring keys and idempotent creates for full Ubuntu VMs in the EU. It has no security.txt, SLA or readable incident history, SOC 2 is in progress, and the trial needs a card.

Freestyle

A public OpenAPI 3.1 file describes 88 operations with a stable error code on every failure, and per-VM identity tokens keep the team API key away from end users. No terms of service, product privacy policy, request rate limit or incident history was found, and the only SDK is TypeScript.

Before you call either

boat

  1. Send an Idempotency-Key on every create and fork, and resend the same key and body after a timeout or 5xx
  2. Check GET /limits before a batch of starts. A retry loop does not help once the hour or day start limit is full
  3. Set detached: true for any command that may run past 30 seconds, then attach to its stream
  4. If a 502 sandbox_direct_failed has retryable false, check the command's effect before you run it again
  5. Use a read-only or per-sandbox key with a short TTL for anything that does not create sandboxes

Freestyle

  1. Send a firewall object on every POST /v5/vms. It is required, and a VM with no rules has no outbound internet
  2. Ask the owner to run freestyle login in a browser once, then mint a key with freestyle tokens create --output json
  3. Do not retry an exec that answers 409 VM_NON_RESPONSIVE. The command may already have run
  4. Keep exec-await under 300 seconds on older guest agents. The 14 October changelog lets vm.exec() run up to 24 hours on VMs with an updated guest agent
  5. Call the /v5 paths. The unversioned duplicates in the OpenAPI file are marked deprecated

Questions

Which is better for AI agents, boat or Freestyle?

boat scores 71.8 (BB) on agent readiness against Freestyle's 62.4 (B), and leads in 6 of 7 scored categories. Freestyle leads on payments & pricing.

Do boat and Freestyle need an API key?

Both need an API key.

Can an agent call boat and Freestyle without installing anything?

No hosted endpoint is listed for boat. Freestyle has a hosted endpoint at https://api.freestyle.sh/v5.

Other comparisons with boat or Freestyle

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.