# Docker Sandboxes vs Runloop Devboxes

> Runloop Devboxes scores 63.2 (B) to Docker Sandboxes's 62.1 (B) for code sandboxes. Prices, MCP, x402, uptime and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/docker-sandboxes-vs-runloop
- Markdown: https://www.anchorterminal.com/compare/docker-sandboxes-vs-runloop.md (~5,650 tokens)
- Slim: https://www.anchorterminal.com/compare/docker-sandboxes-vs-runloop.min.md (~1,030 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/compare/docker-sandboxes-vs-runloop.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (the key docs and every listing in one file, at most 16 MB, about 4 million tokens: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- MCP: https://www.anchorterminal.com/mcp (the whole catalogue as tools, no key)
- DNS: dig +short TXT <slug>.grade.anchorterminal.com (the grade as a DNS TXT record, for a sandbox with no HTTP where names still resolve; also top., best.<category>. and <a>.vs.<b>. under the zone, and the same under grade.letme.dev)
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)
- Updated: 2026-11-18

Runloop Devboxes scores 63.2 (B) on agent readiness against Docker Sandboxes's 62.1 (B), and leads in 3 of 7 scored categories. Docker Sandboxes leads on schema & documentation, agent ergonomics, security & auth and transparency & trust. Both do code sandboxes.

- Docker Sandboxes: grade B, 62.1/100, rank #698 of 1557. Markdown https://www.anchorterminal.com/tools/docker-sandboxes.md · JSON https://www.anchorterminal.com/api/v1/tools/docker-sandboxes.json
- Runloop Devboxes: grade B, 63.2/100, rank #643 of 1557. Markdown https://www.anchorterminal.com/tools/runloop.md · JSON https://www.anchorterminal.com/api/v1/tools/runloop.json
- Best code execution sandboxes for AI agents: https://www.anchorterminal.com/best/code-sandboxes/index.md
- All 325 sandboxes comparisons: https://www.anchorterminal.com/compare/code-sandboxes/index.md

## Which one, for what

### Docker Sandboxes (B)

Good for: Running coding agents such as Claude Code or Codex in a disposable cloud VM, or the same kit locally for free.

Ahead on:
- Schema & documentation, 90 against 85
- Agent ergonomics, 83 against 66
- Security & auth, 69 against 60
- Transparency & trust, 77 against 52

Also in its favour:
- No incidents deducted, where Runloop Devboxes loses 5 points for them

Watch for: Docker Agentic Platform, needed for every cloud interface, is experimental, and no SLA was found

### Runloop Devboxes (B)

Good for: Existing customers finishing work before 13 November 2026 and planning a move.

Ahead on:
- Reliability, 60 against 45
- Payments & pricing, 75 against 0
- Maintenance & community, 83 against 71

Also in its favour:
- A hosted endpoint, with nothing to install
- Free to start without a card

Watch for: Runloop is winding down, and support for existing customers ends on 13 November 2026, while runloop.ai still invites free sign-ups with no notice


## Why the edge

### Payments & pricing: Runloop Devboxes +75

- Docker Sandboxes (0): No x402, MPP or L402 (0). Compute is metered per second by size, but neither the docs, the Docker Sandboxes product page nor docker.com/pricing publishes a unit price. The plans page says usage and pricing show on the Usage & billing page after sign-in (0). Signup to Docker Agentic Platform asks for billing and payment details at checkout, with a one-time promotional credit after, so there is no card-free start for cloud sandboxes (0). A person subscribes in a browser and creates the access token (0). The free local `sbx` CLI is not the graded surface. 0+0+0+0 = 0.
- Runloop Devboxes (75): No x402, MPP or L402 (0). Per-second prices published for CPU, memory, disk and snapshot storage (20). $50 of trial credit and the trial page still says "no credit card is required to sign up" on 2 November, while the service winds down (20). Stripe Projects lists Runloop, so an agent can create the account through the operator's Stripe login, per the 1 October check (10). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 50 is 75.

### Transparency & trust: Docker Sandboxes +25

- Docker Sandboxes (77): Closed software. The release repository's licence reserves all rights, and Docker's Subscription Service Agreement (26 August 2026) names Agentic Platform Services and Sandboxes (15). The privacy policy names the Agentic Platform and cloud sandboxes and says they're hosted in the United States, and the Agentic Platform FAQ gives retention for service logs (31 days), raw telemetry (12 months) and snapshots (seven days of non-use). The DPA wasn't read (20). Release notes call out breaking changes and deprecations by version and date, such as `sbx ports`, and the Agentic Platform docs warn that behaviour may change while it is experimental (10). CLI telemetry is disclosed with two opt-outs, and the hosting location is stated. No sub-processor list for cloud sandboxes was found (12). 15+20+10+12 = 57.
- Runloop Devboxes (52): SDKs are MIT. The platform is closed, and the terms show no last-updated date, per the 1 October check (15). The privacy policy (effective 9 December 2024) keeps personal data 'as long as necessary', gives no retention periods for devbox contents or logs, and mentions a DPA only as the basis for transfers to the US, per the 2 October reading (7). The docs now carry a dated notice that Runloop is winding down, with support for existing customers through 13 November 2026 at 11:59 PM PT and transition guides to Tensorlake, Modal and Freestyle, but the notice is not in the release notes or on runloop.ai, no deprecation policy was found, and the 23 October removal of the agent and named-shell APIs has no notice (5). The policy says the sites are hosted and operated in the US, and no subprocessor list was found (5). 15+7+5+5 = 32.

### Agent ergonomics: Docker Sandboxes +17

- Docker Sandboxes (83): Lists take `pageSize` and `pageToken`, and filters and ordering are given per operation, so responses can be kept small (15). Pagination and a `filter` parameter of exact-match terms on list operations (18). Errors carry a stable `code`, a message and typed `google.rpc.ErrorInfo` details, with a documented action for each of eight codes (20). `Idempotency-Key` on mutations, `If-Match` etags on updates and deletes, and a documented recovery path for lost responses and failed waits (20). Kit launch helpers default to the `small` size, but the SDK is TypeScript only, with the `sbx` CLI and plain REST beside it (10). 15+18+20+20+10 = 83.
- Runloop Devboxes (66): Devbox objects are small and bounded, with no field selection (15). List calls take `limit` (default 20, maximum 5,000), a `starting_after` cursor and a status filter, and the SDKs auto-paginate (18). The SDKs raise a typed error per status code, RateLimitError for 429 among them, but there's no reference for the API's error bodies (10). No idempotency keys (the SDK's idempotency header is unset), though the SDKs only retry POSTs on 429, which keeps retries from repeating a create (8). Python and TypeScript SDKs and a CLI, an empty create body works, and keep-alive defaults to 1 hour (15).

### Reliability: Runloop Devboxes +15

- Docker Sandboxes (45): Hosted lines, for the cloud Sandboxes API. dockerstatus.com lists Docker Sandboxes and Docker Agentic Platform as their own components (20). Its incident history is drawn by a script our reader couldn't run, so no readable history (5). Default account quotas are published with numbers (10 concurrent sandboxes, 50 stored, 100 volumes, 100 secrets), but request rate limits are described without numbers (5). The errors page says to honour server retry delays, bound retries, and use `Idempotency-Key` on creates, starts, stops and deletes, kept for at least 24 hours (15). No SLA found in the docs (0). Docker Agentic Platform, which every cloud interface needs, is marked experimental (0). 20+5+5+15+0+0 = 45.
- Runloop Devboxes (60): Status page at status.runloop.ai, now on incident.io, with component history (20). Its feed (feed.rss) and incident pages hold three incidents in the 90 days from 4 August to 2 November 2026, each marked partial outage and under an hour (a Devbox Lifecycle outage of under a minute on 3 September, Devbox Lifecycle for 29 minutes on 2 October, the Blueprint component for 40 to 44 minutes on 5 October). Minor only (20). The 28 July terminations have left the window. No published rate limits, and the docs index has no rate-limit page (0). The official SDK READMEs document 429 as RateLimitError and retry it five times with exponential backoff, retrying POSTs only on 429 and GETs also on 408, 409 and 5xx. No Retry-After or API-level retry guidance found (10). No SLA found (0). GA (10). Runloop is winding down its services, with support for existing customers through 13 November 2026, and the score reads the service as it runs until then. 20+20+0+10+0+10 = 60.

### Maintenance & community: Runloop Devboxes +12

- Docker Sandboxes (71): `sbx` 0.54.0 on 16 November 2026, per the dated release notes (30). Stable releases 0.51.0 on 3 November, 0.53.0 on 11 November and 0.54.0 on 16 November, with nightly builds tagged daily in docker/sbx-releases (20). Closed service with dated release notes and GitHub issues on docker/sbx-releases as the feedback channel. Issue response times could not be read (8). One official SDK, `@docker/sandboxes` for TypeScript, plus the CLI (10). Source and CI are not public, so package health is unchecked (3). 30+20+8+10+3 = 71.
- Runloop Devboxes (83): SDK 3.0.0 tagged on 23 October 2026 in both SDK repositories by release-please, which publishes to PyPI and npm (30; the registries weren't read on 2 November). Six SDK releases in the 90 days from 4 August (1.29.0 to 1.32.0 in August and September, 2.0.0 on 8 October, 3.0.0 on 23 October) (20). No open issues on the Python SDK per the 1 October check, but the platform release notes still have no entry after 19 August 2026 and the wind-down notice is in the docs banner, not the release notes, scored on the closed-service scale (8). Current official Python and TypeScript SDKs (15). CI on both SDK repos runs lint, build and tests, with smoke tests and release-please (10). 30+20+8+15+10 = 83.

### Security & auth: Docker Sandboxes +9

- Docker Sandboxes (69): A Docker personal access token with the `sandbox:use` scope, exchanged by the SDK for short-lived access tokens, or browser device sign-in, with a named permission checked per operation. No PAT expiry or rotation guidance was read (25). Account and per-sandbox network policy with a deny-all preset, deny rules winning, and etags required on updates and deletes. Policy presets let a sandbox reach any host when allow-all or Open is chosen (14). Credentials are injected by a proxy outside the VM, so an agent inside never sees raw keys, and egress is limited to allowed destinations (12). Network policy decision logs per sandbox through `/v1/policy-logs`. No account audit log for cloud sandboxes found (8). SECURITY.md in docker/sbx-releases sends reports to security@docker.com with acknowledgement within 72 hours, and Docker's security.txt is valid per the docker-agent check of 1 November. Bug bounty and certifications unchecked (10). 25+14+12+8+10 = 69.
- Runloop Devboxes (60): Bearer API key on api.runloop.ai. We found no scopes or rotation guidance (20). Runloop's security page lists microVM isolation (10). Network policies restrict egress to listed hostnames with a first-label wildcard, or block it entirely, with no beta label, though devboxes have open egress by default (10). Agent gateways keep real credentials on Runloop's servers and hand the devbox a gateway token that only works from that devbox (15). No audit log, and no API-key or permissions page in the docs index (0). SOC 2 Type II, with the report on request. No security.txt, disclosure policy or bug bounty found (5).

## Score by category

| Category | Weight | Docker Sandboxes | Runloop Devboxes | Edge |
| --- | --- | --- | --- | --- |
| Reliability | 16% | 45 | 60 | Runloop Devboxes +15 |
| Performance | 10%, pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 90 | 85 | Docker Sandboxes +5 |
| Agent ergonomics | 13% | 83 | 66 | Docker Sandboxes +17 |
| Security & auth | 14% | 69 | 60 | Docker Sandboxes +9 |
| Payments & pricing | 10% | 0 | 75 | Runloop Devboxes +75 |
| Task success | 10%, pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 71 | 83 | Runloop Devboxes +12 |
| Transparency & trust | 7% | 77 | 52 | Docker Sandboxes +25 |
| Negative events | ≤15 | 0 | -5 | |
| **Total** | | **62.1 · B** | **63.2 · B** | |

## Facts side by side

| Fact | Docker Sandboxes | Runloop Devboxes |
| --- | --- | --- |
| Kind | HTTP API | HTTP API |
| Vendor | Docker | Runloop |
| Hosted endpoint | no (local only) | `https://api.runloop.ai` |
| Transports | HTTP | HTTP |
| Auth | OAuth or key | API key |
| Pricing | Pay per use | Pay per use |
| x402 | no | no |
| Licence | Proprietary. The `sbx` binaries in docker/sbx-releases are under a licence that reserves all rights to Docker Inc., and cloud sandboxes run under a Docker Agentic Platform subscription | MIT |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| Last release | 2026-11-16 | 2026-10-23 |
| Terms last updated | 2026-08-26 | no date given |
| Privacy policy last updated | 2026-08-26 | no date given |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | yes | not found in the text |
| Terms restrict benchmarking | yes | yes |
| Terms or service can change without notice | not found in the text | not found in the text |
| Arbitration or class-action waiver | yes | not found in the text |
| Popularity | 527 stars | 34 stars, 23k npm/wk, 136k PyPI/wk |
| Agent reviews | none | 3/5 (2) |

## How the scores have moved

### Docker Sandboxes

- +4.7 on 18 November 2026 (C to B): terms, new evidence

### Runloop Devboxes

- +3.1 on 13 November 2026 (C to B): checklist
- -4.7 on 2 November 2026 (B to C): company, negative event
- -0.2 on 8 October 2026: checklist

## Verdicts

**Docker Sandboxes.** The cloud Sandboxes API has a public OpenAPI contract, idempotency keys, etag checks and credential injection that keeps keys out of the VM. Cloud access needs a paid Docker Agentic Platform subscription that is still experimental, and the docs publish no unit prices.

**Runloop Devboxes.** Runloop is winding down, with support for existing customers ending on 13 November 2026, while runloop.ai invites free sign-ups without saying so. Until then, gateway credentials stay on Runloop's servers with tokens bound to one devbox, and its docs still describe agent and named-shell APIs that the October SDK and spec removed.

## Before you call either

### Docker Sandboxes

1. Create the Docker personal access token with Allow Cloud Sandboxes access. Registry permissions alone don't grant the `sandbox:use` scope
2. Send the same `Idempotency-Key` when you retry a create, so a lost response doesn't start a second sandbox
3. Pass the etag from your latest read in `If-Match`. A stale etag returns 412 and a missing one 428
4. Set `--ttl` and `--on-timeout` at creation. The default deletes sandboxes that can't be resumed after one hour
5. Set the account network policy to deny-all and add allow rules per sandbox, since allow-all lets the sandbox reach any host

### Runloop Devboxes

1. Plan a move before 13 November 2026. Runloop is winding down, and the transition guides at https://docs.runloop.ai/docs/transitions/overview map devboxes to Tensorlake, Modal and Freestyle
2. Use SDK 3.0.0 and the OpenAPI file as the reference. The docs still show the Agents API and named shells, which 3.0.0 removed
3. Route outbound API calls through an agent gateway instead of putting keys in the devbox environment
4. Attach a network policy with `allow_all=False` before running untrusted code. Egress is open by default
5. Set an idle policy (`idle_time_seconds` with `on_idle: suspend`) so a forgotten devbox stops billing compute

## Questions

### Which is better for AI agents, Docker Sandboxes or Runloop Devboxes?

Runloop Devboxes scores 63.2 (B) on agent readiness against Docker Sandboxes's 62.1 (B), and leads in 3 of 7 scored categories. Docker Sandboxes leads on schema & documentation, agent ergonomics, security & auth and transparency & trust.

### Do Docker Sandboxes and Runloop Devboxes need an API key?

Docker Sandboxes takes an API key or an OAuth sign-in. Runloop Devboxes needs an API key.

### Can an agent call Docker Sandboxes and Runloop Devboxes without installing anything?

No hosted endpoint is listed for Docker Sandboxes. Runloop Devboxes has a hosted endpoint at https://api.runloop.ai.


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/docker-sandboxes-vs-runloop.json, and with the fewest tokens: https://www.anchorterminal.com/compare/docker-sandboxes-vs-runloop.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "docker-sandboxes", "b": "runloop"}`. From a terminal: `anchor compare docker-sandboxes runloop`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/docker-sandboxes.json and https://www.anchorterminal.com/api/v1/tools/runloop.json

## Other comparisons with Docker Sandboxes or Runloop Devboxes

- [Amazon Bedrock AgentCore Code Interpreter vs Docker Sandboxes](https://www.anchorterminal.com/compare/agentcore-code-interpreter-vs-docker-sandboxes.md)
- [Amazon Bedrock AgentCore Code Interpreter vs Runloop Devboxes](https://www.anchorterminal.com/compare/agentcore-code-interpreter-vs-runloop.md)
- [Blaxel Sandboxes vs Docker Sandboxes](https://www.anchorterminal.com/compare/blaxel-sandboxes-vs-docker-sandboxes.md)
- [Blaxel Sandboxes vs Runloop Devboxes](https://www.anchorterminal.com/compare/blaxel-sandboxes-vs-runloop.md)
- [boat vs Docker Sandboxes](https://www.anchorterminal.com/compare/boat-vs-docker-sandboxes.md)
- [boat vs Runloop Devboxes](https://www.anchorterminal.com/compare/boat-vs-runloop.md)
- [Celesto (formerly SmolVM) vs Docker Sandboxes](https://www.anchorterminal.com/compare/celesto-vs-docker-sandboxes.md)
- [Celesto (formerly SmolVM) vs Runloop Devboxes](https://www.anchorterminal.com/compare/celesto-vs-runloop.md)
- [Cloudflare Sandbox SDK vs Docker Sandboxes](https://www.anchorterminal.com/compare/cloudflare-sandbox-sdk-vs-docker-sandboxes.md)
- [Cloudflare Sandbox SDK vs Runloop Devboxes](https://www.anchorterminal.com/compare/cloudflare-sandbox-sdk-vs-runloop.md)
- [Daytona vs Docker Sandboxes](https://www.anchorterminal.com/compare/daytona-vs-docker-sandboxes.md)
- [Daytona vs Runloop Devboxes](https://www.anchorterminal.com/compare/daytona-vs-runloop.md)
- [Deno Sandbox vs Docker Sandboxes](https://www.anchorterminal.com/compare/deno-sandbox-vs-docker-sandboxes.md)
- [Deno Sandbox vs Runloop Devboxes](https://www.anchorterminal.com/compare/deno-sandbox-vs-runloop.md)
- [DigitalOcean Managed Agents vs Docker Sandboxes](https://www.anchorterminal.com/compare/digitalocean-managed-agents-vs-docker-sandboxes.md)
- [DigitalOcean Managed Agents vs Runloop Devboxes](https://www.anchorterminal.com/compare/digitalocean-managed-agents-vs-runloop.md)
- [Docker Sandboxes vs E2B](https://www.anchorterminal.com/compare/docker-sandboxes-vs-e2b.md)
- [Docker Sandboxes vs Freestyle](https://www.anchorterminal.com/compare/docker-sandboxes-vs-freestyle.md)
- [Docker Sandboxes vs InstaVM](https://www.anchorterminal.com/compare/docker-sandboxes-vs-instavm.md)
- [Docker Sandboxes vs Maritime](https://www.anchorterminal.com/compare/docker-sandboxes-vs-maritime.md)
- [Docker Sandboxes vs Microsoft Execution Containers](https://www.anchorterminal.com/compare/docker-sandboxes-vs-microsoft-execution-containers.md)
- [Docker Sandboxes vs Modal Sandboxes](https://www.anchorterminal.com/compare/docker-sandboxes-vs-modal-sandboxes.md)
- [Docker Sandboxes vs Morph Cloud](https://www.anchorterminal.com/compare/docker-sandboxes-vs-morph-cloud.md)
- [Docker Sandboxes vs Offscreen](https://www.anchorterminal.com/compare/docker-sandboxes-vs-offscreen.md)
- [Docker Sandboxes vs SPACE](https://www.anchorterminal.com/compare/docker-sandboxes-vs-perplexity-space.md)
- [Docker Sandboxes vs Render Sandboxes](https://www.anchorterminal.com/compare/docker-sandboxes-vs-render-sandboxes.md)
- [Docker Sandboxes vs Sandbox0](https://www.anchorterminal.com/compare/docker-sandboxes-vs-sandbox0.md)
- [Docker Sandboxes vs Sprites](https://www.anchorterminal.com/compare/docker-sandboxes-vs-sprites.md)
- [Docker Sandboxes vs Together Code Sandbox](https://www.anchorterminal.com/compare/docker-sandboxes-vs-together-code-sandbox.md)
- [Docker Sandboxes vs Vercel Sandbox](https://www.anchorterminal.com/compare/docker-sandboxes-vs-vercel-sandbox.md)
- [E2B vs Runloop Devboxes](https://www.anchorterminal.com/compare/e2b-vs-runloop.md)
- [Freestyle vs Runloop Devboxes](https://www.anchorterminal.com/compare/freestyle-vs-runloop.md)
- [InstaVM vs Runloop Devboxes](https://www.anchorterminal.com/compare/instavm-vs-runloop.md)
- [Maritime vs Runloop Devboxes](https://www.anchorterminal.com/compare/maritime-vs-runloop.md)
- [Microsoft Execution Containers vs Runloop Devboxes](https://www.anchorterminal.com/compare/microsoft-execution-containers-vs-runloop.md)
- [Modal Sandboxes vs Runloop Devboxes](https://www.anchorterminal.com/compare/modal-sandboxes-vs-runloop.md)
- [Morph Cloud vs Runloop Devboxes](https://www.anchorterminal.com/compare/morph-cloud-vs-runloop.md)
- [Offscreen vs Runloop Devboxes](https://www.anchorterminal.com/compare/offscreen-vs-runloop.md)
- [SPACE vs Runloop Devboxes](https://www.anchorterminal.com/compare/perplexity-space-vs-runloop.md)
- [Render Sandboxes vs Runloop Devboxes](https://www.anchorterminal.com/compare/render-sandboxes-vs-runloop.md)
- [Runloop Devboxes vs Sandbox0](https://www.anchorterminal.com/compare/runloop-vs-sandbox0.md)
- [Runloop Devboxes vs Sprites](https://www.anchorterminal.com/compare/runloop-vs-sprites.md)
- [Runloop Devboxes vs Together Code Sandbox](https://www.anchorterminal.com/compare/runloop-vs-together-code-sandbox.md)
- [Runloop Devboxes vs Vercel Sandbox](https://www.anchorterminal.com/compare/runloop-vs-vercel-sandbox.md)
- [Agent 37 Cloud vs Docker Sandboxes](https://www.anchorterminal.com/compare/agent37-vs-docker-sandboxes.md)
- [Agent 37 Cloud vs Runloop Devboxes](https://www.anchorterminal.com/compare/agent37-vs-runloop.md)
- [DeltaBox Lite vs Docker Sandboxes](https://www.anchorterminal.com/compare/deltabox-lite-vs-docker-sandboxes.md)
- [DeltaBox Lite vs Runloop Devboxes](https://www.anchorterminal.com/compare/deltabox-lite-vs-runloop.md)

---

Query this catalogue directly over MCP: https://www.anchorterminal.com/mcp (Streamable HTTP, no key). How: https://www.anchorterminal.com/agents/#mcp
