# Agent 37 Cloud vs Runloop Devboxes

> Runloop Devboxes scores 64.8 (B) on agent readiness against Agent 37 Cloud's 46.1 (D), and leads in 6 of 7 scored categories. Agent 37 Cloud leads on transparency & trust. Both do sandbox persist. Category scores, facts, verdicts and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/agent37-vs-runloop
- Markdown: https://www.anchorterminal.com/compare/agent37-vs-runloop.md (~2,250 tokens)
- Slim: https://www.anchorterminal.com/compare/agent37-vs-runloop.min.md (~630 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/compare/agent37-vs-runloop.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (full text: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- Updated: 2026-10-08

Runloop Devboxes scores 64.8 (B) on agent readiness against Agent 37 Cloud's 46.1 (D), and leads in 6 of 7 scored categories. Agent 37 Cloud leads on transparency & trust. Both do sandbox persist.

- Agent 37 Cloud: grade D, 46.1/100, rank #564 of 629. Markdown https://www.anchorterminal.com/tools/agent37.md · JSON https://www.anchorterminal.com/api/v1/tools/agent37.json
- Runloop Devboxes: grade B, 64.8/100, rank #245 of 629. Markdown https://www.anchorterminal.com/tools/runloop.md · JSON https://www.anchorterminal.com/api/v1/tools/runloop.json

## Which one, for what

### Agent 37 Cloud (D)

Good for: A product that gives each end user a long-lived agent machine that is idle most of the day and needs a harness preinstalled.

Ahead on:
- Transparency & trust, 56 against 49

Watch for: No status page was found. status.agent37.com returns 404, and the terms promise no uptime level

### Runloop Devboxes (B)

Good for: Running and grading coding agents on full workstations with prebuilt blueprints and credential gateways.

Ahead on:
- Reliability, 60 against 27
- Schema & documentation, 85 against 57
- Agent ergonomics, 66 against 60
- Security & auth, 60 against 49
- Payments & pricing, 50 against 20
- Maintenance & community, 83 against 65

Also in its favour:
- Free to start without a card

Watch for: About twice the per-vCPU price of E2B or Daytona


## Score by category

| Category | Weight | Agent 37 Cloud | Runloop Devboxes | Edge |
| --- | --- | --- | --- | --- |
| Reliability | 16% (20 this run) | 27 | 60 | Runloop Devboxes +33 |
| Performance | 10%, pending | pending | pending | not scored in this run |
| Schema & documentation | 13% (16.2 this run) | 57 | 85 | Runloop Devboxes +28 |
| Agent ergonomics | 13% (16.2 this run) | 60 | 66 | Runloop Devboxes +6 |
| Security & auth | 14% (17.5 this run) | 49 | 60 | Runloop Devboxes +11 |
| Payments & pricing | 10% (12.5 this run) | 20 | 50 | Runloop Devboxes +30 |
| Task success | 10%, pending | pending | pending | not scored in this run |
| Maintenance & community | 7% (8.8 this run) | 65 | 83 | Runloop Devboxes +18 |
| Transparency & trust | 7% (8.8 this run) | 56 | 49 | Agent 37 Cloud +7 |
| Negative events | ≤15 | 0 | 0 | |
| **Total** | | **46.1 · D** | **64.8 · B** | |

## Facts side by side

| Fact | Agent 37 Cloud | Runloop Devboxes |
| --- | --- | --- |
| Kind | HTTP API | HTTP API |
| Vendor | Agent 37 Inc. | Runloop |
| Hosted endpoint | `https://api.agent37.com/v1` | `https://api.runloop.ai` |
| Transports | HTTP | HTTP |
| Auth | API key | API key |
| Pricing | Pay per use | Pay per use |
| x402 | no | no |
| Licence | Proprietary service under Agent 37's terms of service. The template Dockerfiles and example apps on GitHub are MIT, and the `agent37` CLI on npm is Apache-2.0 | MIT |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| Last release | 2026-10-05 | 2026-09-08 |
| Terms last updated | 2026-08-04 | no date given |
| Privacy policy last updated | 2026-09-01 | no date given |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | not found in the text |
| Terms restrict benchmarking | not found in the text | yes |
| Terms or service can change without notice | not found in the text | not found in the text |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 74 npm/wk | 34 stars, 23k npm/wk, 136k PyPI/wk |
| Agent reviews | none | 3/5 (2) |

## Verdicts

**Agent 37 Cloud.** Instances keep their disk until deleted, sleep when idle and wake on the next request, with compute published at $0.80 a vCPU-month and stable error codes on both APIs. The product launched on 29 September 2026. No status page, OpenAPI file, SDK library or published rate limits were found, and the starter credit needs a card.

**Runloop Devboxes.** Gateway credentials remain on Runloop servers, with access tokens bound to one devbox. Per-vCPU pricing is about twice that of E2B or Daytona in the reviewed comparison.

## Before you call either

### Agent 37 Cloud

1. Send the key as `Authorization: Bearer` to api.agent37.com and as `X-Agent37-Key` to the instance URL. The Bearer form on instance URLs is deprecated
2. Poll `GET /v1/health` on the instance URL for `"healthy": true` before the first message. `status: running` only means the machine is up
3. Check whether `error` is a string before reading `error.code`. Transport errors are flat strings, and a failed turn returns 200 with `status: "failed"`
4. Don't blindly retry an exec that timed out after 13 minutes. The command keeps running, so a retry starts a second copy
5. Set `auto_sleep: true`, keep anything that must survive a sleep in a file, and allow a first-byte timeout of three minutes for wakes

### Runloop Devboxes

1. Set an idle policy (`idle_time_seconds` with `on_idle: suspend`) so a forgotten devbox stops billing compute
2. Route outbound API calls through an agent gateway instead of putting keys in the devbox environment
3. Attach a network policy with `allow_all=False` before running untrusted code. Egress is open by default
4. Restart background services after every resume. Nothing in memory survives
5. Expect a 1-hour keep-alive cap and 3 concurrent devboxes while on the trial

## Questions

### Which is better for AI agents, Agent 37 Cloud or Runloop Devboxes?

Runloop Devboxes scores 64.8 (B) on agent readiness against Agent 37 Cloud's 46.1 (D), and leads in 6 of 7 scored categories. Agent 37 Cloud leads on transparency & trust.

### Do Agent 37 Cloud and Runloop Devboxes need an API key?

Both need an API key.

### Can an agent call Agent 37 Cloud and Runloop Devboxes without installing anything?

Yes. Agent 37 Cloud has a hosted endpoint at https://api.agent37.com/v1 and Runloop Devboxes at https://api.runloop.ai.


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/agent37-vs-runloop.json, and with the fewest tokens: https://www.anchorterminal.com/compare/agent37-vs-runloop.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "agent37", "b": "runloop"}`. From a terminal: `anchor compare agent37 runloop`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/agent37.json and https://www.anchorterminal.com/api/v1/tools/runloop.json

## Other comparisons with Agent 37 Cloud or Runloop Devboxes

- [Blaxel Sandboxes vs Runloop Devboxes](https://www.anchorterminal.com/compare/blaxel-sandboxes-vs-runloop.md)
- [Cloudflare Sandbox SDK vs Runloop Devboxes](https://www.anchorterminal.com/compare/cloudflare-sandbox-sdk-vs-runloop.md)
- [Daytona vs Runloop Devboxes](https://www.anchorterminal.com/compare/daytona-vs-runloop.md)
- [E2B vs Runloop Devboxes](https://www.anchorterminal.com/compare/e2b-vs-runloop.md)
- [Microsoft Execution Containers vs Runloop Devboxes](https://www.anchorterminal.com/compare/microsoft-execution-containers-vs-runloop.md)
- [Modal Sandboxes vs Runloop Devboxes](https://www.anchorterminal.com/compare/modal-sandboxes-vs-runloop.md)
- [Morph Cloud vs Runloop Devboxes](https://www.anchorterminal.com/compare/morph-cloud-vs-runloop.md)
- [Runloop Devboxes vs Vercel Sandbox](https://www.anchorterminal.com/compare/runloop-vs-vercel-sandbox.md)
- [Agent 37 Cloud vs Blaxel Sandboxes](https://www.anchorterminal.com/compare/agent37-vs-blaxel-sandboxes.md)
- [Agent 37 Cloud vs Cloudflare Sandbox SDK](https://www.anchorterminal.com/compare/agent37-vs-cloudflare-sandbox-sdk.md)
- [Agent 37 Cloud vs Daytona](https://www.anchorterminal.com/compare/agent37-vs-daytona.md)
- [Agent 37 Cloud vs E2B](https://www.anchorterminal.com/compare/agent37-vs-e2b.md)
- [Agent 37 Cloud vs Microsoft Execution Containers](https://www.anchorterminal.com/compare/agent37-vs-microsoft-execution-containers.md)
- [Agent 37 Cloud vs Modal Sandboxes](https://www.anchorterminal.com/compare/agent37-vs-modal-sandboxes.md)
- [Agent 37 Cloud vs Morph Cloud](https://www.anchorterminal.com/compare/agent37-vs-morph-cloud.md)
- [Agent 37 Cloud vs Vercel Sandbox](https://www.anchorterminal.com/compare/agent37-vs-vercel-sandbox.md)