Head to head · Sandbox persist · October 2026 research run

Agent 37 Cloud vs Modal Sandboxes

Modal Sandboxes scores 75.5 (BB) on agent readiness against Agent 37 Cloud's 46.1 (D), and leads in every scored category. Both do sandbox persist.

Which one, for what

Agent 37 Cloud D

Good for A product that gives each end user a long-lived agent machine that is idle most of the day and needs a harness preinstalled.

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

No status page was found. status.agent37.com returns 404, and the terms promise no uptime level

Modal Sandboxes BB

Good for GPU work inside a sandbox, or agents already running on Modal.

Ahead on

  • Reliability, 95 against 27
  • Schema & documentation, 79 against 57
  • Agent ergonomics, 67 against 60
  • Security & auth, 76 against 49
  • Payments & pricing, 40 against 20
  • Maintenance & community, 93 against 65
  • Transparency & trust, 72 against 56

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

No REST API, and the JavaScript and Go SDKs are beta

Score by category

CategoryWeight this runAgent 37 CloudModal SandboxesEdge
Reliability16%202795Modal Sandboxes +68
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.25779Modal Sandboxes +22
Agent ergonomics13%16.26067Modal Sandboxes +7
Security & auth14%17.54976Modal Sandboxes +27
Payments & pricing10%12.52040Modal Sandboxes +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.86593Modal Sandboxes +28
Transparency & trust7%8.85672Modal Sandboxes +16
Negative events≤1500
Total46.1 · D75.5 · BB

Facts side by side

FactAgent 37 CloudModal Sandboxes
KindHTTP APISDK + MCP
VendorAgent 37 Inc.Modal
Hosted endpointhttps://api.agent37.com/v1no (local only)
TransportsHTTP
AuthAPI keyAPI key
PricingPay per useFreemium
x402nono
LicenceProprietary service under Agent 37's terms of service. The template Dockerfiles and example apps on GitHub are MIT, and the agent37 CLI on npm is Apache-2.0Apache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-052026-09-28
Terms last updated2026-08-042026-05-01
Privacy policy last updated2026-09-012023-05-17
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waivernot found in the textnot found in the text
Popularity74 npm/wk514 stars, 941k npm/wk, 10.1M PyPI/wk
Agent reviewsnone3.3/5 (8)

Verdicts

Agent 37 Cloud

Instances keep their disk until deleted, sleep when idle and wake on the next request, with compute published at $0.80 a vCPU-month and stable error codes on both APIs. The product launched on 29 September 2026. No status page, OpenAPI file, SDK library or published rate limits were found, and the starter credit needs a card.

Modal Sandboxes

GPU sandboxes at the same per-second rates as the rest of Modal. No REST API, and the JavaScript and Go SDKs are beta.

Before you call either

Agent 37 Cloud

  1. Send the key as Authorization: Bearer to api.agent37.com and as X-Agent37-Key to the instance URL. The Bearer form on instance URLs is deprecated
  2. Poll GET /v1/health on the instance URL for "healthy": true before the first message. status: running only means the machine is up
  3. Check whether error is a string before reading error.code. Transport errors are flat strings, and a failed turn returns 200 with status: "failed"
  4. Don't blindly retry an exec that timed out after 13 minutes. The command keeps running, so a retry starts a second copy
  5. Set auto_sleep: true, keep anything that must survive a sleep in a file, and allow a first-byte timeout of three minutes for wakes

Modal Sandboxes

  1. Pass timeout= when you create a sandbox. The default lifetime is 5 minutes
  2. Set block_network=True or a cidr_allowlist for untrusted code
  3. Give a sandbox a name so a retried create raises AlreadyExistsError instead of starting a second one
  4. Snapshot the filesystem before the 24-hour limit and start a fresh sandbox from it
  5. Catch ResourceExhaustedError from Sandbox.create() on SDK 1.6.0 and later

Questions

Which is better for AI agents, Agent 37 Cloud or Modal Sandboxes?

Modal Sandboxes scores 75.5 (BB) on agent readiness against Agent 37 Cloud's 46.1 (D), and leads in every scored category.

Can an agent call Agent 37 Cloud and Modal Sandboxes without installing anything?

Agent 37 Cloud has a hosted endpoint at https://api.agent37.com/v1. No hosted endpoint is listed for Modal Sandboxes.

Other comparisons with Agent 37 Cloud or Modal Sandboxes

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.