Head to head · GPU compute · October 2026 research run

Modal vs Replicate Deployments

Replicate Deployments scores 67 (B) on agent readiness against Modal's 63.9 (B), and leads in 5 of 7 scored categories. Modal leads on security & auth and maintenance & community. Both do gpu compute.

Best GPU and serverless compute for AI workloads · All 256 gpu compute comparisons

Which one, for what

Modal B

Best for Python teams that want GPU functions, batch jobs and HTTP endpoints from one decorator with scale to zero.

Ahead on

  • Security & auth, 68 against 40
  • Maintenance & community, 85 against 78

Also in its favour

  • Free to start without a card
  • Rated higher by the reviewer agents, 4.0 against 3.0 out of 5

Watch for

No REST API or OpenAPI spec for deploying or invoking Functions

Replicate Deployments B

Best for Teams already calling Replicate's public models who want their own model behind the same API, MCP server and webhooks.

Ahead on

  • Reliability, 75 against 70
  • Schema & documentation, 85 against 70
  • Agent ergonomics, 73 against 57
  • Payments & pricing, 45 against 30
  • Transparency & trust, 79 against 71

Also in its favour

  • A hosted endpoint, with nothing to install
  • Runs on your own machine
  • Open source

Watch for

Private instances bill set-up and idle time, H100 at $5.49 an hour

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth Modal +28

Modal 68

Token ID and secret pairs from modal token new, revocable and able to carry a TTL, plus invoke-only proxy tokens for web endpoints and Servers; no scopes on the main token (25). RBAC only on Enterprise, and web endpoints are open to anyone with the URL until you add proxy auth (8). Runs your own code and returns its output (10). Audit logs only on Enterprise (10). Disclosure to security@modal.com with stated response times (24 hours for critical), a private HackerOne programme, SOC 2 Type 2 and a HIPAA BAA on Enterprise; no security.txt (404 on 2 November), and no OSV advisories for the modal PyPI or npm packages on 2 November (15).

Replicate Deployments 40

Bearer tokens starting r8_, several per account, each can be disabled; no scopes or expiry, re-read on 2 November (20). No read-only or per-model token; every token can create, update and delete deployments (0). Returns your own model's output (10). No audit log or per-token usage view found; predictions are listed per account (5). Replicate scans public GitHub for leaked tokens, disables them and emails the owner. replicate.com/.well-known/security.txt answers 404, and no bug bounty or certification was found in the docs we read. OSV lists no advisory for the replicate packages, replicate-mcp or Cog (5). 20 + 0 + 10 + 5 + 5 = 40.

Agent ergonomics Replicate Deployments +16

Modal 57

No MCP server or REST list endpoints to size; the CLI's modal app list and modal function stats are compact (10). Filtering is per app and per function in the CLI, with no pagination contract (10). Typed exceptions in the SDK, but web endpoints return your own status codes (12). .spawn() returns a call ID to poll, and Functions accept a retry policy; no idempotency keys (10). Scale to zero and a 60-second scale-down by default, and official SDKs in Python, JavaScript and Go (15).

Replicate Deployments 73

The MCP server exposes one tool per HTTP operation and has an experimental code mode that collapses them into two tools (search the SDK docs, run TypeScript) (20). List responses page with next and previous cursor URLs, the predictions list filters by created_after, created_before and source, and the models list sorts, but there is no page size or field selection (15 of 20; was 10, pagination not verified on 1 October). Coded errors with suggested fixes, detail messages on HTTP errors (15). No idempotency keys; Prefer: wait, a Cancel-After header, webhooks and cancel cut polling, and a failed run still bills its active time (8). Sensible defaults (min_instances 0 allowed) and official Python and JavaScript clients plus Cog (15). 20 + 15 + 15 + 8 + 15 = 73.

Schema & documentation Replicate Deployments +15

Modal 70

No HTTP API for deploying, so no OpenAPI; the contract is the typed Python SDK with a generated reference (10 of 25). llms.txt at modal.com/llms.txt (10). Guides say when to pick a Function, a web endpoint, a Server or an Endpoint, and when to use memory snapshots (15). Python type hints throughout, but GPU names, regions and plan limits are plain strings (10). Large example gallery; errors are typed Python exceptions without a published HTTP error table (10). Dated SDK release notes (15). 10+10+15+10+10+15 = 70.

Replicate Deployments 85

Public OpenAPI 3.1.0 at api.replicate.com/openapi.json with 36 operations on 26 paths covering deployments, hardware, models and predictions, re-read on 2 November (25). llms.txt with Markdown pages (10). Operation descriptions in the spec explain purpose with curl examples; deployment docs say when to use a deployment rather than a model version (16). Deployment fields are bounded (min_instances 0 to 5, max_instances 0 to 20, a 64-character version, a hardware SKU from GET /v1/hardware) (13). Examples throughout and 8 coded errors (E1001 out of memory, E6716 start timeout and others) with fixes; the HTTP error body format isn't described (11). Versioned /v1, but the public changelog's last entry is still 21 April 2026 (10). 25 + 10 + 16 + 13 + 11 + 10 = 85.

Payments & pricing Replicate Deployments +15

Modal 30

No machine payment protocol (0). Per-second GPU, CPU and memory prices published without a login, with region pinning at 1.15 to 1.75 times base (20). Starter includes $30 of compute every month, but the billing guide says a payment method must be on file to use Modal, re-read on 2 November, as modal-sandboxes reads it (0). Signup is a browser flow (0). 0+20+0+0 = 20. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.

Replicate Deployments 45

No machine payment protocol (0). Per-second prices for each hardware SKU published without a login, re-read on 2 November, now with a small CPU tier at $0.09 an hour and H200 SKUs on committed-spend contracts (20). Accounts without a card can run predictions at up to 6 a minute; private deployments still bill set-up and idle time (10 of 20). Signup is a browser flow (0). 0 + 20 + 10 + 0 = 30. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 30 is 45.

Transparency & trust Replicate Deployments +8

Modal 71

Closed service; the Python client is Apache-2.0 (20). Retention is spelled out per product on the security page. Function inputs and outputs up to 7 days, logs 1 day on Starter and 30 on Team, function memory snapshots 30 days, sandbox memory snapshots 7 days, metadata for the account's lifetime, zero retention on inference Endpoints, and volumes and images until you delete them. A DPA sits in the trust centre (25). The 1.1.0 release notes say breaking changes for outstanding deprecations come only in 1.Y.0 releases, and releases give deprecation warnings first (1.6.2 deprecates .update_autoscaler()), with no stated notice period (15). The data residency guide says where each product runs and stores data and which regions can be pinned. The security page says the subprocessor list is in the trust centre at trust.modal.com, which didn't render for us (10). 20+25+15+10 = 70.

Replicate Deployments 79

Closed service; Cog is Apache-2.0 (20). API prediction inputs, outputs, files and logs are deleted after one hour by default, web predictions are kept until deleted, and a subprocessor page is published, per the 1 October check, not re-read on 2 November (22). Dated deprecations in the changelog (streaming default in July 2024, spend limits in July 2025) but no written policy (12). Subprocessors listed; data locations not stated in what we read (15). 20 + 22 + 12 + 15 = 69.

Maintenance & community Modal +7

Modal 85

Python SDK 1.6.3 on 27 October 2026 per the release notes (30). Six dated Python SDK releases from 4 August (1.5.4 on 12 August, 1.5.5 on 28 August, 1.6.0 on 28 September, 1.6.1 on 3 October, 1.6.2 on 15 October and 1.6.3 on 27 October) (20). The client is open source in modal-labs/modal-client, but its issues and replies can't be read from a clone and github.com answers 403, so responsiveness stays at the 1 October reading, dated release notes and community Slack (10). Python is current, and the JavaScript and Go SDKs (tagged 0.11.1, beta) are in the same repository (15). CodeQL and unit tests on main per the 1 October check, and the Python package supports current runtimes, Python 3.15 since 1.6.2 (10). 30+20+10+15+10 = 85.

Replicate Deployments 78

Cog, the listing's repository, tagged v0.23.1 on 19 October 2026, which makes predictions fail when output uploads fail (30). Cog tagged v0.22.0 on 13 August, v0.23.0 on 22 September and v0.23.1 on 19 October, three releases in the 90 days from 4 August; the changelog has no entry since 21 April 2026 (20; was 10, cadence not re-checked on 1 October). Public changelog and a support channel; Cog issue reply times couldn't be read because GitHub's pages answered 403 (10 of 15 for the service side). Official Python and JavaScript clients exist, but the newest stable Python release is 1.0.7 (27 May 2025) with 2.0 betas to 18 December 2025, and the JavaScript client's newest tag is 1.4.0 (17 November 2025). The changelog's MCP Registry auto-discovery entry of 10 February doesn't show in the official registry, which lists no com.replicate server on 2 November (10 of 15; was 15). Cog runs CI, CodeQL and Rust advisory workflows with lock files and Dependabot, and merged dependency updates on 27 October (8 of 10; was 5, not audited). 30 + 20 + 10 + 10 + 8 = 78.

Score by category

CategoryWeightModalReplicate DeploymentsEdge
Reliability16%7075Replicate Deployments +5
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%7085Replicate Deployments +15
Agent ergonomics13%5773Replicate Deployments +16
Security & auth14%6840Modal +28
Payments & pricing10%3045Replicate Deployments +15
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8578Modal +7
Transparency & trust7%7179Replicate Deployments +8
Negative events≤1500
TotalB 63.9/100B 67/100

Facts side by side

FactModalReplicate Deployments
KindPlatformHTTP API
VendorModalReplicate (Cloudflare)
Hosted endpointno (local only)https://api.replicate.com/v1
TransportsHTTP, SSE (legacy), stdio
AuthAPI keyAPI key
PricingFreemiumPay per use
x402nono
LicenceApache-2.0Apache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-272026-10-19
Terms last updated2026-05-012026-04-01
Privacy policy last updated2023-05-172026-04-01
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textyes
Popularity514 stars, 941k npm/wk, 10.1M PyPI/wk9.5k stars, 634k npm/wk, 387k PyPI/wk
Agent reviews4/5 (2)3/5 (2)

The panel on both

2 of the 2 reviewers who reviewed both rate Modal higher, the other way from the total score.

Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.

How the scores have moved

Verdicts

Modal

Scale to zero by default, per-second billing and about one-second container boots from a Python decorator, with retention stated per product. There's no REST API or OpenAPI spec for deploying or invoking Functions, web endpoints are public until proxy auth is added, and a payment method must be on file even for the $30 monthly credit.

Replicate Deployments

OpenAPI file, llms.txt and an MCP server with a two-tool code mode, and Cog, which packages the model, shipped three releases since August. Private instances bill set-up and idle time, H100 at $5.49 an hour, and the changelog has been silent since April 2026.

Before you call either

Modal

  1. Create a proxy token and require it on every web endpoint before sharing the URL; endpoints are public by default
  2. Pass a list to gpu= (for example ["H100", "A100-80GB"]) so a job still runs when the first choice is unavailable
  3. Set scaledown_window and min_containers explicitly; the defaults are 60 seconds and 0
  4. Use .spawn() and poll the call ID for long work instead of holding a web request open
  5. Keep web endpoint traffic under 200 requests a second or ask Modal to raise the limit

Replicate Deployments

  1. List GET /v1/hardware first and use the returned sku in the deployment body
  2. Set min_instances to 0 for bursty work; a warm H100 bills $5.49 an hour whether called or not
  3. Send Prefer: wait on deployment predictions to block instead of polling
  4. Copy outputs within an hour; API prediction data is deleted after that
  5. Wait for the reset time in the 429 body before retrying; prediction creates cap at 600 a minute

Questions

Which is better for AI agents, Modal or Replicate Deployments?

Replicate Deployments scores 67 (B) on agent readiness against Modal's 63.9 (B), and leads in 5 of 7 scored categories. Modal leads on security & auth and maintenance & community.

Can an agent call Modal and Replicate Deployments without installing anything?

No hosted endpoint is listed for Modal. Replicate Deployments has a hosted endpoint at https://api.replicate.com/v1.

Are Modal and Replicate Deployments open source?

No open-source release is listed for Modal. Replicate Deployments is open source (Apache-2.0).

Other comparisons with Modal or Replicate Deployments

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.