Replicate Deployments vs Runpod

Replicate Deployments

OpenAPI file, llms.txt and an MCP server with a two-tool code mode. Private instances bill set-up and idle time, H100 at $5.49 an hour.

Runpod

Per-second billing across more than a dozen serverless GPU classes, H100 at $4.79 and A100 80 GB at $2.72 an hour. Data-centre outages of 6 to 24 hours in each of July, August and September 2026.

Replicate Deployments

1. List GET /v1/hardware first and use the returned sku in the deployment body
2. Set min_instances to 0 for bursty work; a warm H100 bills $5.49 an hour whether called or not
3. Send Prefer: wait on deployment predictions to block instead of polling
4. Copy outputs within an hour; API prediction data is deleted after that
5. Wait for the reset time in the 429 body before retrying; prediction creates cap at 600 a minute

Runpod

1. Create a Restricted or Read Only key per endpoint for the agent, not an All key
2. Use REST v2 at api.runpod.io/v2 with a Bearer header; avoid GraphQL, which puts the key in the URL
3. Fetch /run results within 30 minutes and /runsync results within 1 minute, or they're gone
4. Call /retry on a failed job ID rather than submitting a duplicate job
5. Check /health before relying on an endpoint idle for a week, since max workers drop to 0