Lambda Cloud vs Runpod

Lambda Cloud

H100 SXM at $3.99 and B200 at $6.69 an hour with per-minute billing. No scale to zero, autoscaling or endpoints; an idle VM bills until terminated.

Runpod

Per-second billing across more than a dozen serverless GPU classes, H100 at $4.79 and A100 80 GB at $2.72 an hour. Data-centre outages of 6 to 24 hours in each of July, August and September 2026.

Lambda Cloud

1. Call GET /instance-types first and read regions_with_capacity_available before trying to launch
2. Space launch calls 12 seconds apart; a sixth in a minute returns 429 with global/rate-limited
3. Branch on the error code, not the message or suggestion, which Lambda says may change
4. List instances before retrying a failed launch, since there's no idempotency key and a retry can start a second machine
5. Terminate the instance in a finally block; billing runs by the minute until you do

Runpod

1. Create a Restricted or Read Only key per endpoint for the agent, not an All key
2. Use REST v2 at api.runpod.io/v2 with a Bearer header; avoid GraphQL, which puts the key in the URL
3. Fetch /run results within 30 minutes and /runsync results within 1 minute, or they're gone
4. Call /retry on a failed job ID rather than submitting a duplicate job
5. Check /health before relying on an endpoint idle for a week, since max workers drop to 0