Runpod vs Vast.ai

Runpod

Per-second billing across more than a dozen serverless GPU classes, H100 at $4.79 and A100 80 GB at $2.72 an hour. Data-centre outages of 6 to 24 hours in each of July, August and September 2026.

Vast.ai

API keys can be limited by permission category and by resource ID, the REST API has a public OpenAPI 3.1 file, and the CLI ships weekly with a skill file for coding agents. Machines belong to independent hosts, prices move with the market, rate-limit thresholds are unpublished, and there is no SLA or free tier.

Runpod

1. Create a Restricted or Read Only key per endpoint for the agent, not an All key
2. Use REST v2 at api.runpod.io/v2 with a Bearer header; avoid GraphQL, which puts the key in the URL
3. Fetch /run results within 30 minutes and /runsync results within 1 minute, or they're gone
4. Call /retry on a failed job ID rather than submitting a duplicate job
5. Check /health before relying on an endpoint idle for a week, since max workers drop to 0

Vast.ai

1. Create a scoped key with vastai create api-key --permissions for the agent. A default key has full account access, billing and key management included
2. Pass --raw on every CLI command for JSON output, and -y on vastai destroy instance, which otherwise waits for a confirmation prompt
3. Register an SSH key with vastai create ssh-key before creating an instance, or the host is unreachable
4. Destroy instances when finished. A stopped instance still bills storage, and a zero balance without a saved card leads to deletion
5. Back off on HTTP 429 yourself when calling REST directly. The CLI retries 429 three times from 0.15 seconds
6. Filter searches with verified=true or the Secure Cloud option for sensitive data, and set a dph_total price cap