Head to head · Compute serverless · October 2026 research run

Cloud Run GPUs vs Vast.ai

Cloud Run GPUs scores 68.4 (B) on agent readiness against Vast.ai's 56.4 (C), and leads in 5 of 7 scored categories. Both do compute serverless.

Best GPU and serverless compute for AI workloads · All 231 gpu compute comparisons

Which one, for what

Cloud Run GPUs B

Best for Serving small and mid-size open models, or batch jobs, from a container that should scale to zero.

Ahead on

  • Reliability, 70 against 50
  • Agent ergonomics, 66 against 57
  • Security & auth, 78 against 70
  • Transparency & trust, 84 against 64

Also in its favour

  • No incidents deducted, where Vast.ai loses 3 points for them

Watch for

One GPU per instance, L4 (24 GB) or RTX PRO 6000 (96 GB) only, so large models don't fit

Vast.ai C

Best for Cost-sensitive training, batch work and self-managed inference where the agent can search listings, set a price cap and tolerate host variance or interruption.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

No SLA. The terms say availability is not guaranteed and the service can change without notice

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability Cloud Run GPUs +20

Cloud Run GPUs 70

Hosted reading. Google Cloud's status page with a JSON incident feed (20). In the 90 days from 8 August 2026 the feed names Cloud Run in three multi-product incidents, a service outage on 20 August (15:40 to 19:20 UTC, 27 products, global and us-west1), a network degradation in us-central1-b on 1 September and a europe-west2 disruption on 20 October. One major (10). Resource limits and GPU quota are published with numbers (3 GPUs a region by default), but no request rate for the Admin API was found on the quotas page (10). Google's client libraries retry with backoff and the Admin API takes etags, while no GPU-specific retry guidance was found (10). An SLA for GPU services, 99.95% with zonal redundancy and 99.5% without (10). GPU services generally available since 7 April 2025 (10). 20+10+10+10+10+10 = 70.

Vast.ai 50

Graded as a hosted service. status.vast.ai is Vast.ai's own page with three components (vast, console, serverless) and 30-day bars built from roughly hourly checks, with no incident write-ups (20). The page draws its bars by script from check-log files on the same host. The 8 October count came from those files, the page's own data, which this run doesn't read (as the Docusign and SeaTable listings read their status pages' data feeds), so it's struck, and the window from 4 August to 2 November is unread (5). The page covers Vast.ai's control plane and not the independent hosts' machines. Rate limits are described as a minimum interval per endpoint and identity, re-read on 2 November, but thresholds are unpublished apart from an x-rateLimit value on 2 of 89 operations in the OpenAPI file (5 of 15). 429 is documented with backoff advice and the CLI retries it, but the docs say the API sets no Retry-After header, and there is no idempotency key for instance creation (10 of 15). No SLA found, and the terms say availability is not guaranteed (0). Instances, serverless and the REST API carry no beta label (10). 20 + 5 + 5 + 10 + 0 + 10 = 50.

Transparency & trust Cloud Run GPUs +20

Cloud Run GPUs 84

Closed service under the Google Cloud terms, with Apache-2.0 client libraries (15). The Cloud Data Processing Addendum and the privacy notice cover customer data, per the Document AI listing's 1 November reading; no Cloud Run statement on GPU instance data after shutdown was found (22). The Cloud terms promise 12 months' notice before a backwards-incompatible API change, and driver versions are announced in the release notes (16). Regions per GPU type listed, with Google's subprocessor list and data-location terms (16). 15+22+16+16 = 69.

Vast.ai 64

A closed service with an MIT CLI and SDK. The Terms of Use Agreement of 1 September 2026, re-read on 2 November, prohibits scripts and automated access to the services without a separate written agreement, which conflicts with the public API and agent tooling (17 of 30). The compliance page says data is destroyed when an instance is deleted, and the DPA allows return or deletion on written notice within 30 days of termination. The privacy policy of 18 June 2025 is written for website users, gives no retention periods, allows targeted advertising and contains an unfilled [INSERT HYPERLINK] placeholder (15 of 30). No deprecation policy was found, and the terms allow changes or discontinuation without notice. v0 and v1 routes coexist (3 of 20). The DPA names five sub-processors without locations and gives new ones only on request. Host location is shown per listing and can be filtered (10 of 20). 17 + 15 + 3 + 10 = 45.

Agent ergonomics Cloud Run GPUs +9

Cloud Run GPUs 66

Platform reading. One gcloud run deploy with --gpu and --gpu-type adds a GPU to a container, and responses carry the service object with fieldMask on updates (15). List calls page with pageSize and pageToken (15). Google's status codes and messages, with quota errors that name the limit (12). Revisions are immutable, traffic can be moved back, and etags guard updates, but no idempotency key on create (12). Client libraries in many languages and gcloud, though a GPU deploy needs instance-based billing, minimum CPU and memory and, past 3 GPUs, a quota request (12). 15+15+12+12+12 = 66.

Vast.ai 57

No MCP server for account actions. The CLI skill file is about 19 KB, --raw returns JSON on every command, and the v1 instances route supports column selection (18 of 25). Search takes filter operators, sort fields and a price cap, and v1 instances use keyset pagination with at most 25 a page (16 of 20). The usual error body has success, error and msg, but some endpoints omit fields and 429 is often plain text (10 of 20). No idempotency keys were found in the OpenAPI file. The CLI retries only 429, and vastai destroy instance asks for confirmation unless -y is passed (5 of 20). Templates supply launch defaults. The only official SDK is Python, and the docs send other languages to raw REST (8 of 15). 18 + 16 + 10 + 5 + 8 = 57.

Security & auth Cloud Run GPUs +8

Cloud Run GPUs 78

OAuth 2.0 tokens from service accounts under IAM. Google's APIs accept access_token as a query parameter, the 10-point deduction other Google API listings take (20). IAM roles separate viewing, deploying and invoking, and services can require IAM authentication for every call (16). The platform runs your own container and returns its output (10). Cloud Audit Logs record Admin API calls, and request logs go to Cloud Logging (15). Google's vulnerability reward programme, security.txt and certifications (17). 20+16+10+15+17 = 78.

Vast.ai 70

Keys can be scoped to 11 permission categories and narrowed by constraints to resource IDs, are shown once, and can be reset or deleted with immediate effect (30). The rate-limit page, re-read on 2 November, names an api_key query parameter as part of a caller's identity while the authentication page shows only the Bearer header. We took 5 of the checklist's 10 points for a key that can travel in a URL, a judgement call because the option is acknowledged but not taught (25 of 30). Read-only categories and per-instance constraints exist. The CLI confirms a destroy, and Vast.ai's auth.md asks agents to confirm paid or destructive actions, but nothing on the server enforces approval and default keys have full access (15 of 20). The service runs the customer's own containers and returns their logs (10). vastai show audit-logs returns account action history. Its retention and fields were not reviewed (10 of 15). A vulnerability disclosure policy dated 23 July 2025, re-read on 2 November, has safe harbour, triage within 5 business days and security@vast.ai. Its bounty is discretionary, which this checklist doesn't count. The compliance page states SOC 2 Type 2 and makes a SOC 3 report available on request. There is no security.txt (404 on 2 November) and no advisories for vastai in OSV, and the security FAQ says individual hosts may have less formal security. A reporting route and SOC 2 with no counted bounty take 10, as Sinch's messaging listing (10 of 20). 25 + 15 + 10 + 10 + 10 = 70.

Score by category

CategoryWeight this runCloud Run GPUsVast.aiEdge
Reliability16%207050Cloud Run GPUs +20
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28178Cloud Run GPUs +3
Agent ergonomics13%16.26657Cloud Run GPUs +9
Security & auth14%17.57870Cloud Run GPUs +8
Payments & pricing10%12.52020even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88081Vast.ai +1
Transparency & trust7%8.88464Cloud Run GPUs +20
Negative events≤150-3
TotalB 68.4/100C 56.4/100

Facts side by side

FactCloud Run GPUsVast.ai
KindPlatformHTTP API
VendorGoogle CloudVast.ai Inc.
Hosted endpointhttps://run.googleapis.comhttps://console.vast.ai/api/v0
TransportsHTTP
AuthOAuthAPI key
PricingPay per usePay per use
x402nono
LicenceProprietary service under the Google Cloud Platform terms. Client libraries are Apache-2.0Proprietary service under Vast.ai's Terms of Use Agreement. The vastai CLI and Python SDK on GitHub are MIT
Read-only variant documentednono
llms.txtnoyes
Last release2026-10-302026-10-30
Terms last updated2026-09-022026-09-01
Privacy policy last updated2026-09-282025-06-18
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textyes
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textyes
Popularitynone223 stars, 33k PyPI/wk
Agent reviewsnone3/5 (4)

How the scores have moved

Verdicts

Cloud Run GPUs

Serverless GPUs on Cloud Run, an L4 or RTX PRO 6000 per instance, billed per second, scaling to zero and starting in about 5 seconds before the model loads, with a published SLA and IAM. One GPU per instance, 3 GPUs of default quota a region and instance-based billing limit it to small and mid-size models.

Vast.ai

API keys can be limited by permission category and by resource ID, the REST API has a public OpenAPI 3.1 file, and the CLI ships about weekly with a skill file and editor plugins for coding agents. Machines belong to independent hosts, prices move with the market, rate-limit thresholds are unpublished, and there is no SLA or free tier.

Before you call either

Cloud Run GPUs

  1. Pass --gpu 1 --gpu-type nvidia-l4 (or nvidia-rtx-pro-6000) with at least 4 vCPU and 16 GiB, and --no-cpu-throttling for instance-based billing
  2. Load model weights from Cloud Storage at startup in parallel; bake them into the image only below about 10 GB
  3. Turn zonal redundancy off for cheaper, more readily granted quota when failover isn't required
  4. Set minimum instances to 0 unless cold starts matter, since minimum instances bill at the full rate
  5. Send OAuth tokens in the Authorization header, never as access_token in the URL

Vast.ai

  1. Create a scoped key with vastai create api-key --permissions for the agent. A default key has full account access, billing and key management included
  2. Pass --raw on every CLI command for JSON output, and -y on vastai destroy instance, which otherwise waits for a confirmation prompt
  3. Register an SSH key with vastai create ssh-key before creating an instance, or the host is unreachable
  4. Destroy instances when finished. A stopped instance still bills storage, and a zero balance without a saved card leads to deletion
  5. Back off on HTTP 429 yourself when calling REST directly. The CLI retries 429, honouring a Retry-After header when one comes back, and stops on a daily search quota
  6. Filter searches with verified=true or the Secure Cloud option for sensitive data, set a dph_total price cap, and add cpu_arch=amd64 for amd64-only images, since v1.10.0 searches arm64 machines too

Questions

Which is better for AI agents, Cloud Run GPUs or Vast.ai?

Cloud Run GPUs scores 68.4 (B) on agent readiness against Vast.ai's 56.4 (C), and leads in 5 of 7 scored categories.

Can an agent call Cloud Run GPUs and Vast.ai without installing anything?

Yes. Cloud Run GPUs has a hosted endpoint at https://run.googleapis.com and Vast.ai at https://console.vast.ai/api/v0.

Other comparisons with Cloud Run GPUs or Vast.ai

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.