Niches · GPU & serverless compute
Find GPU capacity at a price and get a machine running
No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.
What counts as done
A list or availability call returns the complete set of has or regions with capacity, the launch call either succeeds or returns a structured capacity error, and the instance becomes SSH-reachable or Ready.
Measured, for our own tests: the set comes from one list or availability call, the launch result within 30 seconds, and the instance is SSH-reachable or Ready within 15 minutes. No docs we read state these figures, so they don't count against a listing here.
How agents ask for it: find me the cheapest available A100 80GB right now
, is an H100 available anywhere, launch one if so
, keep trying until a GPU frees up
Does the job, with a limit 13
It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.
| Listing | Why |
|---|---|
| Beam C Smartshare, Inc. | beam machine list shows live serverless availability and beam pool has lists provider, region, resources and cost with a --max-spend cap; beam machine reserve --yes takes the cheapest offer. No provisioning time or capacity error format is documented. source |
| CoreWeave C CoreWeave, Inc. | The beta Capacity Finder API (POST /v1beta1/capacity/availability:get) ranks zones for spot node pools only, from cached data that neither reserves nor guarantees; on-demand capacity is a quota question with sales. Node pool conditions report Sufficient or partial capacity after the fact. source |
| Crusoe Cloud B Crusoe Technologies LLC | GET /v1/capacities?product_name=a100.8x&location=... reports availability per type and location before a create, and creates return an operation to poll. Requests are HMAC-signed, no idempotency key exists, and the docs say quotas do not guarantee capacity. source |
| GPUsMarket E Tyga.Cloud Ltd | GET /marketplace/search takes gpu, maxPrice and minVram, /gpu/cheapest?vram=24 picks the cheapest, and /gpu/deploy claims about 30 s provisioning. 502 means the host is offline and the agent rents another; completeness of search results is not documented. source |
| Hyperbolic E Hyperbolic Labs, Inc. | GET /v2/on-demand/rentals/options lists rentable configurations and the docs say capacity changes hour to hour; sold-out alerts are email only and personal accounts only. Create has no idempotency key, and an instance can sit pending up to the 3 hour provisioning timeout before auto-termination. source |
| Lambda Cloud C Lambda, Inc. | GET /instance-types returns regions_with_capacity_available and launch fails with the structured code instance-operations/launch/insufficient-capacity. Launch has no idempotency key, 429s arrive after five launches a minute, and users report capacity gone for days with scripting retries the only remedy (acc-30). source |
| Massed Compute E Massed Compute, Inc. | GET /gpu-inventory lists available GPU configurations before launch, and launch returns 402 until credit and auto-recharge are set. No idempotency key, no documented capacity error shape, and no timing for reaching SSH. source |
| Nebius AI Cloud BB Nebius B.V. | list-platforms shows the platforms and presets a project can use and X-Idempotency-Key makes a retried create safe, but there is no capacity count per region, quota overruns fail with QuotaExceeded, and creates return an operation to poll. source |
| Runpod C Runpod, Inc. | List GPU types and data centres return pricing with availability (HIGH to NONE) before a Pod create, and 80 GB cards now arrive in minutes (acc-02). A Pod takes one GPU type so fallback is the caller's loop, and there is no idempotency key. source |
| Thunder Compute D Thunder GPU, Inc. | GET availability and GET /v2/specs list GPU types and current availability before create, and creation fails when a type is sold out. No idempotency key, no capacity error shape documented, and no timing to SSH. source |
| Together GPU Clusters C Together Computer, Inc. | GET /v1/compute/regions lists regions, instance types and driver versions but no prices or capacity counts, create fails with a structured error when credits are short, and there is no idempotency key; Ready arrives in 10 minutes to an hour. source |
| Vast.ai C Vast.ai Inc. | POST /api/v0/bundles filters has by gpu_name, num_gpus, reliability and price, but repeated identical queries returned a random 10 to 30 percent of matching has (acc-24), unknown fields silently dropped the gpu_name filter (acc-26), and a reservation hung at provisioning four times (acc-19). source |
| Verda C DataCrunch Oy | GET /v1/instance-availability lists what each location can launch and POST /v1/instances returns 503 service_unavailable when it cannot, which is a structured capacity error. There is no idempotency key, so a retried launch can start a second billed instance. source |
Doesn't do this job 8
Listings in the category that do something else, with the reason.
| Listing | Why |
|---|---|
| Baseten B Baseten Labs, Inc. | Fixed instance-type catalogue with no availability call, offer search or price comparison; Baseten places replicas across its own multi-cloud capacity. source |
| Cerebrium C Cerebrium Inc. | No availability call or offer search; capacity is a static GPU-by-region table and a preference list of up to five GPU types the platform falls back through. source |
| Cloud Run GPUs B Google LLC | Two GPU types in a fixed region list with a default quota of 3 GPUs a region; no availability call, offer search or price comparison. source |
| Hugging Face Inference Endpoints B Hugging Face, Inc. | Fixed instance tiles per cloud and region, greyed out when unavailable, and a provider list with status; no cross-vendor search, price cap or capacity error for a VM. source |
| Koyeb D Koyeb SAS | Fixed GPU instance types in specific regions with no availability call or price search. source |
| Modal B Modal Labs, Inc. | No availability call or offer search; the agent passes a GPU priority list and Modal schedules on whatever is free, with region selection as the only placement knob. source |
| Northflank C Northflank Ltd | GPU models are a dropdown per region with VRAM and price; no availability call, cross-region search or capacity error is documented. source |
| Replicate Deployments B Replicate, LLC | Hardware is a fixed SKU list chosen per deployment; no availability call, offer search or capacity error. source |
What stops agents finishing
- search endpoint returns a random 10 to 30 percent of matching has, so the cheapest offer is often missing
- provisioning hangs with no error and the deposit is spent on nothing
- sold out for days and no queue or notification, only retrying
- launch has no idempotency key, so a retried call after a timeout starts a second billed machine
- availability claimed in marketing but on-demand refused after sign-up
Around it
Before: gpu-compute.agent-provisioned-compute. After: gpu-compute.training-run, gpu-compute.self-hosted-llm-server, gpu-compute.batch-job.
Where this comes from
Weight 14 of 100 in GPU & serverless compute: 10 of 48 accounts are about getting a machine at all: capacity gone for days, provisioning that hangs, search results that are a random subset, availability that changed between list and launch.
The same as data: /api/v1/use-cases/gpu-compute.find-and-provision.json, or the MCP tool get_use_case with id gpu-compute.find-and-provision. Other jobs in this category: /api/v1/niches?category=gpu-compute.
For companies
Do agents find, use and choose your tools?
An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.