Category · Models & inference

GPU and serverless compute for AI workloads

Clouds that run your own models and jobs on GPUs by the second, as serverless functions, endpoints or rented machines. Compared on GPU types and price per hour, cold starts, scaling and what you have to package.

Best GPU and serverless compute for AI workloads, the shortlist231 head-to-head comparisons

Capability keys compute.gpu · compute.serverless · compute.endpoints · compute.batch · compute.containers · All tools

letme.dev/compute.gpu picks the top-graded tool in this list and says how to call it direct (how letme works).

22listings graded
1agent-ready (BB+)
52desk reviews by the panel
0accept x402
18 Nov 21:29last updated (UTC)
Filters
Grade
Agent rating
Where it runs
Mode
Auth
Pricing
Status
22 tools
Compare#ToolCategoryGradeScoreAgent ratingPrice / x402Details
219 Nebius AI CloudNebius · HTTP API GPU compute BB 72.4 3.0 (4) Pay per use
323 Cloud Run GPUsGoogle Cloud · Platform GPU compute B 69.6 none Pay per use
405 Hugging Face Inference EndpointsHugging Face · HTTP API GPU compute B 67.9 3.0 (4) $0.033 / vCPU-hr
436 Modal SandboxesModal · SDK + MCP Sandboxes B 67.3 3.3 (8) $0.071 / vCPU-hr
453 Replicate DeploymentsReplicate (Cloudflare) · HTTP API GPU compute B 67 3.0 (2) Pay per use
532 BasetenBaseten · HTTP API GPU compute B 65.2 3.5 (2) Pay per use
582 Crusoe CloudCrusoe · HTTP API GPU compute B 64.3 3.3 (4) $0.04 / vCPU-hr
599 ModalModal · Platform GPU compute B 63.9 4.0 (2) $250 / mo
691 CoreWeaveCoreWeave, Inc. · HTTP API GPU compute C 61.8 2.5 (4) Pay per use
800 Together GPU ClustersTogether AI · HTTP API GPU compute C 59.4 none Pay per use
864 Vast.aiVast.ai Inc. · HTTP API GPU compute C 57.6 3.0 (4) Pay per use
873 BeamBeam · Platform GPU compute C 57.4 3.0 (2) $0.045 / vCPU-hr
894 RunpodRunpod · HTTP API GPU compute C 56.9 3.0 (2) Pay per use
920 NorthflankNorthflank · Platform GPU compute C 56.5 3.5 (2) $0.0167 / vCPU-hr
991 VerdaVerda · HTTP API GPU compute C 54.5 3.3 (4) Pay per use
994 CerebriumCerebrium Inc. · Platform GPU compute C 54.4 none $0.0236 / vCPU-hr
1007 Lambda CloudLambda · HTTP API GPU compute C 54.1 3.0 (2) Pay per use
1062 Thunder ComputeThunder Compute · HTTP API GPU compute D 52.5 none $0.04 / vCPU-hr
1196 KoyebKoyeb · Platform GPU compute D 47.8 3.5 (2) $29 / mo
1299 Massed ComputeMassed Compute · HTTP API GPU compute E 43.3 3.3 (4) Pay per use
1331 GPUsMarketTyga.Cloud Ltd · HTTP API GPU compute E 41.5 none $0.50 / tx
1360 HyperbolicHyperbolic Labs, Inc. · HTTP API GPU compute E 39.7 none Pay per use

p95 latency and context cost come from our probes, which haven't run yet, so those columns start hidden. Grades run from AA to F, and agent-ready means BB or better. Filters, sorting and export run in your browser; the table is complete without JavaScript.

Indexed, not reviewed (9)

Listings sorted into this category from public catalogues (the official MCP registry, APIs.guru, the x402 Bazaar and OpenRouter), with facts and our own checks but no score, grade or rank. How the index works.

ListingKindWhat it doesWhy it's here
AI Compute Radar
aicomputeradar.dev
MCP serverWhich open models fit your GPU or Mac, measured. Model momentum, GPU rental prices, weekly pick.vendor's own
AI Video Enhancer Studio
contenta-software.com
MCP serverUpscale, stabilize, denoise and raise the frame rate of videos locally on your NVIDIA GPUvendor's own
AmpleRun GPU rentals
amplerun.com
MCP serverFind, price, rent and stop GPUs on AmpleRun. Paid in USDC or USDT on Base. Flat 5% fee.vendor's own
matrix-compute-mcp
matrix-compute.com
MCP serverP2P GPU matrix multiply, exact cosine search, and PCA/SVD verified via Freivalds' algorithm.vendor's own
Nodegrove VRAM: can I run it?
nodegrove.io
MCP serverCan this LLM run on my GPU? VRAM, speed ceiling and what fits instead, for any model and GPU.vendor's own
prismnetwork.tech MCP server
prismnetwork.tech
MCP serverRent real NVIDIA GPUs from your agent. Browse with no wallet; pay per second onchain.vendor's own
rent.dev
rent.dev
MCP serverLinux sandboxes billed by the second from a prepaid balance, and GPU pods on your own RunPod key.vendor's own
singularis
getsingularis.com
MCP serverUnlimited computation for agents. Results depend on your equipment; GPU optional.vendor's own
VideoRecompress Studio
contenta-software.com
MCP serverShrink video files on your Windows PC with H.265/AV1 and GPU encoding, a whole folder at a timevendor's own

How we test this category

The same model deployed as an endpoint on each platform, called cold and warm, then scaled to zero. We time cold starts, check the scaling and add up the cost per GPU-hour.

How the ranking works

Every tool is scored 0 to 100 across 9 weighted categories, minus deductions for negative events, and given a grade from AA to F. Reliability, latency and context cost are measured by probes and by traffic through letme. Schema quality, security and payments are assessed against a published checklist. Task success comes from a fixed task suite. Payments, including x402, are one category of the nine. Read the methodology.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.