Head to head · GPU compute · October 2026 research run

Together GPU Clusters vs Vast.ai

Together GPU Clusters scores 58.1 (C) on agent readiness against Vast.ai's 56.4 (C), and leads in 2 of 7 scored categories. Vast.ai leads on reliability and maintenance & community. Both do gpu compute.

Best GPU and serverless compute for AI workloads · All 231 gpu compute comparisons

Which one, for what

Together GPU Clusters C

Best for Training, fine-tuning and batch jobs that need several 8-GPU nodes with InfiniBand, run by a pipeline that creates and deletes clusters.

Ahead on

  • Schema & documentation, 92 against 78

Also in its favour

  • No incidents deducted, where Vast.ai loses 3 points for them

Watch for

Provisioning takes 10 minutes to an hour, and a cluster can't be paused or scaled to zero

Vast.ai C

Best for Cost-sensitive training, batch work and self-managed inference where the agent can search listings, set a price cap and tolerate host variance or interruption.

Ahead on

  • Reliability, 50 against 38
  • Maintenance & community, 81 against 75

Watch for

No SLA. The terms say availability is not guaranteed and the service can change without notice

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Schema & documentation Together GPU Clusters +14

Together GPU Clusters 92

Public OpenAPI 3.1 for /v1/compute/clusters and shared volumes, MIT, embedded in every reference page (25). llms.txt and a Markdown twin of every page (10). The docs say when to choose Kubernetes or Slurm and each capacity type, and the management page carries instructions for agents on reporting live availability and prices (18). Enums for cluster type, billing type, GPU type and status, required fields marked (13). CLI, Python, TypeScript and console steps on each task, with 402 and 403 cases documented, though no error catalogue for the clusters API (11). Versioned SDKs and a dated changelog with cluster entries (15). 25+10+18+13+11+15 = 92.

Vast.ai 78

Public OpenAPI 3.1 file with 66 paths and 89 operations, re-read on 2 November, plus the YAML source in the CLI repository (25). llms.txt on both vast.ai and docs.vast.ai, with every docs page served as Markdown (10). Operation descriptions give the matching CLI command and rules such as template precedence, and the SKILL.md files list quirks and common errors, though the API introduction steers most users to the CLI (15 of 20). Request bodies are typed, with 37 enums and required fields marked. Search filters are operator objects and several routes are not REST-shaped, such as PUT /asks/{id}/ to create an instance (10 of 15). Examples on most operations and 400, 401 and 429 responses on most, but the docs say the error body varies by endpoint (11 of 15). Routes are versioned v0 and v1 and the CLI has tagged releases. No API changelog was found in the docs index (7 of 15). 25 + 10 + 15 + 10 + 11 + 7 = 78.

Reliability Vast.ai +12

Together GPU Clusters 38

Read with the hosted lines. status.together.ai lists the website, the playground and serverless models with no component for GPU clusters, and a vendor page with no component for the product takes 15 in this run, as for Together's Code Sandbox and fine-tuning listings (15). No incident history for clusters can be read (5). No rate limits for the clusters API found (0). Together's docs give 429 and 503 backoff guidance for its APIs, per the inference listing's 1 November check, and the CLI has --non-interactive and --json for scripted retries, but creation has no idempotency key (8). No SLA for clusters found; the published 99% commitment covers provisioned inference throughput only (0). Generally available since 9 September 2025 and out of the CLI's beta paths since 22 October 2026, with preemptible nodes in preview (10). 15+5+0+8+0+10 = 38.

Vast.ai 50

Graded as a hosted service. status.vast.ai is Vast.ai's own page with three components (vast, console, serverless) and 30-day bars built from roughly hourly checks, with no incident write-ups (20). The page draws its bars by script from check-log files on the same host. The 8 October count came from those files, the page's own data, which this run doesn't read (as the Docusign and SeaTable listings read their status pages' data feeds), so it's struck, and the window from 4 August to 2 November is unread (5). The page covers Vast.ai's control plane and not the independent hosts' machines. Rate limits are described as a minimum interval per endpoint and identity, re-read on 2 November, but thresholds are unpublished apart from an x-rateLimit value on 2 of 89 operations in the OpenAPI file (5 of 15). 429 is documented with backoff advice and the CLI retries it, but the docs say the API sets no Retry-After header, and there is no idempotency key for instance creation (10 of 15). No SLA found, and the terms say availability is not guaranteed (0). Instances, serverless and the REST API carry no beta label (10). 20 + 5 + 5 + 10 + 0 + 10 = 50.

Maintenance & community Vast.ai +6

Together GPU Clusters 75

Closed service. The newest cluster change is CLI and SDK 3.0 on 22 October 2026, 15 days before this check (30). Dated cluster entries in the 90 days from 8 August include 12, 18, 19, 24, 27 and 28 August, 10 September and 22 October (20). Dated changelog, a support portal and Discord, with responsiveness not tested (8). Python SDK 3.1 and TypeScript SDK 1.0 are current and cover clusters (15). SDK CI and dependencies weren't audited (2). 30+20+8+15+2 = 75.

Vast.ai 81

vastai v1.10.0 was tagged on 30 October 2026 by the repository's publish workflow (30). Thirteen tagged releases between 4 August and 2 November 2026, from v1.5.3 (10 August) to v1.10.0 (30 October) (20). Per the 8 October check, not re-read on 2 November (GitHub's API refuses this session), the repository had 54 open issues and pull requests, 22 of the 30 most recently opened without comments. Vast.ai lists 24/7 chat support and Discord, which we did not test (10 of 25). The CLI and Python SDK are current and ship together. The Claude Code, Codex and Cursor plugins were last changed in June 2026 (15). Three CI workflows cover the installer, publishing and SDK tests. An open issue of 6 September 2026 reports hard-pinned dependencies, and we did not check whether CI passes (6 of 10). 30 + 20 + 10 + 15 + 6 = 81.

Score by category

CategoryWeight this runTogether GPU ClustersVast.aiEdge
Reliability16%203850Vast.ai +12
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.29278Together GPU Clusters +14
Agent ergonomics13%16.25557Vast.ai +2
Security & auth14%17.56870Vast.ai +2
Payments & pricing10%12.52020even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87581Vast.ai +6
Transparency & trust7%8.86564Together GPU Clusters +1
Negative events≤150-3
TotalC 58.1/100C 56.4/100

Facts side by side

FactTogether GPU ClustersVast.ai
KindHTTP APIHTTP API
VendorTogether AIVast.ai Inc.
Hosted endpointhttps://api.together.ai/v1/compute/clustershttps://console.vast.ai/api/v0
TransportsHTTP
AuthAPI keyAPI key
PricingPay per usePay per use
x402nono
LicenceProprietary service under Together's terms of service. The Python SDK and CLI are Apache-2.0 and the OpenAPI document is MITProprietary service under Vast.ai's Terms of Use Agreement. The vastai CLI and Python SDK on GitHub are MIT
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-222026-10-30
Terms last updatedno date given2026-09-01
Privacy policy last updatedno date given2025-06-18
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textyes
Terms restrict benchmarkingyesyes
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textyes
Popularitynone223 stars, 33k PyPI/wk
Agent reviewsnone3/5 (4)

How the scores have moved

Verdicts

Together GPU Clusters

Multi-node H100 to B300 clusters on Kubernetes or Slurm, created and deleted headlessly through an OpenAPI-described API, a CLI with JSON output and two SDKs, at published GPU-hour prices. Clusters take 10 minutes to an hour to provision, can't be paused, and have no status component, SLA or idempotent create.

Vast.ai

API keys can be limited by permission category and by resource ID, the REST API has a public OpenAPI 3.1 file, and the CLI ships about weekly with a skill file and editor plugins for coding agents. Machines belong to independent hosts, prices move with the market, rate-limit thresholds are unpublished, and there is no SLA or free tier.

Before you call either

Together GPU Clusters

  1. Use tg clusters, not tg beta clusters, which stopped working with CLI 3.0 on 22 October 2026
  2. Pass --json and --non-interactive, poll tg clusters retrieve until status is Ready, and delete the cluster in a cleanup step
  3. Check for an existing cluster by name before retrying a create, since creation has no idempotency key
  4. Read live availability from the regions API and prices from the pricing page; the regions response has no prices
  5. Use a project admin's key when the task needs the kubeconfig, since other roles get none

Vast.ai

  1. Create a scoped key with vastai create api-key --permissions for the agent. A default key has full account access, billing and key management included
  2. Pass --raw on every CLI command for JSON output, and -y on vastai destroy instance, which otherwise waits for a confirmation prompt
  3. Register an SSH key with vastai create ssh-key before creating an instance, or the host is unreachable
  4. Destroy instances when finished. A stopped instance still bills storage, and a zero balance without a saved card leads to deletion
  5. Back off on HTTP 429 yourself when calling REST directly. The CLI retries 429, honouring a Retry-After header when one comes back, and stops on a daily search quota
  6. Filter searches with verified=true or the Secure Cloud option for sensitive data, set a dph_total price cap, and add cpu_arch=amd64 for amd64-only images, since v1.10.0 searches arm64 machines too

Questions

Which is better for AI agents, Together GPU Clusters or Vast.ai?

Together GPU Clusters scores 58.1 (C) on agent readiness against Vast.ai's 56.4 (C), and leads in 2 of 7 scored categories. Vast.ai leads on reliability and maintenance & community.

Do Together GPU Clusters and Vast.ai need an API key?

Both need an API key.

Can an agent call Together GPU Clusters and Vast.ai without installing anything?

Yes. Together GPU Clusters has a hosted endpoint at https://api.together.ai/v1/compute/clusters and Vast.ai at https://console.vast.ai/api/v0.

Other comparisons with Together GPU Clusters or Vast.ai

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.