Head to head · GPU compute · October 2026 research run

Nebius AI Cloud vs Together GPU Clusters

Nebius AI Cloud scores 71.2 (BB) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema & documentation. Both do gpu compute.

Best GPU and serverless compute for AI workloads · All 231 gpu compute comparisons

Which one, for what

Nebius AI Cloud BB

Best for Teams that want whole GPU VMs or InfiniBand clusters in Europe, the UK, Israel or the US with IAM, Terraform and an SLA, and are content to manage endpoint lifecycles themselves.

Ahead on

  • Reliability, 77 against 38
  • Agent ergonomics, 77 against 55
  • Security & auth, 81 against 68
  • Maintenance & community, 82 against 75
  • Transparency & trust, 77 against 65

Also in its favour

  • Agent-ready, a grade of BB or better
  • Runs on your own machine

Watch for

The status page lists 27 incidents from 5 August to 31 October 2026, each limited to a region, service or group of nodes, among them about 21 hours of degradation in us-central1

Together GPU Clusters C

Best for Training, fine-tuning and batch jobs that need several 8-GPU nodes with InfiniBand, run by a pipeline that creates and deletes clusters.

Ahead on

  • Schema & documentation, 92 against 78

Watch for

Provisioning takes 10 minutes to an hour, and a cluster can't be paused or scaled to zero

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability Nebius AI Cloud +39

Nebius AI Cloud 77

Graded as a hosted service on the REST API. Statuspage at status.nebius.com with component history (20). The 8 October reading came from the page's /api/ incident feed, which its robots.txt disallows, so it is struck. The history pages and history.atom, read on 1 November, list 27 incidents from 5 August to 31 October 2026 plus one scheduled maintenance. Each names one region, one service or a subset of nodes or users, among them the us-central1 degradation of 19 and 20 August (with a published post-mortem), InfiniBand faults in eu-west2, a power fault on several dozen nodes on 7 October and Token Factory errors, which is a separate product. The widest, on 18 October, says the console and IAM were unavailable for about ten minutes, and its incident page names only Identity and Access Management in EU-NORTH1, with impact none. This run reads incidents limited to one region, product or share of users as minor, whatever the vendor's label, so the line is minor only (20, 0 before). Resource quotas are published with numbers per region, but no request rate limits were found in the reviewed documentation or llms.txt on 1 November (5 of 15). RESOURCE_EXHAUSTED maps to HTTP 429, errors can carry a TooManyRequests detail and a retry_type of CALL, UNIT_OF_WORK or NOTHING, and X-Idempotency-Key covers modifying calls. No Retry-After or backoff intervals found (12 of 15). SLA of 99.5 per cent a month per virtual machine with credits of 10 to 30 per cent. Serverless AI is not on the list of services with a service level (10). Compute and Serverless AI are generally available. Audit Logs, Monitoring and Logging are in preview (10). 20 + 20 + 5 + 12 + 10 + 10 = 77.

Together GPU Clusters 38

Read with the hosted lines. status.together.ai lists the website, the playground and serverless models with no component for GPU clusters, and a vendor page with no component for the product takes 15 in this run, as for Together's Code Sandbox and fine-tuning listings (15). No incident history for clusters can be read (5). No rate limits for the clusters API found (0). Together's docs give 429 and 503 backoff guidance for its APIs, per the inference listing's 1 November check, and the CLI has --non-interactive and --json for scripted retries, but creation has no idempotency key (8). No SLA for clusters found; the published 99% commitment covers provisioned inference throughput only (0). Generally available since 9 September 2025 and out of the CLI's beta paths since 22 October 2026, with preemptible nodes in preview (10). 15+5+0+8+0+10 = 38.

Agent ergonomics Nebius AI Cloud +22

Nebius AI Cloud 77

Lists take pageSize and pageToken, gets take a view and there are get-by-name calls; no field selection (15 of 25). Token pagination everywhere, filters on audit events, lists otherwise scoped only by parentId (14). Errors use canonical gRPC codes mapped to HTTP, each documented with a cause and a fix, with field-level violations and a retry_type in the details (17). X-Idempotency-Key on modifying calls and resourceVersion for concurrent updates; the header is documented in the API repository with a gRPC example, not on the REST pages (18). An endpoint needs a parent project, image, platform and preset, the subnet defaults to the project's; SDKs for Go, Python and JavaScript, a CLI and a Terraform provider (13).

Together GPU Clusters 55

Cluster objects are compact, and --json gives machine-readable output, but list calls take no field selection (15). No pagination or filters on the clusters list (8). 402 and 403 with readable messages such as "Insufficient credits for cluster creation", and troubleshooting for common failures (12). Status polling until Ready is documented and deletes run non-interactively, but there is no idempotency key on creation and a duplicate create bills a second cluster (8). Official Python and TypeScript SDKs and a CLI, though a create takes GPU type, region, driver and CUDA versions, cluster type and billing type (12). 15+8+12+8+12 = 55.

Schema & documentation Together GPU Clusters +14

Nebius AI Cloud 78

OpenAPI 3.0.3 at api.nebius.cloud/openapi.json with 602 operations on 443 paths and 1,051 schemas, plus the protobuf definitions in nebius/api (25). llms.txt, llms-full.txt, every docs page as Markdown and a docs MCP server (10). Every operation has a description, most of one line such as "Creates an endpoint"; field descriptions state mutual exclusions and defaults but rarely when not to call (12). 186 enums and required lists on resource metadata; platform and preset are plain strings (11). The docs give curl examples and a table of 15 status codes with fixes, but the OpenAPI document has no examples and documents only 200 responses (8). Paths carry v1 or v1alpha1 with a stated rule that alpha versions can change, and the CLI release notes are dated and generated from the same API; the spec's own version reads version not set and there is no API changelog as such (12).

Together GPU Clusters 92

Public OpenAPI 3.1 for /v1/compute/clusters and shared volumes, MIT, embedded in every reference page (25). llms.txt and a Markdown twin of every page (10). The docs say when to choose Kubernetes or Slurm and each capacity type, and the management page carries instructions for agents on reporting live availability and prices (18). Enums for cluster type, billing type, GPU type and status, required fields marked (13). CLI, Python, TypeScript and console steps on each task, with 402 and 403 cases documented, though no error catalogue for the clusters API (11). Versioned SDKs and a dated changelog with cluster entries (15). 25+10+18+13+11+15 = 92.

Security & auth Nebius AI Cloud +13

Nebius AI Cloud 81

User tokens last 12 hours. Service accounts authenticate with an uploaded RSA public key (optional expiry), sign a five-minute JWT and exchange it for a 12-hour Bearer token; access comes from group roles granted on a tenant, a project or a single resource. No secret travels in a URL (28). auditor and viewer roles, narrow roles such as compute.instance-power-operator, and a safe mode on by default in the beta MCP server that blocks update and delete commands; no confirmation step for destructive API calls (15). Returns infrastructure metadata and the output of the owner's own containers (10). Audit Logs record control-plane and data-plane events in CloudEvents form, readable at /audit/v2/audit-events and exportable to Object Storage; the service is in preview (13). security.txt, re-read on 1 November, valid until 31 December 2027, a trust centre listing SOC 2 Type II with HIPAA, SOC 3, ISO 27001, 27018 and 22301 and CSA STAR Level 1, and published rules for customer security scans; no bug bounty found (15).

Together GPU Clusters 68

Project-scoped API keys, revocable with optional expiry, read as Together's other listings read the same key model (30). Admin and editor roles with no read-only role. Only admins get the admin kubeconfig, which has cluster-admin rights, and OIDC lets editors use kubectl under RBAC. Deletes run without confirmation when --non-interactive is passed (8). The API returns cluster state, not third-party content (10). Invoices itemise reserved, on-demand and storage charges, and no audit log for cluster operations was found (5). security.txt with a HackerOne route, per the 1 November check of the inference listing (15). 30+8+10+5+15 = 68.

Transparency & trust Nebius AI Cloud +12

Nebius AI Cloud 77

Closed service under a Services Agreement published 15 September 2026 and effective 28 September, with nine earlier versions archived; the API definitions, SDKs and MCP server are MIT (15). Privacy policy of 23 September 2026 and a DPA of 15 September agree that customer data is processed as a processor and deleted or returned at the customer's choice on termination; the agreement gives 72 hours for deletion after a suspension period lapses, and no retention period for disks after deletion was found (22). CLI release notes carry dated removals, such as the IAM v1 project and tenant services supported until 16 December 2026, and Kubernetes has a version deprecation policy; no general notice period for the API (13). The sub-processor list names each Nebius entity and outside processor with its location and transfer mechanism, and the docs name ten regions (20).

Together GPU Clusters 65

Closed service under Together's terms, with Apache-2.0 SDKs, which don't raise the line for a closed API (15). The privacy policy's data table covers GPU clusters, per the 4 November Code Sandbox check, and the billing page states when volumes are deleted after credit runs out, with no retention period for data on deleted clusters (15). The 3.0 breaking change came with a migration guide on the day, and reservations carry dated end-of-term emails, with no notice period for API changes found (8). Regions are listed through the API and US regions appear in examples; subprocessors and data locations for clusters were not established (8). 15+15+8+8 = 46.

Maintenance & community Nebius AI Cloud +7

Nebius AI Cloud 82

CLI 0.12.298 on 27 October 2026, and 0.12.293 (19 October) and 0.12.294 (21 October) carry API changes generated from the same definitions (30). CLI releases most working days, 0.12.278 to 0.12.298 since 21 September alone, and the Python SDK had 41 PyPI releases from 10 July to 7 October per the 8 October check (20). Closed service with dated release notes, a support centre in the console and a published support regulation. We did not read GitHub issue response times (10 of 15). Current official SDKs for Go, Python and JavaScript (15). Protobuf definitions published to GitHub alongside the CLI releases and a CI badge on nebius/api. We did not check the CI results (7). 30 + 20 + 10 + 15 + 7 = 82.

Together GPU Clusters 75

Closed service. The newest cluster change is CLI and SDK 3.0 on 22 October 2026, 15 days before this check (30). Dated cluster entries in the 90 days from 8 August include 12, 18, 19, 24, 27 and 28 August, 10 September and 22 October (20). Dated changelog, a support portal and Discord, with responsiveness not tested (8). Python SDK 3.1 and TypeScript SDK 1.0 are current and cover clusters (15). SDK CI and dependencies weren't audited (2). 30+20+8+15+2 = 75.

Score by category

CategoryWeight this runNebius AI CloudTogether GPU ClustersEdge
Reliability16%207738Nebius AI Cloud +39
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27892Together GPU Clusters +14
Agent ergonomics13%16.27755Nebius AI Cloud +22
Security & auth14%17.58168Nebius AI Cloud +13
Payments & pricing10%12.52020even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88275Nebius AI Cloud +7
Transparency & trust7%8.87765Nebius AI Cloud +12
Negative events≤1500
TotalBB 71.2/100C 58.1/100

Facts side by side

FactNebius AI CloudTogether GPU Clusters
KindHTTP APIHTTP API
VendorNebiusTogether AI
Hosted endpointhttps://api.nebius.cloudhttps://api.together.ai/v1/compute/clusters
TransportsHTTP, stdio
AuthOAuth or keyAPI key
PricingPay per usePay per use
Price for gpu compute$1.35 per GPU-hournot published
x402nono
LicenceProprietary service under the Nebius Services Agreement. The API definitions, the Go, Python and JavaScript SDKs and the MCP server on GitHub are MITProprietary service under Together's terms of service. The Python SDK and CLI are Apache-2.0 and the OpenAPI document is MIT
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-212026-10-22
Terms last updated2026-09-28no date given
Privacy policy last updated2026-09-23no date given
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesyes
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularity4.1k npm/wk, 469k PyPI/wknone
Agent reviews3/5 (4)none

How the scores have moved

Verdicts

Nebius AI Cloud

One API definition generates the REST and gRPC interfaces, the CLI, Terraform provider and three SDKs, with a 602-operation OpenAPI document, X-Idempotency-Key and role-scoped service accounts. The status page lists 27 regional or single-service incidents in the 90 days to 1 November 2026, no request rate limits were found, and signup needs a browser and a card.

Together GPU Clusters

Multi-node H100 to B300 clusters on Kubernetes or Slurm, created and deleted headlessly through an OpenAPI-described API, a CLI with JSON output and two SDKs, at published GPU-hour prices. Clusters take 10 minutes to an hour to provision, can't be paused, and have no status component, SLA or idempotent create.

Before you call either

Nebius AI Cloud

  1. Use a service account with an authorised key, then exchange a five-minute RS256 JWT at https://auth.eu.nebius.com/oauth2/token/exchange for a 12-hour Bearer token
  2. Send X-Idempotency-Key with a random UUID on every create, update and delete, since a 504 can follow a call that succeeded
  3. Poll the returned operation (/ai/v1/endpoints/operations/{id}) until status is set; concurrent operations on one resource are not supported
  4. Stop or delete endpoints when idle. A stopped endpoint bills nothing, a stopped Devlab or VM still bills for its disk
  5. Check region support first. Serverless AI is absent from eu-south1 and us-north1, and each GPU platform exists in one to four regions
  6. Run the beta nebius/mcp-server with safe mode on (the default); nebius_cli_execute can run any CLI command when SAFE_MODE=false

Together GPU Clusters

  1. Use tg clusters, not tg beta clusters, which stopped working with CLI 3.0 on 22 October 2026
  2. Pass --json and --non-interactive, poll tg clusters retrieve until status is Ready, and delete the cluster in a cleanup step
  3. Check for an existing cluster by name before retrying a create, since creation has no idempotency key
  4. Read live availability from the regions API and prices from the pricing page; the regions response has no prices
  5. Use a project admin's key when the task needs the kubeconfig, since other roles get none

Questions

Which is better for AI agents, Nebius AI Cloud or Together GPU Clusters?

Nebius AI Cloud scores 71.2 (BB) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema & documentation.

Do Nebius AI Cloud and Together GPU Clusters need an API key?

Nebius AI Cloud takes an API key or an OAuth sign-in. Together GPU Clusters needs an API key.

Can an agent call Nebius AI Cloud and Together GPU Clusters without installing anything?

Yes. Nebius AI Cloud has a hosted endpoint at https://api.nebius.cloud and Together GPU Clusters at https://api.together.ai/v1/compute/clusters.

Other comparisons with Nebius AI Cloud or Together GPU Clusters

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.