{ "data": { "a": { "slug": "baseten", "name": "Baseten", "vendor": "Baseten", "vendorUrl": "https://www.baseten.co", "kind": "http-api", "category": "gpu-compute", "summary": "Dedicated model deployments packaged with the open-source Truss framework and served behind a per-model HTTPS endpoint, with autoscaling from zero replicas, async inference, a management API and per-minute GPU billing from T4 to B200.", "url": "https://www.anchorterminal.com/tools/baseten", "markdownUrl": "https://www.anchorterminal.com/tools/baseten.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/baseten.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/baseten.json", "dns": "baseten.grade.anchorterminal.com", "repo": "https://github.com/basetenlabs/truss", "license": "MIT", "transports": [ "http" ], "remoteUrl": "https://api.baseten.co", "packages": [ { "registry": "pypi", "name": "truss" } ], "auth": "api-key", "authNotes": "API key from the workspace settings, sent as `Authorization: Bearer $BASETEN_API_KEY` (preferred) or the legacy `Authorization: Api-Key` scheme. Keys created from 1 October 2026 carry a `b10_` prefix. Inference goes to model-\u003cid\u003e.api.baseten.co and management calls to api.baseten.co.", "pricing": "usage", "pricingNotes": "Basic is $0 a month, pay as you go; Pro and Enterprise add volume discounts. Dedicated deployments bill per minute of replica time, including start-up and idle, and nothing at zero replicas. T4 16 GiB $0.01052 a minute (about $0.63 an hour), L4 24 GiB $0.01414 ($0.85), A10G 24 GiB $0.02012 ($1.21), H100 MIG 40 GiB $0.0625 ($3.75), A100 80 GiB $0.06667 ($4.00), H100 80 GiB $0.10833 ($6.50), B200 180 GiB $0.16633 ($9.98). New accounts get a small credit to try the UI. Model APIs bill per token instead (https://www.baseten.co/pricing/).", "priceSummary": "Pay per use", "where": "hosted", "x402": { "level": "no", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 1200, "npmWeekly": null, "pypiWeekly": 74496, "asOf": "2026-09-30" }, "docsUrl": "https://docs.baseten.co", "llmsTxt": "https://docs.baseten.co/llms.txt", "openapi": "https://api.baseten.co/v1/spec", "capabilities": [ "compute.gpu", "compute.endpoints", "compute.serverless", "compute.containers" ], "tags": [ "hosted", "usage-priced", "python", "llms-txt", "open-source", "async-jobs", "webhooks", "enterprise" ], "lastRelease": "2026-10-30", "graded": true, "anchor": { "graded": true, "score": 62.7, "grade": "B", "agentReady": false, "rank": 543, "ranked": true, "rankOf": 1510, "categoryRank": 6, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 55, "maintenance": 90, "payments": 40, "reliability": 90, "schema": 84, "security": 82, "transparency": 67 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-01" }, "negative": -11, "negativeNotes": [ "-5: a GitHub personal access token for `basetenbot`, exposed in a public Harbor image since March 2023, gave admin and push access to Baseten's main product repository, the GitOps repository that drives its clusters, its Homebrew tap and per-customer private repositories. Reported on 2026-07-13, revoked on 2026-07-14, no misuse found, published with Baseten's approval in September 2026. Deducted less because the fix was quick and documented (https://www.strix.ai/blog/baseten-harbor-github-pat-takeover)", "-3: on 24 October 2026 Baseten began revoking every API key unused for 30 days, irreversibly, announced in a changelog entry dated the day it took effect; the 1 October docs said keys don't expire. A published behaviour changed for existing clients with notice only on the day (https://www.baseten.co/resources/changelog/revocation-of-unused-api-keys-on-1024/)", "-3: Truss v0.18.26 (18 August 2026) fixed a path traversal in the control server's /control/patch applier (5ae5067f) and v0.18.27 (26 August) a shell injection in generated Dockerfile RUN lines (5ff97175). Both name the flaw, cite no advisory, and OSV lists none for truss; repeats fold into one term (https://github.com/basetenlabs/truss)" ], "verdict": "Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.", "bestFor": "Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.", "strengths": [ "Team API keys scoped to inference-only, metrics-only or a single environment or model, plus a Viewer role since 1 September 2026", "A public SLA of 99.9 per cent monthly for Dedicated Inference and Model APIs, with service credits", "Public OpenAPI spec for the management API at api.baseten.co/v1/spec, and llms.txt with Markdown twins", "Rate limits published per endpoint with a `retry_after` field on 429", "Truss (MIT) keeps the model package portable, with 13 stable releases from 3 August to 29 October 2026" ], "weaknesses": [ "H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed", "API keys unused for 30 days are revoked automatically since 24 October 2026, announced the same day", "A bot token with admin access to the product and GitOps repositories sat exposed from March 2023 until July 2026", "Truss fixed a path traversal and a shell injection in August 2026 with no published advisory", "No pagination on management list endpoints, no idempotency keys, no bug bounty and no security.txt" ], "agentNotes": [ "Create a team key with inference-only permission for calling models and keep full-access keys out of the agent", "Sleep for `retry_after` seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute", "Treat 401 as bad or expired credentials and 403 as missing permission (since 28 October 2026)", "Make a call with each key at least every 30 days, or create a new key before an infrequent job; revoked keys can't be restored", "Set `scale_down_delay` below the 900-second default or every burst bills 15 idle minutes" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 2, "avgRating": 3.5, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "B", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 62.7 } ], "editorialScores": { "ergonomics": 55, "maintenance": 90, "payments": 40, "reliability": 90, "schema": 84, "security": 82, "transparency": 58 }, "provenanceScore": 75, "checked": { "categories": { "ergonomics": "2026-11-01", "maintenance": "2026-11-01", "payments": "2026-11-01", "reliability": "2026-11-01", "schema": "2026-11-01", "security": "2026-11-01", "transparency": "2026-11-01" }, "last": "2026-11-01", "lastMoved": "2026-11-01", "oldest": "2026-11-01", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "pip install truss", "http": "curl -X POST \"https://model-$BASETEN_MODEL_ID.api.baseten.co/environments/production/predict\" \\\n -H \"Authorization: Bearer $BASETEN_API_KEY\" -H \"Content-Type: application/json\" \\\n -d '{\"prompt\":\"Hello, world!\"}'" }, "letme": { "capability": "https://letme.dev/compute.gpu", "tool": "https://letme.dev/baseten" }, "sameCompany": [ "elephant-1", "joey-1", "mammoth-1" ], "area": "models", "unitPrices": [ { "item": "H100 80 GiB", "unit": "gpu-hour", "usd": 6.5, "note": "$0.10833 a minute" }, { "item": "B200 180 GiB", "unit": "gpu-hour", "usd": 9.98, "note": "$0.16633 a minute" }, { "item": "A100 80 GiB", "unit": "gpu-hour", "usd": 4, "note": "$0.06667 a minute" }, { "item": "H100 MIG 40 GiB", "unit": "gpu-hour", "usd": 3.75, "note": "$0.0625 a minute" }, { "item": "A10G 24 GiB", "unit": "gpu-hour", "usd": 1.21, "note": "$0.02012 a minute" }, { "item": "L4 24 GiB", "unit": "gpu-hour", "usd": 0.85, "note": "$0.01414 a minute" }, { "item": "T4 16 GiB", "unit": "gpu-hour", "usd": 0.63, "note": "$0.01052 a minute" } ], "provenance": { "legalEntity": "Baseten Labs, Inc.", "domain": "baseten.co", "domainRegistered": "", "endpointOnVendorDomain": true, "terms": "https://www.baseten.co/terms-and-conditions/", "privacy": "https://www.baseten.co/privacy-policy/", "statusPage": "https://status.baseten.co", "changelog": "https://www.baseten.co/changelog/", "securityTxt": "none", "checked": "2026-09-30", "notes": [ "Terms name Baseten Labs, Inc. under California law with venue in San Francisco. The privacy policy gives 560 Davis St., Suite 250, San Francisco.", "Inference runs on model-\u003cid\u003e.api.baseten.co, a subdomain of the vendor domain.", "www.baseten.co/.well-known/security.txt returns 404.", "The .co registry's RDAP server couldn't be reached, so the registration date is unrecorded." ], "score": 75 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/baseten.json", "live": { "slug": "baseten", "probe": { "target": "https://api.baseten.co", "method": "get", "lastAt": "2026-11-07T19:21:55.124686962Z", "lastOk": true, "lastStatus": 202, "lastMs": 503, "authRequired": false, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 427, "p95ms24h": 492, "samples24h": 238, "samples30d": 7920, "days": [ { "date": "2026-10-07", "probes": 272, "ok": 272 }, { "date": "2026-10-08", "probes": 268, "ok": 268 }, { "date": "2026-10-09", "probes": 250, "ok": 250 }, { "date": "2026-10-10", "probes": 247, "ok": 247 }, { "date": "2026-10-11", "probes": 247, "ok": 247 }, { "date": "2026-10-12", "probes": 247, "ok": 247 }, { "date": "2026-10-13", "probes": 248, "ok": 248 }, { "date": "2026-10-14", "probes": 249, "ok": 249 }, { "date": "2026-10-15", "probes": 253, "ok": 253 }, { "date": "2026-10-16", "probes": 252, "ok": 252 }, { "date": "2026-10-17", "probes": 253, "ok": 253 }, { "date": "2026-10-18", "probes": 256, "ok": 256 }, { "date": "2026-10-19", "probes": 255, "ok": 255 }, { "date": "2026-10-20", "probes": 252, "ok": 252 }, { "date": "2026-10-21", "probes": 253, "ok": 253 }, { "date": "2026-10-22", "probes": 253, "ok": 253 }, { "date": "2026-10-23", "probes": 248, "ok": 248 }, { "date": "2026-10-24", "probes": 251, "ok": 251 }, { "date": "2026-10-25", "probes": 250, "ok": 250 }, { "date": "2026-10-26", "probes": 252, "ok": 252 }, { "date": "2026-10-27", "probes": 249, "ok": 249 }, { "date": "2026-10-28", "probes": 251, "ok": 251 }, { "date": "2026-10-29", "probes": 249, "ok": 249 }, { "date": "2026-10-30", "probes": 248, "ok": 248 }, { "date": "2026-10-31", "probes": 251, "ok": 251 }, { "date": "2026-11-01", "probes": 249, "ok": 249 }, { "date": "2026-11-02", "probes": 250, "ok": 250 }, { "date": "2026-11-03", "probes": 248, "ok": 248 }, { "date": "2026-11-04", "probes": 246, "ok": 246 }, { "date": "2026-11-05", "probes": 185, "ok": 185 }, { "date": "2026-11-06", "probes": 241, "ok": 241 }, { "date": "2026-11-07", "probes": 197, "ok": 197 } ] }, "vendorStatus": { "page": "https://status.baseten.co", "indicator": "none", "summary": "All Systems Operational", "checkedAt": "2026-11-07T19:21:02.281615882Z" }, "versions": [ { "registry": "github", "name": "basetenlabs/truss", "version": "v0.18.38", "released": "2026-11-05", "seenAt": "2026-11-06T23:10:20.295892726Z" }, { "registry": "pypi", "name": "truss", "version": "0.18.38", "released": "2026-11-05", "seenAt": "2026-11-06T23:10:20.092737586Z" } ], "githubStars": 1230, "pypiWeekly": 81644, "securityTxt": { "url": "https://baseten.co/.well-known/security.txt", "state": "none", "checkedAt": "2026-11-07T16:00:23.369616039Z" }, "llmsTxt": { "url": "https://docs.baseten.co/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-11-07T15:31:42.043230756Z" }, "domain": { "domain": "baseten.co", "checkedAt": "2026-11-01T14:12:35.920231191Z" }, "pages": [ { "url": "https://www.baseten.co/changelog/", "kind": "changelog", "status": 200, "checkedAt": "2026-11-07T14:25:24.768972384Z", "changedAt": "2026-11-04T08:37:41.945283228Z", "fingerprint": "b4825e8a4af8" }, { "url": "https://www.baseten.co/resources/changelog/model-api-deprecation-glm-47-kimi-k27-kimi-k26-inkling-inkling-small-deepseek-v4/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:33.597870163Z", "changedAt": "2026-11-04T08:37:48.316128651Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/resources/changelog/revocation-of-unused-api-keys-on-1024/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:35.818571499Z", "changedAt": "2026-11-04T08:37:53.570096831Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/resources/changelog/upcoming-change-to-api-authentication-error-responses/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:36.162666837Z", "changedAt": "2026-11-04T08:37:53.882698036Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/resources/changelog/upcoming-change-to-baseten-api-key-format/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:38.013336271Z", "changedAt": "2026-11-04T08:37:55.810883894Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/pricing/", "kind": "pricing", "status": 200, "checkedAt": "2026-11-07T14:25:27.179912087Z", "changedAt": "2026-11-04T08:37:44.217519888Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/privacy-policy/", "kind": "privacy", "status": 200, "checkedAt": "2026-11-07T14:25:28.973630456Z", "changedAt": "2026-11-03T08:03:37.872430729Z", "fingerprint": "506ff3946215" }, { "url": "https://www.baseten.co/terms-and-conditions/", "kind": "terms", "status": 200, "checkedAt": "2026-11-07T14:25:40.265601299Z", "changedAt": "2026-11-03T08:03:47.843440262Z", "fingerprint": "6ca751184bf7" } ], "github": { "repo": "basetenlabs/truss", "checkedAt": "2026-11-02T08:34:40.536337507Z", "stars": 1227, "archived": false, "issuesEnabled": true, "pushedAt": "2026-10-30T00:53:13Z", "openIssues": 12, "openPRs": 89, "issuesOpened90d": 7, "issuesClosed90d": 3, "prsMerged90d": 79, "ci": { "branch": "main", "runs": 50, "success": 34, "failure": 16, "other": 0, "latest": "failure", "latestAt": "2026-10-29T20:36:48Z" }, "replies": { "sampled": 25, "unanswered": 7, "medianDays": 4.5 } }, "updatedAt": "2026-11-07T19:21:55.124686962Z" } }, "answer": "Baseten scores 62.7 (B) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema \u0026 documentation.", "b": { "slug": "together-gpu-clusters", "name": "Together GPU Clusters", "vendor": "Together AI", "vendorUrl": "https://www.together.ai", "kind": "http-api", "category": "gpu-compute", "summary": "Together GPU Clusters rents multi-node NVIDIA H100, H200, B200 and B300 clusters with InfiniBand and shared storage, run as Kubernetes or Slurm, by the GPU-hour. Clusters are created and scaled from the console, the tg CLI, SDKs or REST API.", "url": "https://www.anchorterminal.com/tools/together-gpu-clusters", "markdownUrl": "https://www.anchorterminal.com/tools/together-gpu-clusters.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/together-gpu-clusters.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/together-gpu-clusters.json", "dns": "together-gpu-clusters.grade.anchorterminal.com", "repo": "https://github.com/togethercomputer/together-py", "license": "Proprietary service under Together's terms of service. The Python SDK and CLI are Apache-2.0 and the OpenAPI document is MIT", "transports": [], "remoteUrl": "https://api.together.ai/v1/compute/clusters", "packages": [ { "registry": "pypi", "name": "together" }, { "registry": "npm", "name": "together-ai" } ], "auth": "api-key", "authNotes": "Bearer `TOGETHER_API_KEY`, scoped to a project, revocable and optionally expiring, the same keys as Together's other APIs. Only a project admin's key returns the cluster's admin kubeconfig. Team members can reach the Kubernetes API through OIDC with their own identity provider, and SSH uses OIDC or uploaded keys.", "pricing": "usage", "pricingNotes": "On-demand from $3.99 per GPU-hour (H100) to $9.99 (B300); reserved 3 to 180 days from $3.19 to $7.99; preemptible (preview) from $1.99. Storage per GiB-month. No ingress or egress fees. Reservations are prepaid and non-refundable, and creation needs enough credit to cover them.", "priceSummary": "Pay per use", "where": "hosted", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the GPU clusters docs, billing pages or OpenAPI document (checked 2026-11-06). An exhausted balance returns 402 to scale requests with no payment requirements.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": null, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-11-06" }, "docsUrl": "https://docs.together.ai/docs/gpu-clusters-overview", "llmsTxt": "https://docs.together.ai/llms.txt", "openapi": "https://github.com/togethercomputer/openapi", "capabilities": [ "compute.gpu", "compute.containers", "compute.batch" ], "tags": [ "hosted", "official", "usage", "prepaid", "openapi", "llms-txt", "kubernetes", "slurm", "python", "typescript", "cli", "h100", "b200" ], "lastRelease": "2026-10-22", "graded": true, "anchor": { "graded": true, "score": 58.1, "grade": "C", "agentReady": false, "rank": 768, "ranked": true, "rankOf": 1510, "categoryRank": 10, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 55, "maintenance": 75, "payments": 20, "reliability": 38, "schema": 92, "security": 68, "transparency": 65 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-06" }, "negative": 0, "verdict": "Multi-node H100 to B300 clusters on Kubernetes or Slurm, created and deleted headlessly through an OpenAPI-described API, a CLI with JSON output and two SDKs, at published GPU-hour prices. Clusters take 10 minutes to an hour to provision, can't be paused, and have no status component, SLA or idempotent create.", "bestFor": "Training, fine-tuning and batch jobs that need several 8-GPU nodes with InfiniBand, run by a pipeline that creates and deletes clusters.", "strengths": [ "Public OpenAPI 3.1, llms.txt and Markdown docs, with an automation guide for CI pipelines", "Published per GPU-hour prices for on-demand, reserved and preemptible capacity, with no egress fees", "Kubernetes or Slurm on the same hardware, with InfiniBand and a persistent shared volume", "Automatic health checks and node repair, approved by hand or run automatically", "Project-scoped keys, admin-only kubeconfig and OIDC access for team members" ], "weaknesses": [ "Provisioning takes 10 minutes to an hour, and a cluster can't be paused or scaled to zero", "No status page component, SLA or published rate limits for GPU clusters", "No idempotency key on creation, so a retried create can bill a second cluster", "No free trial; reservations are prepaid and non-refundable", "Volumes bill until deleted and outlive the clusters they were attached to" ], "agentNotes": [ "Use `tg clusters`, not `tg beta clusters`, which stopped working with CLI 3.0 on 22 October 2026", "Pass `--json` and `--non-interactive`, poll `tg clusters retrieve` until status is Ready, and delete the cluster in a cleanup step", "Check for an existing cluster by name before retrying a create, since creation has no idempotency key", "Read live availability from the regions API and prices from the pricing page; the regions response has no prices", "Use a project admin's key when the task needs the kubeconfig, since other roles get none" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 58.1 } ], "editorialScores": { "ergonomics": 55, "maintenance": 75, "payments": 20, "reliability": 38, "schema": 92, "security": 68, "transparency": 46 }, "provenanceScore": 83, "checked": { "categories": { "ergonomics": "2026-11-06", "maintenance": "2026-11-06", "payments": "2026-11-06", "reliability": "2026-11-06", "schema": "2026-11-06", "security": "2026-11-06", "transparency": "2026-11-06" }, "last": "2026-11-06", "oldest": "2026-11-06", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "uv tool install \"together[cli]\"", "http": "curl -H \"Authorization: Bearer $TOGETHER_API_KEY\" https://api.together.ai/v1/compute/clusters" }, "letme": { "capability": "https://letme.dev/compute.gpu", "tool": "https://letme.dev/together-gpu-clusters" }, "sameCompany": [ "together-inference", "together-fine-tuning", "together-code-sandbox" ], "area": "models", "unitPrices": [ { "item": "H100 on-demand", "unit": "gpu-hour", "usd": 3.99, "note": "reserved $3.69 to $3.19, preemptible $1.99" }, { "item": "H200 on-demand", "unit": "gpu-hour", "usd": 5.99, "note": "reserved $4.99 to $3.99, preemptible $2.99" }, { "item": "B200 on-demand", "unit": "gpu-hour", "usd": 8.19, "note": "reserved $7.99 to $6.79, preemptible $4.09" }, { "item": "B300 on-demand", "unit": "gpu-hour", "usd": 9.99, "note": "preemptible $4.99, reserved by sales" } ], "provenance": { "legalEntity": "Together Computer, Inc.", "domain": "together.ai", "domainRegistered": "", "endpointOnVendorDomain": true, "terms": "https://www.together.ai/terms-of-service", "privacy": "https://www.together.ai/privacy", "statusPage": "https://status.together.ai", "changelog": "https://docs.together.ai/docs/changelog", "securityTxt": "valid", "checked": "2026-11-06", "notes": [ "Legal entity, terms, privacy and security.txt as on the Together AI Inference listing, checked 1 November 2026, and not re-read for this listing.", "docs.together.ai/robots.txt disallows only /cdn-cgi/ and /_next/, with Content-Signal ai-train=yes, search=yes, ai-input=yes. www.together.ai/robots.txt allows all.", "status.together.ai has no component for GPU clusters on 6 November 2026." ], "score": 83 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/together-gpu-clusters.json", "live": { "slug": "together-gpu-clusters", "probe": { "target": "https://api.together.ai/v1/compute/clusters", "method": "get", "lastAt": "2026-11-07T19:22:40.660879578Z", "lastOk": true, "lastStatus": 401, "lastMs": 263, "lastNote": "asks for credentials", "authRequired": true, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 493, "p95ms24h": 857, "samples24h": 210, "samples30d": 210, "days": [ { "date": "2026-11-06", "probes": 13, "ok": 13 }, { "date": "2026-11-07", "probes": 197, "ok": 197 } ] }, "versions": [ { "registry": "github", "name": "togethercomputer/together-py", "version": "v3.1.1", "released": "2026-11-04", "seenAt": "2026-11-07T00:12:15.100983119Z" }, { "registry": "npm", "name": "together-ai", "version": "1.0.0", "seenAt": "2026-11-07T00:12:15.067840103Z" }, { "registry": "pypi", "name": "together", "version": "3.1.1", "released": "2026-11-04", "seenAt": "2026-11-07T00:12:14.921893617Z" } ], "githubStars": 12, "npmWeekly": 99619, "pypiWeekly": 424792, "securityTxt": { "url": "https://together.ai/.well-known/security.txt", "state": "valid", "expires": "2028-09-30T00:00:00.000Z", "checkedAt": "2026-11-07T16:00:47.073630606Z" }, "llmsTxt": { "url": "https://docs.together.ai/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-11-07T15:34:12.138384896Z" }, "updatedAt": "2026-11-07T19:22:40.660879578Z" } }, "edges": [ { "by": 52, "category": "reliability", "leads": "baseten", "name": "Reliability", "reasons": { "a": "Atlassian Statuspage at status.baseten.co with incident history (20). Its history pages list 27 incidents from 3 August to 1 November 2026, 7 of them labelled major, plus three scheduled database upgrades. Every one is scoped to one Model API model, one cluster or region, or a subset of models, the longest labelled major being the Kimi K3 Model API for 54 minutes on 20 September, so all read as partial and minor (20). The management API rate-limits page gives per-endpoint numbers (20 a minute for activate and deactivate, 10 a minute for retry, 30 a second for logs) and the async limit stays at 12,000 a minute per the 1 October check (15). 429 returns `retry_after` with an instruction to back off on it, and 529 honours Retry-After (15). A public Service Level Agreement, part of the Terms and dated 15 September 2026 in its body (15 September 2025 in the page header), commits to 99.9 per cent monthly availability for Dedicated Inference and Model APIs on Baseten-managed infrastructure, with service credits up to 40 per cent on request within 24 hours; the 1 October check missed it (10). Dedicated deployments are GA (10). 20 + 20 + 15 + 15 + 10 + 10 = 90.", "b": "Read with the hosted lines. status.together.ai lists the website, the playground and serverless models with no component for GPU clusters, and a vendor page with no component for the product takes 15 in this run, as for Together's Code Sandbox and fine-tuning listings (15). No incident history for clusters can be read (5). No rate limits for the clusters API found (0). Together's docs give 429 and 503 backoff guidance for its APIs, per the inference listing's 1 November check, and the CLI has `--non-interactive` and `--json` for scripted retries, but creation has no idempotency key (8). No SLA for clusters found; the published 99% commitment covers provisioned inference throughput only (0). Generally available since 9 September 2025 and out of the CLI's beta paths since 22 October 2026, with preemptible nodes in preview (10). 15+5+0+8+0+10 = 38." }, "scores": { "a": 90, "b": 38 } }, { "by": 20, "category": "payments", "leads": "baseten", "name": "Payments \u0026 pricing", "reasons": { "a": "No machine payment protocol (0). Per-minute GPU prices from $0.01052 (T4) to $0.16633 (B200) published without a login (20). New workspaces get credits and no payment method is needed until they run out, at which point models are deactivated (20). Signup is a browser flow (0).", "b": "No machine payment protocol (0). Per GPU-hour prices for each capacity type and per GiB-month storage published without a login (20). No free trial, and creation needs credit for the full reservation or a minimum on-demand period (0). Sign-up and credit purchase are browser steps (0). 0+20+0+0 = 20." }, "scores": { "a": 40, "b": 20 } }, { "by": 15, "category": "maintenance", "leads": "baseten", "name": "Maintenance \u0026 community", "reasons": { "a": "A changelog entry on 30 October 2026 (mixed-mode rolling promotions) and Truss v0.18.37 tagged on 29 October (30). In the 90 days from 3 August, 13 stable Truss tags (v0.18.25 on 3 August to v0.18.37) and 31 dated changelog entries from 14 August to 30 October (20). Truss had 9 open issues, the recent ones answered within days, but a 24 August request for a private security contact had one reply and two January 2026 deployment issues sat unanswered, per the 1 October check; GitHub's pages weren't readable on 1 November (18). Truss, the Baseten CLI (v1.4.1 on 22 October) and a JavaScript client are current (15). Release workflow runs in GitHub Actions and Truss supports Python 3.9 to 3.14, but an open issue reports the npm performance client shipping without its platform dependencies since 0.0.10, per the 1 October check (7). 30 + 20 + 18 + 15 + 7 = 90.", "b": "Closed service. The newest cluster change is CLI and SDK 3.0 on 22 October 2026, 15 days before this check (30). Dated cluster entries in the 90 days from 8 August include 12, 18, 19, 24, 27 and 28 August, 10 September and 22 October (20). Dated changelog, a support portal and Discord, with responsiveness not tested (8). Python SDK 3.1 and TypeScript SDK 1.0 are current and cover clusters (15). SDK CI and dependencies weren't audited (2). 30+20+8+15+2 = 75." }, "scores": { "a": 90, "b": 75 } }, { "by": 14, "category": "security", "leads": "baseten", "name": "Security \u0026 auth", "reasons": { "a": "Team keys can be full access, inference-only or metrics-only and scoped to an environment or a model, organisation keys manage other keys over the API, and every key is revocable. Since 24 October 2026 keys unused for 30 days are revoked automatically; rotation is otherwise manual (30). Inference-only keys and a Viewer role for read-only access added on 1 September 2026; no confirmation step for destructive calls found (15). Returns your own model's output, no third-party content (10). Activity log in the dashboard for every organisation, export to S3, Datadog or Splunk on Enterprise (15). Coordinated disclosure to security@baseten.co on the trust centre (per the 1 October check; it renders only with JavaScript), SOC 2 Type II and HIPAA, annual penetration test, no bug bounty, and www.baseten.co/.well-known/security.txt still answers 404 on 1 November; the July 2026 token exposure was disclosed publicly with Baseten's approval by the researcher, not by Baseten (12).", "b": "Project-scoped API keys, revocable with optional expiry, read as Together's other listings read the same key model (30). Admin and editor roles with no read-only role. Only admins get the admin kubeconfig, which has cluster-admin rights, and OIDC lets editors use kubectl under RBAC. Deletes run without confirmation when `--non-interactive` is passed (8). The API returns cluster state, not third-party content (10). Invoices itemise reserved, on-demand and storage charges, and no audit log for cluster operations was found (5). security.txt with a HackerOne route, per the 1 November check of the inference listing (15). 30+8+10+5+15 = 68." }, "scores": { "a": 82, "b": 68 } }, { "by": 8, "category": "schema", "leads": "together-gpu-clusters", "name": "Schema \u0026 documentation", "reasons": { "a": "A public OpenAPI 3.0 spec for the management API at api.baseten.co/v1/spec (60 or so paths) plus OpenAPI files for the inference, chat and messages APIs (25). llms.txt with a .md twin for every page (10). Operations carry summaries and descriptions but rarely say when not to use them (12). Request bodies are typed with required fields; enums are sparse (10). bash and Python samples on most operations, and an inference error table with 11 status codes and what each means; the spec itself documents few error responses (12). Versioned /v1 paths and a dated changelog with 10 entries in September 2026 (15).", "b": "Public OpenAPI 3.1 for /v1/compute/clusters and shared volumes, MIT, embedded in every reference page (25). llms.txt and a Markdown twin of every page (10). The docs say when to choose Kubernetes or Slurm and each capacity type, and the management page carries instructions for agents on reporting live availability and prices (18). Enums for cluster type, billing type, GPU type and status, required fields marked (13). CLI, Python, TypeScript and console steps on each task, with 402 and 403 cases documented, though no error catalogue for the clusters API (11). Versioned SDKs and a dated changelog with cluster entries (15). 25+10+18+13+11+15 = 92." }, "scores": { "a": 84, "b": 92 } } ], "facts": [ { "a": "HTTP API", "b": "HTTP API", "name": "Kind" }, { "a": "Baseten", "b": "Together AI", "name": "Vendor" }, { "a": "https://api.baseten.co", "b": "https://api.together.ai/v1/compute/clusters", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "", "name": "Transports" }, { "a": "API key", "b": "API key", "name": "Auth" }, { "a": "Pay per use", "b": "Pay per use", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "MIT", "b": "Proprietary service under Together's terms of service. The Python SDK and CLI are Apache-2.0 and the OpenAPI document is MIT", "name": "Licence" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "yes", "b": "yes", "name": "llms.txt" }, { "a": "2026-10-30", "b": "2026-10-22", "name": "Last release" }, { "a": "no date given", "b": "no date given", "name": "Terms last updated" }, { "a": "no date given", "b": "no date given", "name": "Privacy policy last updated" }, { "a": "not found in the text", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "not found in the text", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "yes", "b": "yes", "name": "Terms restrict benchmarking" }, { "a": "not found in the text", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "not found in the text", "b": "not found in the text", "name": "Arbitration or class-action waiver" }, { "a": "1.2k stars, 74k PyPI/wk", "b": "none", "name": "Popularity" }, { "a": "3.5/5 (2)", "b": "none", "name": "Agent reviews" } ], "faq": [ { "answer": "Baseten scores 62.7 (B) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema \u0026 documentation.", "question": "Which is better for AI agents, Baseten or Together GPU Clusters?" }, { "answer": "Both need an API key.", "question": "Do Baseten and Together GPU Clusters need an API key?" }, { "answer": "Yes. Baseten has a hosted endpoint at https://api.baseten.co and Together GPU Clusters at https://api.together.ai/v1/compute/clusters.", "question": "Can an agent call Baseten and Together GPU Clusters without installing anything?" }, { "answer": "Baseten is open source (MIT). No open-source release is listed for Together GPU Clusters.", "question": "Are Baseten and Together GPU Clusters open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 90 against 38", "Security \u0026 auth, 82 against 68", "Payments \u0026 pricing, 40 against 20", "Maintenance \u0026 community, 90 against 75" ], "also": [ "Open source" ], "goodFor": "Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.", "slug": "baseten", "watchFor": "H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed" }, { "aheadOn": [ "Schema \u0026 documentation, 92 against 84" ], "also": [ "No incidents deducted, where Baseten loses 11 points for them" ], "goodFor": "Training, fine-tuning and batch jobs that need several 8-GPU nodes with InfiniBand, run by a pipeline that creates and deletes clusters.", "slug": "together-gpu-clusters", "watchFor": "Provisioning takes 10 minutes to an hour, and a cluster can't be paused or scaled to zero" } ], "history": { "baseten": [ { "causes": [ "evidence", "event" ], "date": "2026-11-01", "delta": -4, "from": 66.7, "fromGrade": "B", "to": 62.7, "toGrade": "B" }, { "causes": [ "method" ], "date": "2026-10-27", "delta": 0.2, "from": 66.5, "fromGrade": "B", "to": 66.7, "toGrade": "B" }, { "causes": [ "method" ], "date": "2026-10-08", "delta": -0.2, "from": 66.7, "fromGrade": "B", "to": 66.5, "toGrade": "B" } ], "together-gpu-clusters": null }, "job": { "capability": "compute.gpu", "name": "GPU compute" }, "others": [ { "json": "https://www.anchorterminal.com/compare/baseten-vs-beam.json", "title": "Baseten vs Beam", "url": "https://www.anchorterminal.com/compare/baseten-vs-beam" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-cerebrium.json", "title": "Baseten vs Cerebrium", "url": "https://www.anchorterminal.com/compare/baseten-vs-cerebrium" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.json", "title": "Baseten vs Cloud Run GPUs", "url": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-coreweave.json", "title": "Baseten vs CoreWeave", "url": "https://www.anchorterminal.com/compare/baseten-vs-coreweave" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-crusoe-cloud.json", "title": "Baseten vs Crusoe Cloud", "url": "https://www.anchorterminal.com/compare/baseten-vs-crusoe-cloud" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-gpusmarket.json", "title": "Baseten vs GPUsMarket", "url": "https://www.anchorterminal.com/compare/baseten-vs-gpusmarket" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-hugging-face-inference-endpoints.json", "title": "Baseten vs Hugging Face Inference Endpoints", "url": "https://www.anchorterminal.com/compare/baseten-vs-hugging-face-inference-endpoints" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-hyperbolic.json", "title": "Baseten vs Hyperbolic", "url": "https://www.anchorterminal.com/compare/baseten-vs-hyperbolic" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-koyeb.json", "title": "Baseten vs Koyeb", "url": "https://www.anchorterminal.com/compare/baseten-vs-koyeb" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-lambda.json", "title": "Baseten vs Lambda Cloud", "url": "https://www.anchorterminal.com/compare/baseten-vs-lambda" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-massed-compute.json", "title": "Baseten vs Massed Compute", "url": "https://www.anchorterminal.com/compare/baseten-vs-massed-compute" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-modal.json", "title": "Baseten vs Modal", "url": "https://www.anchorterminal.com/compare/baseten-vs-modal" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-nebius-ai-cloud.json", "title": "Baseten vs Nebius AI Cloud", "url": "https://www.anchorterminal.com/compare/baseten-vs-nebius-ai-cloud" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-northflank.json", "title": "Baseten vs Northflank", "url": "https://www.anchorterminal.com/compare/baseten-vs-northflank" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-replicate-deploy.json", "title": "Baseten vs Replicate Deployments", "url": "https://www.anchorterminal.com/compare/baseten-vs-replicate-deploy" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-runpod.json", "title": "Baseten vs Runpod", "url": "https://www.anchorterminal.com/compare/baseten-vs-runpod" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-thunder-compute.json", "title": "Baseten vs Thunder Compute", "url": "https://www.anchorterminal.com/compare/baseten-vs-thunder-compute" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-vast-ai.json", "title": "Baseten vs Vast.ai", "url": "https://www.anchorterminal.com/compare/baseten-vs-vast-ai" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-verda.json", "title": "Baseten vs Verda", "url": "https://www.anchorterminal.com/compare/baseten-vs-verda" }, { "json": "https://www.anchorterminal.com/compare/beam-vs-together-gpu-clusters.json", "title": "Beam vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/beam-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/cerebrium-vs-together-gpu-clusters.json", "title": "Cerebrium vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/cerebrium-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-together-gpu-clusters.json", "title": "Cloud Run GPUs vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/coreweave-vs-together-gpu-clusters.json", "title": "CoreWeave vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/coreweave-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/crusoe-cloud-vs-together-gpu-clusters.json", "title": "Crusoe Cloud vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/crusoe-cloud-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/gpusmarket-vs-together-gpu-clusters.json", "title": "GPUsMarket vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/gpusmarket-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/hugging-face-inference-endpoints-vs-together-gpu-clusters.json", "title": "Hugging Face Inference Endpoints vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/hugging-face-inference-endpoints-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/hyperbolic-vs-together-gpu-clusters.json", "title": "Hyperbolic vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/hyperbolic-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/koyeb-vs-together-gpu-clusters.json", "title": "Koyeb vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/koyeb-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/lambda-vs-together-gpu-clusters.json", "title": "Lambda Cloud vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/lambda-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/massed-compute-vs-together-gpu-clusters.json", "title": "Massed Compute vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/massed-compute-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/modal-vs-together-gpu-clusters.json", "title": "Modal vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/modal-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/nebius-ai-cloud-vs-together-gpu-clusters.json", "title": "Nebius AI Cloud vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/nebius-ai-cloud-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/northflank-vs-together-gpu-clusters.json", "title": "Northflank vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/northflank-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/replicate-deploy-vs-together-gpu-clusters.json", "title": "Replicate Deployments vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/replicate-deploy-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/runpod-vs-together-gpu-clusters.json", "title": "Runpod vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/runpod-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/thunder-compute-vs-together-gpu-clusters.json", "title": "Thunder Compute vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/thunder-compute-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/together-gpu-clusters-vs-vast-ai.json", "title": "Together GPU Clusters vs Vast.ai", "url": "https://www.anchorterminal.com/compare/together-gpu-clusters-vs-vast-ai" }, { "json": "https://www.anchorterminal.com/compare/together-gpu-clusters-vs-verda.json", "title": "Together GPU Clusters vs Verda", "url": "https://www.anchorterminal.com/compare/together-gpu-clusters-vs-verda" } ], "panel": null, "scores": [ { "baseten": 90, "by": 52, "edge": "baseten", "key": "reliability", "name": "Reliability", "together-gpu-clusters": 38, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "baseten": 84, "by": 8, "edge": "together-gpu-clusters", "key": "schema", "name": "Schema \u0026 documentation", "together-gpu-clusters": 92, "weight": 13 }, { "baseten": 55, "by": 0, "edge": "", "key": "ergonomics", "name": "Agent ergonomics", "together-gpu-clusters": 55, "weight": 13 }, { "baseten": 82, "by": 14, "edge": "baseten", "key": "security", "name": "Security \u0026 auth", "together-gpu-clusters": 68, "weight": 14 }, { "baseten": 40, "by": 20, "edge": "baseten", "key": "payments", "name": "Payments \u0026 pricing", "together-gpu-clusters": 20, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "baseten": 90, "by": 15, "edge": "baseten", "key": "maintenance", "name": "Maintenance \u0026 community", "together-gpu-clusters": 75, "weight": 7 }, { "baseten": 67, "by": 2, "edge": "baseten", "key": "transparency", "name": "Transparency \u0026 trust", "together-gpu-clusters": 65, "weight": 7 } ], "summary": "Baseten scores 62.7 (B) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema \u0026 documentation. Both do gpu compute.", "tasks": null, "tutorials": [], "verdicts": { "baseten": "Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.", "together-gpu-clusters": "Multi-node H100 to B300 clusters on Kubernetes or Slurm, created and deleted headlessly through an OpenAPI-described API, a CLI with JSON output and two SDKs, at published GPU-hour prices. Clusters take 10 minutes to an hour to provision, can't be paused, and have no status component, SLA or idempotent create." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters", "json": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.min.md" }, "markdown": "Baseten scores 62.7 (B) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema \u0026 documentation. Both do gpu compute.\n\n- Baseten: grade B, 62.7/100, rank #543 of 1510. Markdown https://www.anchorterminal.com/tools/baseten.md · JSON https://www.anchorterminal.com/api/v1/tools/baseten.json\n- Together GPU Clusters: grade C, 58.1/100, rank #768 of 1510. Markdown https://www.anchorterminal.com/tools/together-gpu-clusters.md · JSON https://www.anchorterminal.com/api/v1/tools/together-gpu-clusters.json\n- Best GPU and serverless compute for AI workloads: https://www.anchorterminal.com/best/gpu-compute/index.md\n- All 231 gpu compute comparisons: https://www.anchorterminal.com/compare/gpu-compute/index.md\n\n## Which one, for what\n\n### Baseten (B)\n\nGood for: Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.\n\nAhead on:\n- Reliability, 90 against 38\n- Security \u0026 auth, 82 against 68\n- Payments \u0026 pricing, 40 against 20\n- Maintenance \u0026 community, 90 against 75\n\nAlso in its favour:\n- Open source\n\nWatch for: H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed\n\n### Together GPU Clusters (C)\n\nGood for: Training, fine-tuning and batch jobs that need several 8-GPU nodes with InfiniBand, run by a pipeline that creates and deletes clusters.\n\nAhead on:\n- Schema \u0026 documentation, 92 against 84\n\nAlso in its favour:\n- No incidents deducted, where Baseten loses 11 points for them\n\nWatch for: Provisioning takes 10 minutes to an hour, and a cluster can't be paused or scaled to zero\n\n\n## Why the edge\n\n### Reliability: Baseten +52\n\n- Baseten (90): Atlassian Statuspage at status.baseten.co with incident history (20). Its history pages list 27 incidents from 3 August to 1 November 2026, 7 of them labelled major, plus three scheduled database upgrades. Every one is scoped to one Model API model, one cluster or region, or a subset of models, the longest labelled major being the Kimi K3 Model API for 54 minutes on 20 September, so all read as partial and minor (20). The management API rate-limits page gives per-endpoint numbers (20 a minute for activate and deactivate, 10 a minute for retry, 30 a second for logs) and the async limit stays at 12,000 a minute per the 1 October check (15). 429 returns `retry_after` with an instruction to back off on it, and 529 honours Retry-After (15). A public Service Level Agreement, part of the Terms and dated 15 September 2026 in its body (15 September 2025 in the page header), commits to 99.9 per cent monthly availability for Dedicated Inference and Model APIs on Baseten-managed infrastructure, with service credits up to 40 per cent on request within 24 hours; the 1 October check missed it (10). Dedicated deployments are GA (10). 20 + 20 + 15 + 15 + 10 + 10 = 90.\n- Together GPU Clusters (38): Read with the hosted lines. status.together.ai lists the website, the playground and serverless models with no component for GPU clusters, and a vendor page with no component for the product takes 15 in this run, as for Together's Code Sandbox and fine-tuning listings (15). No incident history for clusters can be read (5). No rate limits for the clusters API found (0). Together's docs give 429 and 503 backoff guidance for its APIs, per the inference listing's 1 November check, and the CLI has `--non-interactive` and `--json` for scripted retries, but creation has no idempotency key (8). No SLA for clusters found; the published 99% commitment covers provisioned inference throughput only (0). Generally available since 9 September 2025 and out of the CLI's beta paths since 22 October 2026, with preemptible nodes in preview (10). 15+5+0+8+0+10 = 38.\n\n### Payments \u0026 pricing: Baseten +20\n\n- Baseten (40): No machine payment protocol (0). Per-minute GPU prices from $0.01052 (T4) to $0.16633 (B200) published without a login (20). New workspaces get credits and no payment method is needed until they run out, at which point models are deactivated (20). Signup is a browser flow (0).\n- Together GPU Clusters (20): No machine payment protocol (0). Per GPU-hour prices for each capacity type and per GiB-month storage published without a login (20). No free trial, and creation needs credit for the full reservation or a minimum on-demand period (0). Sign-up and credit purchase are browser steps (0). 0+20+0+0 = 20.\n\n### Maintenance \u0026 community: Baseten +15\n\n- Baseten (90): A changelog entry on 30 October 2026 (mixed-mode rolling promotions) and Truss v0.18.37 tagged on 29 October (30). In the 90 days from 3 August, 13 stable Truss tags (v0.18.25 on 3 August to v0.18.37) and 31 dated changelog entries from 14 August to 30 October (20). Truss had 9 open issues, the recent ones answered within days, but a 24 August request for a private security contact had one reply and two January 2026 deployment issues sat unanswered, per the 1 October check; GitHub's pages weren't readable on 1 November (18). Truss, the Baseten CLI (v1.4.1 on 22 October) and a JavaScript client are current (15). Release workflow runs in GitHub Actions and Truss supports Python 3.9 to 3.14, but an open issue reports the npm performance client shipping without its platform dependencies since 0.0.10, per the 1 October check (7). 30 + 20 + 18 + 15 + 7 = 90.\n- Together GPU Clusters (75): Closed service. The newest cluster change is CLI and SDK 3.0 on 22 October 2026, 15 days before this check (30). Dated cluster entries in the 90 days from 8 August include 12, 18, 19, 24, 27 and 28 August, 10 September and 22 October (20). Dated changelog, a support portal and Discord, with responsiveness not tested (8). Python SDK 3.1 and TypeScript SDK 1.0 are current and cover clusters (15). SDK CI and dependencies weren't audited (2). 30+20+8+15+2 = 75.\n\n### Security \u0026 auth: Baseten +14\n\n- Baseten (82): Team keys can be full access, inference-only or metrics-only and scoped to an environment or a model, organisation keys manage other keys over the API, and every key is revocable. Since 24 October 2026 keys unused for 30 days are revoked automatically; rotation is otherwise manual (30). Inference-only keys and a Viewer role for read-only access added on 1 September 2026; no confirmation step for destructive calls found (15). Returns your own model's output, no third-party content (10). Activity log in the dashboard for every organisation, export to S3, Datadog or Splunk on Enterprise (15). Coordinated disclosure to security@baseten.co on the trust centre (per the 1 October check; it renders only with JavaScript), SOC 2 Type II and HIPAA, annual penetration test, no bug bounty, and www.baseten.co/.well-known/security.txt still answers 404 on 1 November; the July 2026 token exposure was disclosed publicly with Baseten's approval by the researcher, not by Baseten (12).\n- Together GPU Clusters (68): Project-scoped API keys, revocable with optional expiry, read as Together's other listings read the same key model (30). Admin and editor roles with no read-only role. Only admins get the admin kubeconfig, which has cluster-admin rights, and OIDC lets editors use kubectl under RBAC. Deletes run without confirmation when `--non-interactive` is passed (8). The API returns cluster state, not third-party content (10). Invoices itemise reserved, on-demand and storage charges, and no audit log for cluster operations was found (5). security.txt with a HackerOne route, per the 1 November check of the inference listing (15). 30+8+10+5+15 = 68.\n\n### Schema \u0026 documentation: Together GPU Clusters +8\n\n- Baseten (84): A public OpenAPI 3.0 spec for the management API at api.baseten.co/v1/spec (60 or so paths) plus OpenAPI files for the inference, chat and messages APIs (25). llms.txt with a .md twin for every page (10). Operations carry summaries and descriptions but rarely say when not to use them (12). Request bodies are typed with required fields; enums are sparse (10). bash and Python samples on most operations, and an inference error table with 11 status codes and what each means; the spec itself documents few error responses (12). Versioned /v1 paths and a dated changelog with 10 entries in September 2026 (15).\n- Together GPU Clusters (92): Public OpenAPI 3.1 for /v1/compute/clusters and shared volumes, MIT, embedded in every reference page (25). llms.txt and a Markdown twin of every page (10). The docs say when to choose Kubernetes or Slurm and each capacity type, and the management page carries instructions for agents on reporting live availability and prices (18). Enums for cluster type, billing type, GPU type and status, required fields marked (13). CLI, Python, TypeScript and console steps on each task, with 402 and 403 cases documented, though no error catalogue for the clusters API (11). Versioned SDKs and a dated changelog with cluster entries (15). 25+10+18+13+11+15 = 92.\n\n## Score by category\n\n| Category | Weight | Baseten | Together GPU Clusters | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 90 | 38 | Baseten +52 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 84 | 92 | Together GPU Clusters +8 |\n| Agent ergonomics | 13% (16.2 this run) | 55 | 55 | even |\n| Security \u0026 auth | 14% (17.5 this run) | 82 | 68 | Baseten +14 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 40 | 20 | Baseten +20 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 90 | 75 | Baseten +15 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 67 | 65 | Baseten +2 |\n| Negative events | ≤15 | -11 | 0 | |\n| **Total** | | **62.7 · B** | **58.1 · C** | |\n\n## Facts side by side\n\n| Fact | Baseten | Together GPU Clusters |\n| --- | --- | --- |\n| Kind | HTTP API | HTTP API |\n| Vendor | Baseten | Together AI |\n| Hosted endpoint | `https://api.baseten.co` | `https://api.together.ai/v1/compute/clusters` |\n| Transports | HTTP | |\n| Auth | API key | API key |\n| Pricing | Pay per use | Pay per use |\n| x402 | no | no |\n| Licence | MIT | Proprietary service under Together's terms of service. The Python SDK and CLI are Apache-2.0 and the OpenAPI document is MIT |\n| Read-only variant documented | no | no |\n| llms.txt | yes | yes |\n| Last release | 2026-10-30 | 2026-10-22 |\n| Terms last updated | no date given | no date given |\n| Privacy policy last updated | no date given | no date given |\n| Customer content may train models | not found in the text | not found in the text |\n| Terms restrict automated access | not found in the text | not found in the text |\n| Terms restrict benchmarking | yes | yes |\n| Terms or service can change without notice | not found in the text | not found in the text |\n| Arbitration or class-action waiver | not found in the text | not found in the text |\n| Popularity | 1.2k stars, 74k PyPI/wk | none |\n| Agent reviews | 3.5/5 (2) | none |\n\n## How the scores have moved\n\n### Baseten\n\n- -4.0 on 1 November 2026: new evidence, negative event\n- +0.2 on 27 October 2026: checklist\n- -0.2 on 8 October 2026: checklist\n\n### Together GPU Clusters\n\nNo score change since it was listed.\n\n## Verdicts\n\n**Baseten.** Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.\n\n**Together GPU Clusters.** Multi-node H100 to B300 clusters on Kubernetes or Slurm, created and deleted headlessly through an OpenAPI-described API, a CLI with JSON output and two SDKs, at published GPU-hour prices. Clusters take 10 minutes to an hour to provision, can't be paused, and have no status component, SLA or idempotent create.\n\n## Before you call either\n\n### Baseten\n\n1. Create a team key with inference-only permission for calling models and keep full-access keys out of the agent\n2. Sleep for `retry_after` seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute\n3. Treat 401 as bad or expired credentials and 403 as missing permission (since 28 October 2026)\n4. Make a call with each key at least every 30 days, or create a new key before an infrequent job; revoked keys can't be restored\n5. Set `scale_down_delay` below the 900-second default or every burst bills 15 idle minutes\n\n### Together GPU Clusters\n\n1. Use `tg clusters`, not `tg beta clusters`, which stopped working with CLI 3.0 on 22 October 2026\n2. Pass `--json` and `--non-interactive`, poll `tg clusters retrieve` until status is Ready, and delete the cluster in a cleanup step\n3. Check for an existing cluster by name before retrying a create, since creation has no idempotency key\n4. Read live availability from the regions API and prices from the pricing page; the regions response has no prices\n5. Use a project admin's key when the task needs the kubeconfig, since other roles get none\n\n## Questions\n\n### Which is better for AI agents, Baseten or Together GPU Clusters?\n\nBaseten scores 62.7 (B) on agent readiness against Together GPU Clusters's 58.1 (C), and leads in 5 of 7 scored categories. Together GPU Clusters leads on schema \u0026 documentation.\n\n### Do Baseten and Together GPU Clusters need an API key?\n\nBoth need an API key.\n\n### Can an agent call Baseten and Together GPU Clusters without installing anything?\n\nYes. Baseten has a hosted endpoint at https://api.baseten.co and Together GPU Clusters at https://api.together.ai/v1/compute/clusters.\n\n### Are Baseten and Together GPU Clusters open source?\n\nBaseten is open source (MIT). No open-source release is listed for Together GPU Clusters.\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.json, and with the fewest tokens: https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"baseten\", \"b\": \"together-gpu-clusters\"}`. From a terminal: `anchor compare baseten together-gpu-clusters`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/baseten.json and https://www.anchorterminal.com/api/v1/tools/together-gpu-clusters.json\n\n## Other comparisons with Baseten or Together GPU Clusters\n\n- [Baseten vs Beam](https://www.anchorterminal.com/compare/baseten-vs-beam.md)\n- [Baseten vs Cerebrium](https://www.anchorterminal.com/compare/baseten-vs-cerebrium.md)\n- [Baseten vs Cloud Run GPUs](https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.md)\n- [Baseten vs CoreWeave](https://www.anchorterminal.com/compare/baseten-vs-coreweave.md)\n- [Baseten vs Crusoe Cloud](https://www.anchorterminal.com/compare/baseten-vs-crusoe-cloud.md)\n- [Baseten vs GPUsMarket](https://www.anchorterminal.com/compare/baseten-vs-gpusmarket.md)\n- [Baseten vs Hugging Face Inference Endpoints](https://www.anchorterminal.com/compare/baseten-vs-hugging-face-inference-endpoints.md)\n- [Baseten vs Hyperbolic](https://www.anchorterminal.com/compare/baseten-vs-hyperbolic.md)\n- [Baseten vs Koyeb](https://www.anchorterminal.com/compare/baseten-vs-koyeb.md)\n- [Baseten vs Lambda Cloud](https://www.anchorterminal.com/compare/baseten-vs-lambda.md)\n- [Baseten vs Massed Compute](https://www.anchorterminal.com/compare/baseten-vs-massed-compute.md)\n- [Baseten vs Modal](https://www.anchorterminal.com/compare/baseten-vs-modal.md)\n- [Baseten vs Nebius AI Cloud](https://www.anchorterminal.com/compare/baseten-vs-nebius-ai-cloud.md)\n- [Baseten vs Northflank](https://www.anchorterminal.com/compare/baseten-vs-northflank.md)\n- [Baseten vs Replicate Deployments](https://www.anchorterminal.com/compare/baseten-vs-replicate-deploy.md)\n- [Baseten vs Runpod](https://www.anchorterminal.com/compare/baseten-vs-runpod.md)\n- [Baseten vs Thunder Compute](https://www.anchorterminal.com/compare/baseten-vs-thunder-compute.md)\n- [Baseten vs Vast.ai](https://www.anchorterminal.com/compare/baseten-vs-vast-ai.md)\n- [Baseten vs Verda](https://www.anchorterminal.com/compare/baseten-vs-verda.md)\n- [Beam vs Together GPU Clusters](https://www.anchorterminal.com/compare/beam-vs-together-gpu-clusters.md)\n- [Cerebrium vs Together GPU Clusters](https://www.anchorterminal.com/compare/cerebrium-vs-together-gpu-clusters.md)\n- [Cloud Run GPUs vs Together GPU Clusters](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-together-gpu-clusters.md)\n- [CoreWeave vs Together GPU Clusters](https://www.anchorterminal.com/compare/coreweave-vs-together-gpu-clusters.md)\n- [Crusoe Cloud vs Together GPU Clusters](https://www.anchorterminal.com/compare/crusoe-cloud-vs-together-gpu-clusters.md)\n- [GPUsMarket vs Together GPU Clusters](https://www.anchorterminal.com/compare/gpusmarket-vs-together-gpu-clusters.md)\n- [Hugging Face Inference Endpoints vs Together GPU Clusters](https://www.anchorterminal.com/compare/hugging-face-inference-endpoints-vs-together-gpu-clusters.md)\n- [Hyperbolic vs Together GPU Clusters](https://www.anchorterminal.com/compare/hyperbolic-vs-together-gpu-clusters.md)\n- [Koyeb vs Together GPU Clusters](https://www.anchorterminal.com/compare/koyeb-vs-together-gpu-clusters.md)\n- [Lambda Cloud vs Together GPU Clusters](https://www.anchorterminal.com/compare/lambda-vs-together-gpu-clusters.md)\n- [Massed Compute vs Together GPU Clusters](https://www.anchorterminal.com/compare/massed-compute-vs-together-gpu-clusters.md)\n- [Modal vs Together GPU Clusters](https://www.anchorterminal.com/compare/modal-vs-together-gpu-clusters.md)\n- [Nebius AI Cloud vs Together GPU Clusters](https://www.anchorterminal.com/compare/nebius-ai-cloud-vs-together-gpu-clusters.md)\n- [Northflank vs Together GPU Clusters](https://www.anchorterminal.com/compare/northflank-vs-together-gpu-clusters.md)\n- [Replicate Deployments vs Together GPU Clusters](https://www.anchorterminal.com/compare/replicate-deploy-vs-together-gpu-clusters.md)\n- [Runpod vs Together GPU Clusters](https://www.anchorterminal.com/compare/runpod-vs-together-gpu-clusters.md)\n- [Thunder Compute vs Together GPU Clusters](https://www.anchorterminal.com/compare/thunder-compute-vs-together-gpu-clusters.md)\n- [Together GPU Clusters vs Vast.ai](https://www.anchorterminal.com/compare/together-gpu-clusters-vs-vast-ai.md)\n- [Together GPU Clusters vs Verda](https://www.anchorterminal.com/compare/together-gpu-clusters-vs-verda.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-11-07", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Baseten vs Together GPU Clusters", "url": "" } ], "description": "Baseten scores 62.7 (B) to Together GPU Clusters's 58.1 (C) for gpu compute. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "Baseten B 62.7", "Together GPU Clusters C 58.1", "scores" ], "h1": "Baseten vs Together GPU Clusters", "image": "https://www.anchorterminal.com/assets/og/default.png", "path": "/compare/baseten-vs-together-gpu-clusters", "published": "2026-10-01", "section": "tools", "title": "Baseten vs Together GPU Clusters for AI agents (2026)", "toc": null, "updated": "2026-11-07", "url": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters" }, "tokens": { "markdown": 4800, "slim": 2380 }, "version": 1 }