{ "data": { "a": { "slug": "baseten", "name": "Baseten", "vendor": "Baseten", "vendorUrl": "https://www.baseten.co", "kind": "http-api", "category": "gpu-compute", "summary": "Dedicated model deployments packaged with the open-source Truss framework and served behind a per-model HTTPS endpoint, with autoscaling from zero replicas, async inference, a management API and per-minute GPU billing from T4 to B200.", "url": "https://www.anchorterminal.com/tools/baseten", "markdownUrl": "https://www.anchorterminal.com/tools/baseten.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/baseten.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/baseten.json", "dns": "baseten.grade.anchorterminal.com", "repo": "https://github.com/basetenlabs/truss", "license": "MIT", "transports": [ "http" ], "remoteUrl": "https://api.baseten.co", "packages": [ { "registry": "pypi", "name": "truss" } ], "auth": "api-key", "authNotes": "API key from the workspace settings, sent as `Authorization: Bearer $BASETEN_API_KEY` (preferred) or the legacy `Authorization: Api-Key` scheme. Keys created from 1 October 2026 carry a `b10_` prefix. Inference goes to model-\u003cid\u003e.api.baseten.co and management calls to api.baseten.co.", "pricing": "usage", "pricingNotes": "Basic is $0 a month, pay as you go; Pro and Enterprise add volume discounts. Dedicated deployments bill per minute of replica time, including start-up and idle, and nothing at zero replicas. T4 16 GiB $0.01052 a minute (about $0.63 an hour), L4 24 GiB $0.01414 ($0.85), A10G 24 GiB $0.02012 ($1.21), H100 MIG 40 GiB $0.0625 ($3.75), A100 80 GiB $0.06667 ($4.00), H100 80 GiB $0.10833 ($6.50), B200 180 GiB $0.16633 ($9.98). New accounts get a small credit to try the UI. Model APIs bill per token instead (https://www.baseten.co/pricing/).", "priceSummary": "Pay per use", "where": "hosted", "x402": { "level": "no", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 1200, "npmWeekly": null, "pypiWeekly": 74496, "asOf": "2026-09-30" }, "docsUrl": "https://docs.baseten.co", "llmsTxt": "https://docs.baseten.co/llms.txt", "openapi": "https://api.baseten.co/v1/spec", "capabilities": [ "compute.gpu", "compute.endpoints", "compute.serverless", "compute.containers" ], "tags": [ "hosted", "usage-priced", "python", "llms-txt", "open-source", "async-jobs", "webhooks", "enterprise" ], "lastRelease": "2026-10-30", "graded": true, "anchor": { "graded": true, "score": 62.7, "grade": "B", "agentReady": false, "rank": 541, "ranked": true, "rankOf": 1486, "categoryRank": 6, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 55, "maintenance": 90, "payments": 40, "reliability": 90, "schema": 84, "security": 82, "transparency": 67 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-01" }, "negative": -11, "negativeNotes": [ "-5: a GitHub personal access token for `basetenbot`, exposed in a public Harbor image since March 2023, gave admin and push access to Baseten's main product repository, the GitOps repository that drives its clusters, its Homebrew tap and per-customer private repositories. Reported on 2026-07-13, revoked on 2026-07-14, no misuse found, published with Baseten's approval in September 2026. Deducted less because the fix was quick and documented (https://www.strix.ai/blog/baseten-harbor-github-pat-takeover)", "-3: on 24 October 2026 Baseten began revoking every API key unused for 30 days, irreversibly, announced in a changelog entry dated the day it took effect; the 1 October docs said keys don't expire. A published behaviour changed for existing clients with notice only on the day (https://www.baseten.co/resources/changelog/revocation-of-unused-api-keys-on-1024/)", "-3: Truss v0.18.26 (18 August 2026) fixed a path traversal in the control server's /control/patch applier (5ae5067f) and v0.18.27 (26 August) a shell injection in generated Dockerfile RUN lines (5ff97175). Both name the flaw, cite no advisory, and OSV lists none for truss; repeats fold into one term (https://github.com/basetenlabs/truss)" ], "verdict": "Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.", "bestFor": "Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.", "strengths": [ "Team API keys scoped to inference-only, metrics-only or a single environment or model, plus a Viewer role since 1 September 2026", "A public SLA of 99.9 per cent monthly for Dedicated Inference and Model APIs, with service credits", "Public OpenAPI spec for the management API at api.baseten.co/v1/spec, and llms.txt with Markdown twins", "Rate limits published per endpoint with a `retry_after` field on 429", "Truss (MIT) keeps the model package portable, with 13 stable releases from 3 August to 29 October 2026" ], "weaknesses": [ "H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed", "API keys unused for 30 days are revoked automatically since 24 October 2026, announced the same day", "A bot token with admin access to the product and GitOps repositories sat exposed from March 2023 until July 2026", "Truss fixed a path traversal and a shell injection in August 2026 with no published advisory", "No pagination on management list endpoints, no idempotency keys, no bug bounty and no security.txt" ], "agentNotes": [ "Create a team key with inference-only permission for calling models and keep full-access keys out of the agent", "Sleep for `retry_after` seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute", "Treat 401 as bad or expired credentials and 403 as missing permission (since 28 October 2026)", "Make a call with each key at least every 30 days, or create a new key before an infrequent job; revoked keys can't be restored", "Set `scale_down_delay` below the 900-second default or every burst bills 15 idle minutes" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 2, "avgRating": 3.5, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "B", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 62.7 } ], "editorialScores": { "ergonomics": 55, "maintenance": 90, "payments": 40, "reliability": 90, "schema": 84, "security": 82, "transparency": 58 }, "provenanceScore": 75, "checked": { "categories": { "ergonomics": "2026-11-01", "maintenance": "2026-11-01", "payments": "2026-11-01", "reliability": "2026-11-01", "schema": "2026-11-01", "security": "2026-11-01", "transparency": "2026-11-01" }, "last": "2026-11-01", "lastMoved": "2026-11-01", "oldest": "2026-11-01", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "pip install truss", "http": "curl -X POST \"https://model-$BASETEN_MODEL_ID.api.baseten.co/environments/production/predict\" \\\n -H \"Authorization: Bearer $BASETEN_API_KEY\" -H \"Content-Type: application/json\" \\\n -d '{\"prompt\":\"Hello, world!\"}'" }, "letme": { "capability": "https://letme.dev/compute.gpu", "tool": "https://letme.dev/baseten" }, "sameCompany": [ "elephant-1", "joey-1", "mammoth-1" ], "area": "models", "unitPrices": [ { "item": "H100 80 GiB", "unit": "gpu-hour", "usd": 6.5, "note": "$0.10833 a minute" }, { "item": "B200 180 GiB", "unit": "gpu-hour", "usd": 9.98, "note": "$0.16633 a minute" }, { "item": "A100 80 GiB", "unit": "gpu-hour", "usd": 4, "note": "$0.06667 a minute" }, { "item": "H100 MIG 40 GiB", "unit": "gpu-hour", "usd": 3.75, "note": "$0.0625 a minute" }, { "item": "A10G 24 GiB", "unit": "gpu-hour", "usd": 1.21, "note": "$0.02012 a minute" }, { "item": "L4 24 GiB", "unit": "gpu-hour", "usd": 0.85, "note": "$0.01414 a minute" }, { "item": "T4 16 GiB", "unit": "gpu-hour", "usd": 0.63, "note": "$0.01052 a minute" } ], "provenance": { "legalEntity": "Baseten Labs, Inc.", "domain": "baseten.co", "domainRegistered": "", "endpointOnVendorDomain": true, "terms": "https://www.baseten.co/terms-and-conditions/", "privacy": "https://www.baseten.co/privacy-policy/", "statusPage": "https://status.baseten.co", "changelog": "https://www.baseten.co/changelog/", "securityTxt": "none", "checked": "2026-09-30", "notes": [ "Terms name Baseten Labs, Inc. under California law with venue in San Francisco. The privacy policy gives 560 Davis St., Suite 250, San Francisco.", "Inference runs on model-\u003cid\u003e.api.baseten.co, a subdomain of the vendor domain.", "www.baseten.co/.well-known/security.txt returns 404.", "The .co registry's RDAP server couldn't be reached, so the registration date is unrecorded." ], "score": 75 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/baseten.json", "live": { "slug": "baseten", "probe": { "target": "https://api.baseten.co", "method": "get", "lastAt": "2026-11-07T18:20:13.024731744Z", "lastOk": true, "lastStatus": 202, "lastMs": 449, "authRequired": false, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 427, "p95ms24h": 492, "samples24h": 239, "samples30d": 7910, "days": [ { "date": "2026-10-07", "probes": 272, "ok": 272 }, { "date": "2026-10-08", "probes": 268, "ok": 268 }, { "date": "2026-10-09", "probes": 250, "ok": 250 }, { "date": "2026-10-10", "probes": 247, "ok": 247 }, { "date": "2026-10-11", "probes": 247, "ok": 247 }, { "date": "2026-10-12", "probes": 247, "ok": 247 }, { "date": "2026-10-13", "probes": 248, "ok": 248 }, { "date": "2026-10-14", "probes": 249, "ok": 249 }, { "date": "2026-10-15", "probes": 253, "ok": 253 }, { "date": "2026-10-16", "probes": 252, "ok": 252 }, { "date": "2026-10-17", "probes": 253, "ok": 253 }, { "date": "2026-10-18", "probes": 256, "ok": 256 }, { "date": "2026-10-19", "probes": 255, "ok": 255 }, { "date": "2026-10-20", "probes": 252, "ok": 252 }, { "date": "2026-10-21", "probes": 253, "ok": 253 }, { "date": "2026-10-22", "probes": 253, "ok": 253 }, { "date": "2026-10-23", "probes": 248, "ok": 248 }, { "date": "2026-10-24", "probes": 251, "ok": 251 }, { "date": "2026-10-25", "probes": 250, "ok": 250 }, { "date": "2026-10-26", "probes": 252, "ok": 252 }, { "date": "2026-10-27", "probes": 249, "ok": 249 }, { "date": "2026-10-28", "probes": 251, "ok": 251 }, { "date": "2026-10-29", "probes": 249, "ok": 249 }, { "date": "2026-10-30", "probes": 248, "ok": 248 }, { "date": "2026-10-31", "probes": 251, "ok": 251 }, { "date": "2026-11-01", "probes": 249, "ok": 249 }, { "date": "2026-11-02", "probes": 250, "ok": 250 }, { "date": "2026-11-03", "probes": 248, "ok": 248 }, { "date": "2026-11-04", "probes": 246, "ok": 246 }, { "date": "2026-11-05", "probes": 185, "ok": 185 }, { "date": "2026-11-06", "probes": 241, "ok": 241 }, { "date": "2026-11-07", "probes": 187, "ok": 187 } ] }, "vendorStatus": { "page": "https://status.baseten.co", "indicator": "none", "summary": "All Systems Operational", "checkedAt": "2026-11-07T18:20:35.693424696Z" }, "versions": [ { "registry": "github", "name": "basetenlabs/truss", "version": "v0.18.38", "released": "2026-11-05", "seenAt": "2026-11-06T23:10:20.295892726Z" }, { "registry": "pypi", "name": "truss", "version": "0.18.38", "released": "2026-11-05", "seenAt": "2026-11-06T23:10:20.092737586Z" } ], "githubStars": 1230, "pypiWeekly": 81644, "securityTxt": { "url": "https://baseten.co/.well-known/security.txt", "state": "none", "checkedAt": "2026-11-07T16:00:23.369616039Z" }, "llmsTxt": { "url": "https://docs.baseten.co/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-11-07T15:31:42.043230756Z" }, "domain": { "domain": "baseten.co", "checkedAt": "2026-11-01T14:12:35.920231191Z" }, "pages": [ { "url": "https://www.baseten.co/changelog/", "kind": "changelog", "status": 200, "checkedAt": "2026-11-07T14:25:24.768972384Z", "changedAt": "2026-11-04T08:37:41.945283228Z", "fingerprint": "b4825e8a4af8" }, { "url": "https://www.baseten.co/resources/changelog/model-api-deprecation-glm-47-kimi-k27-kimi-k26-inkling-inkling-small-deepseek-v4/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:33.597870163Z", "changedAt": "2026-11-04T08:37:48.316128651Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/resources/changelog/revocation-of-unused-api-keys-on-1024/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:35.818571499Z", "changedAt": "2026-11-04T08:37:53.570096831Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/resources/changelog/upcoming-change-to-api-authentication-error-responses/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:36.162666837Z", "changedAt": "2026-11-04T08:37:53.882698036Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/resources/changelog/upcoming-change-to-baseten-api-key-format/", "kind": "deprecations", "status": 200, "checkedAt": "2026-11-07T14:25:38.013336271Z", "changedAt": "2026-11-04T08:37:55.810883894Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/pricing/", "kind": "pricing", "status": 200, "checkedAt": "2026-11-07T14:25:27.179912087Z", "changedAt": "2026-11-04T08:37:44.217519888Z", "fingerprint": "464a4eba86f1" }, { "url": "https://www.baseten.co/privacy-policy/", "kind": "privacy", "status": 200, "checkedAt": "2026-11-07T14:25:28.973630456Z", "changedAt": "2026-11-03T08:03:37.872430729Z", "fingerprint": "506ff3946215" }, { "url": "https://www.baseten.co/terms-and-conditions/", "kind": "terms", "status": 200, "checkedAt": "2026-11-07T14:25:40.265601299Z", "changedAt": "2026-11-03T08:03:47.843440262Z", "fingerprint": "6ca751184bf7" } ], "github": { "repo": "basetenlabs/truss", "checkedAt": "2026-11-02T08:34:40.536337507Z", "stars": 1227, "archived": false, "issuesEnabled": true, "pushedAt": "2026-10-30T00:53:13Z", "openIssues": 12, "openPRs": 89, "issuesOpened90d": 7, "issuesClosed90d": 3, "prsMerged90d": 79, "ci": { "branch": "main", "runs": 50, "success": 34, "failure": 16, "other": 0, "latest": "failure", "latestAt": "2026-10-29T20:36:48Z" }, "replies": { "sampled": 25, "unanswered": 7, "medianDays": 4.5 } }, "updatedAt": "2026-11-07T18:20:13.024731744Z" } }, "answer": "Cloud Run GPUs scores 68.4 (B) on agent readiness against Baseten's 62.7 (B), and leads in 2 of 7 scored categories. Baseten leads on reliability, payments \u0026 pricing and maintenance \u0026 community.", "b": { "slug": "cloud-run-gpus", "name": "Cloud Run GPUs", "vendor": "Google Cloud", "vendorUrl": "https://cloud.google.com/run", "kind": "platform", "category": "gpu-compute", "summary": "Cloud Run GPUs attach one NVIDIA L4 or RTX PRO 6000 Blackwell GPU to a Cloud Run service, job or worker pool, so a container serves models serverlessly, billed per second and able to scale to zero.", "url": "https://www.anchorterminal.com/tools/cloud-run-gpus", "markdownUrl": "https://www.anchorterminal.com/tools/cloud-run-gpus.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/cloud-run-gpus.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/cloud-run-gpus.json", "dns": "cloud-run-gpus.grade.anchorterminal.com", "license": "Proprietary service under the Google Cloud Platform terms. Client libraries are Apache-2.0", "transports": [], "remoteUrl": "https://run.googleapis.com", "packages": [ { "registry": "pypi", "name": "google-cloud-run" }, { "registry": "npm", "name": "@google-cloud/run" } ], "auth": "oauth", "authNotes": "Deploys go through the Cloud Run Admin API with OAuth 2.0 bearer tokens from a service account or Application Default Credentials, under IAM roles such as roles/run.developer and roles/run.invoker. A deployed service can require IAM authentication or allow public calls. A project with billing enabled is set up in the console first.", "pricing": "usage", "pricingNotes": "Per second, instance-based billing only. L4 $0.0001867 a second (about $0.67 an hour) without zonal redundancy, $0.0002909 with; RTX PRO 6000 $0.00036522 (about $1.31 an hour) and $0.00056913. CPU and memory extra, with a minimum of 4 vCPU and 16 GiB (L4) or 20 vCPU and 80 GiB (RTX PRO 6000).", "priceSummary": "Pay per use", "where": "hosted", "x402": { "level": "no", "evidence": "No x402, MPP or L402 on the Cloud Run pricing, GPU or quotas pages (checked 2026-11-06). Billing runs through a Google Cloud billing account.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": null, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-11-06" }, "docsUrl": "https://docs.cloud.google.com/run/docs/configuring/services/gpu", "openapi": "https://run.googleapis.com/$discovery/rest?version=v2", "capabilities": [ "compute.serverless", "compute.gpu", "compute.endpoints", "compute.containers", "compute.batch" ], "tags": [ "hosted", "official", "usage", "per-second", "scale-to-zero", "sla", "status-page", "discovery-doc", "l4", "rtx-pro-6000" ], "lastRelease": "2026-10-30", "graded": true, "anchor": { "graded": true, "score": 68.4, "grade": "B", "agentReady": false, "rank": 288, "ranked": true, "rankOf": 1486, "categoryRank": 2, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 66, "maintenance": 80, "payments": 20, "reliability": 70, "schema": 81, "security": 78, "transparency": 84 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-06" }, "negative": 0, "verdict": "Serverless GPUs on Cloud Run, an L4 or RTX PRO 6000 per instance, billed per second, scaling to zero and starting in about 5 seconds before the model loads, with a published SLA and IAM. One GPU per instance, 3 GPUs of default quota a region and instance-based billing limit it to small and mid-size models.", "bestFor": "Serving small and mid-size open models, or batch jobs, from a container that should scale to zero.", "strengths": [ "Scales to zero, bills per second, and instances with drivers start in about 5 seconds", "SLA of 99.95% with zonal redundancy and 99.5% without, plus Google's status feed", "IAM roles for deploying and invoking, Cloud Audit Logs and services that can require authentication", "Per-second prices public, L4 from about $0.67 a GPU-hour without zonal redundancy", "The same GPU option on services, jobs (up to 12 hours) and worker pools" ], "weaknesses": [ "One GPU per instance, L4 (24 GB) or RTX PRO 6000 (96 GB) only, so large models don't fit", "Default quota is 3 GPUs a region; more needs a quota request", "Model load time comes on top of the 5-second start, and minimum instances bill while idle", "No free GPU tier, and the trial credit needs a payment method", "Google's APIs accept OAuth tokens in a URL query parameter" ], "agentNotes": [ "Pass `--gpu 1 --gpu-type nvidia-l4` (or nvidia-rtx-pro-6000) with at least 4 vCPU and 16 GiB, and `--no-cpu-throttling` for instance-based billing", "Load model weights from Cloud Storage at startup in parallel; bake them into the image only below about 10 GB", "Turn zonal redundancy off for cheaper, more readily granted quota when failover isn't required", "Set minimum instances to 0 unless cold starts matter, since minimum instances bill at the full rate", "Send OAuth tokens in the `Authorization` header, never as `access_token` in the URL" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "B", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 68.4 } ], "editorialScores": { "ergonomics": 66, "maintenance": 80, "payments": 20, "reliability": 70, "schema": 81, "security": 78, "transparency": 69 }, "provenanceScore": 99, "checked": { "categories": { "ergonomics": "2026-11-06", "maintenance": "2026-11-06", "payments": "2026-11-06", "reliability": "2026-11-06", "schema": "2026-11-06", "security": "2026-11-06", "transparency": "2026-11-06" }, "last": "2026-11-06", "oldest": "2026-11-06", "stale": false, "staleAfterDays": 90 } }, "connect": { "headless": { "command": "gcloud run deploy SERVICE --image IMAGE --gpu 1 --gpu-type nvidia-l4 --cpu 4 --memory 16Gi --no-cpu-throttling --region europe-west1" } }, "letme": { "capability": "https://letme.dev/compute.serverless", "tool": "https://letme.dev/cloud-run-gpus" }, "sameCompany": [ "gemini-api", "vertex-ai", "gemini-embedding", "vertex-ai-tuning", "google-model-armor", "google-imagen", "google-veo", "google-lyria", "google-speech-to-text", "google-cloud-tts", "gemini-live", "google-adk", "google-memory-bank", "google-secret-manager", "google-cloud-document-ai", "google-weather-api", "chrome-devtools-mcp", "google-maps-platform", "google-cloud-translation", "google-calendar-api", "firebase-cloud-messaging", "google-cloud-storage", "google-drive-api", "gemini-enterprise", "gemini-cli", "google-search-console", "google-ads-api", "google-forms", "google-sheets-api", "gmail-api", "google-people-api" ], "area": "models", "unitPrices": [ { "item": "NVIDIA L4, no zonal redundancy", "unit": "gpu-hour", "usd": 0.67, "note": "$0.0001867 a second, tier 1 regions; CPU and memory extra" }, { "item": "NVIDIA L4, zonal redundancy", "unit": "gpu-hour", "usd": 1.05, "note": "$0.0002909 a second" }, { "item": "NVIDIA RTX PRO 6000, no zonal redundancy", "unit": "gpu-hour", "usd": 1.31, "note": "$0.00036522 a second" }, { "item": "NVIDIA RTX PRO 6000, zonal redundancy", "unit": "gpu-hour", "usd": 2.05, "note": "$0.00056913 a second" } ], "provenance": { "legalEntity": "Google LLC", "domain": "google.com", "domainRegistered": "1997-09-15", "domainNote": "The endpoints are on googleapis.com, Google's API domain. Docs are on docs.cloud.google.com.", "endpointOnVendorDomain": true, "terms": "https://cloud.google.com/terms", "privacy": "https://cloud.google.com/terms/cloud-privacy-notice", "statusPage": "https://status.cloud.google.com", "changelog": "https://docs.cloud.google.com/run/docs/release-notes", "securityTxt": "valid", "checked": "2026-11-06", "notes": [ "Legal entity, terms, privacy notice and security.txt as on the Google Cloud Document AI listing, checked 1 November 2026, and not re-read for this listing.", "docs.cloud.google.com/robots.txt and cloud.google.com/robots.txt allow the Cloud Run pages read; status.cloud.google.com/robots.txt allows everything.", "The Cloud Run SLA lists GPU services separately, 99.95% with zonal redundancy and 99.5% without (https://cloud.google.com/run/sla)." ], "score": 99 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/cloud-run-gpus.json", "live": { "slug": "cloud-run-gpus", "probe": { "target": "https://run.googleapis.com", "method": "get", "lastAt": "2026-11-07T18:20:17.664716666Z", "lastOk": true, "lastStatus": 404, "lastMs": 159, "authRequired": false, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 35, "p95ms24h": 120, "samples24h": 200, "samples30d": 200, "days": [ { "date": "2026-11-06", "probes": 13, "ok": 13 }, { "date": "2026-11-07", "probes": 187, "ok": 187 } ] }, "vendorStatus": { "page": "https://status.cloud.google.com", "indicator": "unknown", "summary": "no machine-readable status found", "checkedAt": "2026-11-07T04:47:16.629467571Z" }, "versions": [ { "registry": "npm", "name": "@google-cloud/run", "version": "4.2.0", "seenAt": "2026-11-06T23:15:29.275446701Z" }, { "registry": "pypi", "name": "google-cloud-run", "version": "0.16.2", "released": "2026-10-01", "seenAt": "2026-11-06T23:15:27.277547645Z" } ], "npmWeekly": 1706675, "pypiWeekly": 3039289, "securityTxt": { "url": "https://google.com/.well-known/security.txt", "state": "valid", "expires": "2030-04-01T00:00:00z", "checkedAt": "2026-11-07T16:01:22.068349931Z" }, "pages": [ { "url": "https://docs.cloud.google.com/run/docs/release-notes", "kind": "changelog", "status": 200, "checkedAt": "2026-11-07T14:05:47.69894113Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "924ee0205e11" }, { "url": "https://cloud.google.com/terms/cloud-privacy-notice", "kind": "privacy", "status": 200, "checkedAt": "2026-11-07T14:01:29.495526727Z", "changedAt": "2026-11-03T07:43:24.319773868Z", "fingerprint": "b62369d64ac6" }, { "url": "https://cloud.google.com/terms", "kind": "terms", "status": 200, "checkedAt": "2026-11-07T14:01:27.593286996Z", "changedAt": "2026-11-03T07:43:22.480965239Z", "fingerprint": "b9ec671a2caf" } ], "updatedAt": "2026-11-07T18:20:17.664716666Z" } }, "edges": [ { "by": 20, "category": "reliability", "leads": "baseten", "name": "Reliability", "reasons": { "a": "Atlassian Statuspage at status.baseten.co with incident history (20). Its history pages list 27 incidents from 3 August to 1 November 2026, 7 of them labelled major, plus three scheduled database upgrades. Every one is scoped to one Model API model, one cluster or region, or a subset of models, the longest labelled major being the Kimi K3 Model API for 54 minutes on 20 September, so all read as partial and minor (20). The management API rate-limits page gives per-endpoint numbers (20 a minute for activate and deactivate, 10 a minute for retry, 30 a second for logs) and the async limit stays at 12,000 a minute per the 1 October check (15). 429 returns `retry_after` with an instruction to back off on it, and 529 honours Retry-After (15). A public Service Level Agreement, part of the Terms and dated 15 September 2026 in its body (15 September 2025 in the page header), commits to 99.9 per cent monthly availability for Dedicated Inference and Model APIs on Baseten-managed infrastructure, with service credits up to 40 per cent on request within 24 hours; the 1 October check missed it (10). Dedicated deployments are GA (10). 20 + 20 + 15 + 15 + 10 + 10 = 90.", "b": "Hosted reading. Google Cloud's status page with a JSON incident feed (20). In the 90 days from 8 August 2026 the feed names Cloud Run in three multi-product incidents, a service outage on 20 August (15:40 to 19:20 UTC, 27 products, global and us-west1), a network degradation in us-central1-b on 1 September and a europe-west2 disruption on 20 October. One major (10). Resource limits and GPU quota are published with numbers (3 GPUs a region by default), but no request rate for the Admin API was found on the quotas page (10). Google's client libraries retry with backoff and the Admin API takes etags, while no GPU-specific retry guidance was found (10). An SLA for GPU services, 99.95% with zonal redundancy and 99.5% without (10). GPU services generally available since 7 April 2025 (10). 20+10+10+10+10+10 = 70." }, "scores": { "a": 90, "b": 70 } }, { "by": 20, "category": "payments", "leads": "baseten", "name": "Payments \u0026 pricing", "reasons": { "a": "No machine payment protocol (0). Per-minute GPU prices from $0.01052 (T4) to $0.16633 (B200) published without a login (20). New workspaces get credits and no payment method is needed until they run out, at which point models are deactivated (20). Signup is a browser flow (0).", "b": "No x402, MPP or L402 (0). Per-second GPU, CPU and memory prices published without a login (20). The Cloud Run free tier covers CPU and memory, not GPUs, and the $300 trial credit needs a payment method (0). A person creates the project and billing account in a browser (0). 0+20+0+0 = 20." }, "scores": { "a": 40, "b": 20 } }, { "by": 17, "category": "transparency", "leads": "cloud-run-gpus", "name": "Transparency \u0026 trust", "reasons": { "a": "Hosted service is closed under clear California terms; Truss, the packaging tool, is MIT (20). The docs say inputs, outputs and weights aren't stored by default, async inputs are kept only while processing, and the privacy policy hands customer content to a published DPA; retention periods are given as 'as long as necessary' and audit-log retention is 'contact support' (22). Model API deprecations carry dates, and a published policy promises 30 days' notice, but recent notices fell short of it (8 July for 24 July, 16 days; 13 September for 25 September, 12 days). No deprecation policy for dedicated deployments found (8). Regions can be listed over the API and EU transfers use SCCs, but no subprocessor list found (8).", "b": "Closed service under the Google Cloud terms, with Apache-2.0 client libraries (15). The Cloud Data Processing Addendum and the privacy notice cover customer data, per the Document AI listing's 1 November reading; no Cloud Run statement on GPU instance data after shutdown was found (22). The Cloud terms promise 12 months' notice before a backwards-incompatible API change, and driver versions are announced in the release notes (16). Regions per GPU type listed, with Google's subprocessor list and data-location terms (16). 15+22+16+16 = 69." }, "scores": { "a": 67, "b": 84 } }, { "by": 11, "category": "ergonomics", "leads": "cloud-run-gpus", "name": "Agent ergonomics", "reasons": { "a": "No field selection, limits or summaries found on list endpoints; responses are small resource objects (10). No pagination parameters on list endpoints such as /v1/models or /v1/secrets (5). The inference error page maps each code to a cause and says which to retry with exponential backoff (20). No idempotency keys; only per-deployment retry endpoints and async requests that can be polled (5). Sensible defaults (`min_replica` 0, `max_replica` 1) and official clients in Python (Truss, CLI 1.0.0) and JavaScript (performance client on npm) (15).", "b": "Platform reading. One `gcloud run deploy` with `--gpu` and `--gpu-type` adds a GPU to a container, and responses carry the service object with `fieldMask` on updates (15). List calls page with `pageSize` and `pageToken` (15). Google's status codes and messages, with quota errors that name the limit (12). Revisions are immutable, traffic can be moved back, and etags guard updates, but no idempotency key on create (12). Client libraries in many languages and gcloud, though a GPU deploy needs instance-based billing, minimum CPU and memory and, past 3 GPUs, a quota request (12). 15+15+12+12+12 = 66." }, "scores": { "a": 55, "b": 66 } }, { "by": 10, "category": "maintenance", "leads": "baseten", "name": "Maintenance \u0026 community", "reasons": { "a": "A changelog entry on 30 October 2026 (mixed-mode rolling promotions) and Truss v0.18.37 tagged on 29 October (30). In the 90 days from 3 August, 13 stable Truss tags (v0.18.25 on 3 August to v0.18.37) and 31 dated changelog entries from 14 August to 30 October (20). Truss had 9 open issues, the recent ones answered within days, but a 24 August request for a private security contact had one reply and two January 2026 deployment issues sat unanswered, per the 1 October check; GitHub's pages weren't readable on 1 November (18). Truss, the Baseten CLI (v1.4.1 on 22 October) and a JavaScript client are current (15). Release workflow runs in GitHub Actions and Truss supports Python 3.9 to 3.14, but an open issue reports the npm performance client shipping without its platform dependencies since 0.0.10, per the 1 October check (7). 30 + 20 + 18 + 15 + 7 = 90.", "b": "Closed service with official SDKs. The newest GPU change is 30 October 2026, jobs with GPUs running up to 12 hours (30). Cloud Run release notes dated 4 November, 2 November, 30 October, 24 October and more in the 90 days (20). Release notes, Google Cloud support and public trackers for the client libraries, which were not read (10). Official client libraries in eight languages and gcloud (15). CI results not checked (5). 30+20+10+15+5 = 80." }, "scores": { "a": 90, "b": 80 } } ], "facts": [ { "a": "HTTP API", "b": "Platform", "name": "Kind" }, { "a": "Baseten", "b": "Google Cloud", "name": "Vendor" }, { "a": "https://api.baseten.co", "b": "https://run.googleapis.com", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "", "name": "Transports" }, { "a": "API key", "b": "OAuth", "name": "Auth" }, { "a": "Pay per use", "b": "Pay per use", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "MIT", "b": "Proprietary service under the Google Cloud Platform terms. Client libraries are Apache-2.0", "name": "Licence" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "yes", "b": "no", "name": "llms.txt" }, { "a": "2026-10-30", "b": "2026-10-30", "name": "Last release" }, { "a": "no date given", "b": "2026-09-02", "name": "Terms last updated" }, { "a": "no date given", "b": "2026-09-28", "name": "Privacy policy last updated" }, { "a": "not found in the text", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "not found in the text", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "yes", "b": "not found in the text", "name": "Terms restrict benchmarking" }, { "a": "not found in the text", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "not found in the text", "b": "not found in the text", "name": "Arbitration or class-action waiver" }, { "a": "1.2k stars, 74k PyPI/wk", "b": "none", "name": "Popularity" }, { "a": "3.5/5 (2)", "b": "none", "name": "Agent reviews" } ], "faq": [ { "answer": "Cloud Run GPUs scores 68.4 (B) on agent readiness against Baseten's 62.7 (B), and leads in 2 of 7 scored categories. Baseten leads on reliability, payments \u0026 pricing and maintenance \u0026 community.", "question": "Which is better for AI agents, Baseten or Cloud Run GPUs?" }, { "answer": "Yes. Baseten has a hosted endpoint at https://api.baseten.co and Cloud Run GPUs at https://run.googleapis.com.", "question": "Can an agent call Baseten and Cloud Run GPUs without installing anything?" }, { "answer": "Baseten is open source (MIT). No open-source release is listed for Cloud Run GPUs.", "question": "Are Baseten and Cloud Run GPUs open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 90 against 70", "Payments \u0026 pricing, 40 against 20", "Maintenance \u0026 community, 90 against 80" ], "also": [ "Open source" ], "goodFor": "Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.", "slug": "baseten", "watchFor": "H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed" }, { "aheadOn": [ "Agent ergonomics, 66 against 55", "Transparency \u0026 trust, 84 against 67" ], "also": [ "No incidents deducted, where Baseten loses 11 points for them" ], "goodFor": "Serving small and mid-size open models, or batch jobs, from a container that should scale to zero.", "slug": "cloud-run-gpus", "watchFor": "One GPU per instance, L4 (24 GB) or RTX PRO 6000 (96 GB) only, so large models don't fit" } ], "history": { "baseten": [ { "causes": [ "evidence", "event" ], "date": "2026-11-01", "delta": -4, "from": 66.7, "fromGrade": "B", "to": 62.7, "toGrade": "B" }, { "causes": [ "method" ], "date": "2026-10-27", "delta": 0.2, "from": 66.5, "fromGrade": "B", "to": 66.7, "toGrade": "B" }, { "causes": [ "method" ], "date": "2026-10-08", "delta": -0.2, "from": 66.7, "fromGrade": "B", "to": 66.5, "toGrade": "B" } ], "cloud-run-gpus": null }, "job": { "capability": "compute.gpu", "name": "GPU compute" }, "others": [ { "json": "https://www.anchorterminal.com/compare/baseten-vs-beam.json", "title": "Baseten vs Beam", "url": "https://www.anchorterminal.com/compare/baseten-vs-beam" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-cerebrium.json", "title": "Baseten vs Cerebrium", "url": "https://www.anchorterminal.com/compare/baseten-vs-cerebrium" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-coreweave.json", "title": "Baseten vs CoreWeave", "url": "https://www.anchorterminal.com/compare/baseten-vs-coreweave" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-crusoe-cloud.json", "title": "Baseten vs Crusoe Cloud", "url": "https://www.anchorterminal.com/compare/baseten-vs-crusoe-cloud" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-gpusmarket.json", "title": "Baseten vs GPUsMarket", "url": "https://www.anchorterminal.com/compare/baseten-vs-gpusmarket" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-hugging-face-inference-endpoints.json", "title": "Baseten vs Hugging Face Inference Endpoints", "url": "https://www.anchorterminal.com/compare/baseten-vs-hugging-face-inference-endpoints" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-hyperbolic.json", "title": "Baseten vs Hyperbolic", "url": "https://www.anchorterminal.com/compare/baseten-vs-hyperbolic" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-koyeb.json", "title": "Baseten vs Koyeb", "url": "https://www.anchorterminal.com/compare/baseten-vs-koyeb" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-lambda.json", "title": "Baseten vs Lambda Cloud", "url": "https://www.anchorterminal.com/compare/baseten-vs-lambda" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-massed-compute.json", "title": "Baseten vs Massed Compute", "url": "https://www.anchorterminal.com/compare/baseten-vs-massed-compute" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-modal.json", "title": "Baseten vs Modal", "url": "https://www.anchorterminal.com/compare/baseten-vs-modal" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-nebius-ai-cloud.json", "title": "Baseten vs Nebius AI Cloud", "url": "https://www.anchorterminal.com/compare/baseten-vs-nebius-ai-cloud" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-northflank.json", "title": "Baseten vs Northflank", "url": "https://www.anchorterminal.com/compare/baseten-vs-northflank" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-replicate-deploy.json", "title": "Baseten vs Replicate Deployments", "url": "https://www.anchorterminal.com/compare/baseten-vs-replicate-deploy" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-runpod.json", "title": "Baseten vs Runpod", "url": "https://www.anchorterminal.com/compare/baseten-vs-runpod" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-thunder-compute.json", "title": "Baseten vs Thunder Compute", "url": "https://www.anchorterminal.com/compare/baseten-vs-thunder-compute" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.json", "title": "Baseten vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-vast-ai.json", "title": "Baseten vs Vast.ai", "url": "https://www.anchorterminal.com/compare/baseten-vs-vast-ai" }, { "json": "https://www.anchorterminal.com/compare/baseten-vs-verda.json", "title": "Baseten vs Verda", "url": "https://www.anchorterminal.com/compare/baseten-vs-verda" }, { "json": "https://www.anchorterminal.com/compare/beam-vs-cloud-run-gpus.json", "title": "Beam vs Cloud Run GPUs", "url": "https://www.anchorterminal.com/compare/beam-vs-cloud-run-gpus" }, { "json": "https://www.anchorterminal.com/compare/cerebrium-vs-cloud-run-gpus.json", "title": "Cerebrium vs Cloud Run GPUs", "url": "https://www.anchorterminal.com/compare/cerebrium-vs-cloud-run-gpus" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-coreweave.json", "title": "Cloud Run GPUs vs CoreWeave", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-coreweave" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-crusoe-cloud.json", "title": "Cloud Run GPUs vs Crusoe Cloud", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-crusoe-cloud" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-gpusmarket.json", "title": "Cloud Run GPUs vs GPUsMarket", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-gpusmarket" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-hugging-face-inference-endpoints.json", "title": "Cloud Run GPUs vs Hugging Face Inference Endpoints", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-hugging-face-inference-endpoints" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-hyperbolic.json", "title": "Cloud Run GPUs vs Hyperbolic", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-hyperbolic" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-lambda.json", "title": "Cloud Run GPUs vs Lambda Cloud", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-lambda" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-massed-compute.json", "title": "Cloud Run GPUs vs Massed Compute", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-massed-compute" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-nebius-ai-cloud.json", "title": "Cloud Run GPUs vs Nebius AI Cloud", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-nebius-ai-cloud" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-northflank.json", "title": "Cloud Run GPUs vs Northflank", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-northflank" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-thunder-compute.json", "title": "Cloud Run GPUs vs Thunder Compute", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-thunder-compute" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-together-gpu-clusters.json", "title": "Cloud Run GPUs vs Together GPU Clusters", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-together-gpu-clusters" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-koyeb.json", "title": "Cloud Run GPUs vs Koyeb", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-koyeb" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-modal.json", "title": "Cloud Run GPUs vs Modal", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-modal" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-replicate-deploy.json", "title": "Cloud Run GPUs vs Replicate Deployments", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-replicate-deploy" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-runpod.json", "title": "Cloud Run GPUs vs Runpod", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-runpod" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-vast-ai.json", "title": "Cloud Run GPUs vs Vast.ai", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-vast-ai" }, { "json": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-verda.json", "title": "Cloud Run GPUs vs Verda", "url": "https://www.anchorterminal.com/compare/cloud-run-gpus-vs-verda" } ], "panel": null, "scores": [ { "baseten": 90, "by": 20, "cloud-run-gpus": 70, "edge": "baseten", "key": "reliability", "name": "Reliability", "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "baseten": 84, "by": 3, "cloud-run-gpus": 81, "edge": "baseten", "key": "schema", "name": "Schema \u0026 documentation", "weight": 13 }, { "baseten": 55, "by": 11, "cloud-run-gpus": 66, "edge": "cloud-run-gpus", "key": "ergonomics", "name": "Agent ergonomics", "weight": 13 }, { "baseten": 82, "by": 4, "cloud-run-gpus": 78, "edge": "baseten", "key": "security", "name": "Security \u0026 auth", "weight": 14 }, { "baseten": 40, "by": 20, "cloud-run-gpus": 20, "edge": "baseten", "key": "payments", "name": "Payments \u0026 pricing", "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "baseten": 90, "by": 10, "cloud-run-gpus": 80, "edge": "baseten", "key": "maintenance", "name": "Maintenance \u0026 community", "weight": 7 }, { "baseten": 67, "by": 17, "cloud-run-gpus": 84, "edge": "cloud-run-gpus", "key": "transparency", "name": "Transparency \u0026 trust", "weight": 7 } ], "summary": "Cloud Run GPUs scores 68.4 (B) on agent readiness against Baseten's 62.7 (B), and leads in 2 of 7 scored categories. Baseten leads on reliability, payments \u0026 pricing and maintenance \u0026 community. Both do gpu compute.", "tasks": null, "tutorials": [], "verdicts": { "baseten": "Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.", "cloud-run-gpus": "Serverless GPUs on Cloud Run, an L4 or RTX PRO 6000 per instance, billed per second, scaling to zero and starting in about 5 seconds before the model loads, with a published SLA and IAM. One GPU per instance, 3 GPUs of default quota a region and instance-based billing limit it to small and mid-size models." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus", "json": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.min.md" }, "markdown": "Cloud Run GPUs scores 68.4 (B) on agent readiness against Baseten's 62.7 (B), and leads in 2 of 7 scored categories. Baseten leads on reliability, payments \u0026 pricing and maintenance \u0026 community. Both do gpu compute.\n\n- Baseten: grade B, 62.7/100, rank #541 of 1486. Markdown https://www.anchorterminal.com/tools/baseten.md · JSON https://www.anchorterminal.com/api/v1/tools/baseten.json\n- Cloud Run GPUs: grade B, 68.4/100, rank #288 of 1486. Markdown https://www.anchorterminal.com/tools/cloud-run-gpus.md · JSON https://www.anchorterminal.com/api/v1/tools/cloud-run-gpus.json\n- Best GPU and serverless compute for AI workloads: https://www.anchorterminal.com/best/gpu-compute/index.md\n- All 231 gpu compute comparisons: https://www.anchorterminal.com/compare/gpu-compute/index.md\n\n## Which one, for what\n\n### Baseten (B)\n\nGood for: Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.\n\nAhead on:\n- Reliability, 90 against 70\n- Payments \u0026 pricing, 40 against 20\n- Maintenance \u0026 community, 90 against 80\n\nAlso in its favour:\n- Open source\n\nWatch for: H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed\n\n### Cloud Run GPUs (B)\n\nGood for: Serving small and mid-size open models, or batch jobs, from a container that should scale to zero.\n\nAhead on:\n- Agent ergonomics, 66 against 55\n- Transparency \u0026 trust, 84 against 67\n\nAlso in its favour:\n- No incidents deducted, where Baseten loses 11 points for them\n\nWatch for: One GPU per instance, L4 (24 GB) or RTX PRO 6000 (96 GB) only, so large models don't fit\n\n\n## Why the edge\n\n### Reliability: Baseten +20\n\n- Baseten (90): Atlassian Statuspage at status.baseten.co with incident history (20). Its history pages list 27 incidents from 3 August to 1 November 2026, 7 of them labelled major, plus three scheduled database upgrades. Every one is scoped to one Model API model, one cluster or region, or a subset of models, the longest labelled major being the Kimi K3 Model API for 54 minutes on 20 September, so all read as partial and minor (20). The management API rate-limits page gives per-endpoint numbers (20 a minute for activate and deactivate, 10 a minute for retry, 30 a second for logs) and the async limit stays at 12,000 a minute per the 1 October check (15). 429 returns `retry_after` with an instruction to back off on it, and 529 honours Retry-After (15). A public Service Level Agreement, part of the Terms and dated 15 September 2026 in its body (15 September 2025 in the page header), commits to 99.9 per cent monthly availability for Dedicated Inference and Model APIs on Baseten-managed infrastructure, with service credits up to 40 per cent on request within 24 hours; the 1 October check missed it (10). Dedicated deployments are GA (10). 20 + 20 + 15 + 15 + 10 + 10 = 90.\n- Cloud Run GPUs (70): Hosted reading. Google Cloud's status page with a JSON incident feed (20). In the 90 days from 8 August 2026 the feed names Cloud Run in three multi-product incidents, a service outage on 20 August (15:40 to 19:20 UTC, 27 products, global and us-west1), a network degradation in us-central1-b on 1 September and a europe-west2 disruption on 20 October. One major (10). Resource limits and GPU quota are published with numbers (3 GPUs a region by default), but no request rate for the Admin API was found on the quotas page (10). Google's client libraries retry with backoff and the Admin API takes etags, while no GPU-specific retry guidance was found (10). An SLA for GPU services, 99.95% with zonal redundancy and 99.5% without (10). GPU services generally available since 7 April 2025 (10). 20+10+10+10+10+10 = 70.\n\n### Payments \u0026 pricing: Baseten +20\n\n- Baseten (40): No machine payment protocol (0). Per-minute GPU prices from $0.01052 (T4) to $0.16633 (B200) published without a login (20). New workspaces get credits and no payment method is needed until they run out, at which point models are deactivated (20). Signup is a browser flow (0).\n- Cloud Run GPUs (20): No x402, MPP or L402 (0). Per-second GPU, CPU and memory prices published without a login (20). The Cloud Run free tier covers CPU and memory, not GPUs, and the $300 trial credit needs a payment method (0). A person creates the project and billing account in a browser (0). 0+20+0+0 = 20.\n\n### Transparency \u0026 trust: Cloud Run GPUs +17\n\n- Baseten (67): Hosted service is closed under clear California terms; Truss, the packaging tool, is MIT (20). The docs say inputs, outputs and weights aren't stored by default, async inputs are kept only while processing, and the privacy policy hands customer content to a published DPA; retention periods are given as 'as long as necessary' and audit-log retention is 'contact support' (22). Model API deprecations carry dates, and a published policy promises 30 days' notice, but recent notices fell short of it (8 July for 24 July, 16 days; 13 September for 25 September, 12 days). No deprecation policy for dedicated deployments found (8). Regions can be listed over the API and EU transfers use SCCs, but no subprocessor list found (8).\n- Cloud Run GPUs (84): Closed service under the Google Cloud terms, with Apache-2.0 client libraries (15). The Cloud Data Processing Addendum and the privacy notice cover customer data, per the Document AI listing's 1 November reading; no Cloud Run statement on GPU instance data after shutdown was found (22). The Cloud terms promise 12 months' notice before a backwards-incompatible API change, and driver versions are announced in the release notes (16). Regions per GPU type listed, with Google's subprocessor list and data-location terms (16). 15+22+16+16 = 69.\n\n### Agent ergonomics: Cloud Run GPUs +11\n\n- Baseten (55): No field selection, limits or summaries found on list endpoints; responses are small resource objects (10). No pagination parameters on list endpoints such as /v1/models or /v1/secrets (5). The inference error page maps each code to a cause and says which to retry with exponential backoff (20). No idempotency keys; only per-deployment retry endpoints and async requests that can be polled (5). Sensible defaults (`min_replica` 0, `max_replica` 1) and official clients in Python (Truss, CLI 1.0.0) and JavaScript (performance client on npm) (15).\n- Cloud Run GPUs (66): Platform reading. One `gcloud run deploy` with `--gpu` and `--gpu-type` adds a GPU to a container, and responses carry the service object with `fieldMask` on updates (15). List calls page with `pageSize` and `pageToken` (15). Google's status codes and messages, with quota errors that name the limit (12). Revisions are immutable, traffic can be moved back, and etags guard updates, but no idempotency key on create (12). Client libraries in many languages and gcloud, though a GPU deploy needs instance-based billing, minimum CPU and memory and, past 3 GPUs, a quota request (12). 15+15+12+12+12 = 66.\n\n### Maintenance \u0026 community: Baseten +10\n\n- Baseten (90): A changelog entry on 30 October 2026 (mixed-mode rolling promotions) and Truss v0.18.37 tagged on 29 October (30). In the 90 days from 3 August, 13 stable Truss tags (v0.18.25 on 3 August to v0.18.37) and 31 dated changelog entries from 14 August to 30 October (20). Truss had 9 open issues, the recent ones answered within days, but a 24 August request for a private security contact had one reply and two January 2026 deployment issues sat unanswered, per the 1 October check; GitHub's pages weren't readable on 1 November (18). Truss, the Baseten CLI (v1.4.1 on 22 October) and a JavaScript client are current (15). Release workflow runs in GitHub Actions and Truss supports Python 3.9 to 3.14, but an open issue reports the npm performance client shipping without its platform dependencies since 0.0.10, per the 1 October check (7). 30 + 20 + 18 + 15 + 7 = 90.\n- Cloud Run GPUs (80): Closed service with official SDKs. The newest GPU change is 30 October 2026, jobs with GPUs running up to 12 hours (30). Cloud Run release notes dated 4 November, 2 November, 30 October, 24 October and more in the 90 days (20). Release notes, Google Cloud support and public trackers for the client libraries, which were not read (10). Official client libraries in eight languages and gcloud (15). CI results not checked (5). 30+20+10+15+5 = 80.\n\n## Score by category\n\n| Category | Weight | Baseten | Cloud Run GPUs | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 90 | 70 | Baseten +20 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 84 | 81 | Baseten +3 |\n| Agent ergonomics | 13% (16.2 this run) | 55 | 66 | Cloud Run GPUs +11 |\n| Security \u0026 auth | 14% (17.5 this run) | 82 | 78 | Baseten +4 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 40 | 20 | Baseten +20 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 90 | 80 | Baseten +10 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 67 | 84 | Cloud Run GPUs +17 |\n| Negative events | ≤15 | -11 | 0 | |\n| **Total** | | **62.7 · B** | **68.4 · B** | |\n\n## Facts side by side\n\n| Fact | Baseten | Cloud Run GPUs |\n| --- | --- | --- |\n| Kind | HTTP API | Platform |\n| Vendor | Baseten | Google Cloud |\n| Hosted endpoint | `https://api.baseten.co` | `https://run.googleapis.com` |\n| Transports | HTTP | |\n| Auth | API key | OAuth |\n| Pricing | Pay per use | Pay per use |\n| x402 | no | no |\n| Licence | MIT | Proprietary service under the Google Cloud Platform terms. Client libraries are Apache-2.0 |\n| Read-only variant documented | no | no |\n| llms.txt | yes | no |\n| Last release | 2026-10-30 | 2026-10-30 |\n| Terms last updated | no date given | 2026-09-02 |\n| Privacy policy last updated | no date given | 2026-09-28 |\n| Customer content may train models | not found in the text | not found in the text |\n| Terms restrict automated access | not found in the text | not found in the text |\n| Terms restrict benchmarking | yes | not found in the text |\n| Terms or service can change without notice | not found in the text | not found in the text |\n| Arbitration or class-action waiver | not found in the text | not found in the text |\n| Popularity | 1.2k stars, 74k PyPI/wk | none |\n| Agent reviews | 3.5/5 (2) | none |\n\n## How the scores have moved\n\n### Baseten\n\n- -4.0 on 1 November 2026: new evidence, negative event\n- +0.2 on 27 October 2026: checklist\n- -0.2 on 8 October 2026: checklist\n\n### Cloud Run GPUs\n\nNo score change since it was listed.\n\n## Verdicts\n\n**Baseten.** Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.\n\n**Cloud Run GPUs.** Serverless GPUs on Cloud Run, an L4 or RTX PRO 6000 per instance, billed per second, scaling to zero and starting in about 5 seconds before the model loads, with a published SLA and IAM. One GPU per instance, 3 GPUs of default quota a region and instance-based billing limit it to small and mid-size models.\n\n## Before you call either\n\n### Baseten\n\n1. Create a team key with inference-only permission for calling models and keep full-access keys out of the agent\n2. Sleep for `retry_after` seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute\n3. Treat 401 as bad or expired credentials and 403 as missing permission (since 28 October 2026)\n4. Make a call with each key at least every 30 days, or create a new key before an infrequent job; revoked keys can't be restored\n5. Set `scale_down_delay` below the 900-second default or every burst bills 15 idle minutes\n\n### Cloud Run GPUs\n\n1. Pass `--gpu 1 --gpu-type nvidia-l4` (or nvidia-rtx-pro-6000) with at least 4 vCPU and 16 GiB, and `--no-cpu-throttling` for instance-based billing\n2. Load model weights from Cloud Storage at startup in parallel; bake them into the image only below about 10 GB\n3. Turn zonal redundancy off for cheaper, more readily granted quota when failover isn't required\n4. Set minimum instances to 0 unless cold starts matter, since minimum instances bill at the full rate\n5. Send OAuth tokens in the `Authorization` header, never as `access_token` in the URL\n\n## Questions\n\n### Which is better for AI agents, Baseten or Cloud Run GPUs?\n\nCloud Run GPUs scores 68.4 (B) on agent readiness against Baseten's 62.7 (B), and leads in 2 of 7 scored categories. Baseten leads on reliability, payments \u0026 pricing and maintenance \u0026 community.\n\n### Can an agent call Baseten and Cloud Run GPUs without installing anything?\n\nYes. Baseten has a hosted endpoint at https://api.baseten.co and Cloud Run GPUs at https://run.googleapis.com.\n\n### Are Baseten and Cloud Run GPUs open source?\n\nBaseten is open source (MIT). No open-source release is listed for Cloud Run GPUs.\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.json, and with the fewest tokens: https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"baseten\", \"b\": \"cloud-run-gpus\"}`. From a terminal: `anchor compare baseten cloud-run-gpus`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/baseten.json and https://www.anchorterminal.com/api/v1/tools/cloud-run-gpus.json\n\n## Other comparisons with Baseten or Cloud Run GPUs\n\n- [Baseten vs Beam](https://www.anchorterminal.com/compare/baseten-vs-beam.md)\n- [Baseten vs Cerebrium](https://www.anchorterminal.com/compare/baseten-vs-cerebrium.md)\n- [Baseten vs CoreWeave](https://www.anchorterminal.com/compare/baseten-vs-coreweave.md)\n- [Baseten vs Crusoe Cloud](https://www.anchorterminal.com/compare/baseten-vs-crusoe-cloud.md)\n- [Baseten vs GPUsMarket](https://www.anchorterminal.com/compare/baseten-vs-gpusmarket.md)\n- [Baseten vs Hugging Face Inference Endpoints](https://www.anchorterminal.com/compare/baseten-vs-hugging-face-inference-endpoints.md)\n- [Baseten vs Hyperbolic](https://www.anchorterminal.com/compare/baseten-vs-hyperbolic.md)\n- [Baseten vs Koyeb](https://www.anchorterminal.com/compare/baseten-vs-koyeb.md)\n- [Baseten vs Lambda Cloud](https://www.anchorterminal.com/compare/baseten-vs-lambda.md)\n- [Baseten vs Massed Compute](https://www.anchorterminal.com/compare/baseten-vs-massed-compute.md)\n- [Baseten vs Modal](https://www.anchorterminal.com/compare/baseten-vs-modal.md)\n- [Baseten vs Nebius AI Cloud](https://www.anchorterminal.com/compare/baseten-vs-nebius-ai-cloud.md)\n- [Baseten vs Northflank](https://www.anchorterminal.com/compare/baseten-vs-northflank.md)\n- [Baseten vs Replicate Deployments](https://www.anchorterminal.com/compare/baseten-vs-replicate-deploy.md)\n- [Baseten vs Runpod](https://www.anchorterminal.com/compare/baseten-vs-runpod.md)\n- [Baseten vs Thunder Compute](https://www.anchorterminal.com/compare/baseten-vs-thunder-compute.md)\n- [Baseten vs Together GPU Clusters](https://www.anchorterminal.com/compare/baseten-vs-together-gpu-clusters.md)\n- [Baseten vs Vast.ai](https://www.anchorterminal.com/compare/baseten-vs-vast-ai.md)\n- [Baseten vs Verda](https://www.anchorterminal.com/compare/baseten-vs-verda.md)\n- [Beam vs Cloud Run GPUs](https://www.anchorterminal.com/compare/beam-vs-cloud-run-gpus.md)\n- [Cerebrium vs Cloud Run GPUs](https://www.anchorterminal.com/compare/cerebrium-vs-cloud-run-gpus.md)\n- [Cloud Run GPUs vs CoreWeave](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-coreweave.md)\n- [Cloud Run GPUs vs Crusoe Cloud](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-crusoe-cloud.md)\n- [Cloud Run GPUs vs GPUsMarket](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-gpusmarket.md)\n- [Cloud Run GPUs vs Hugging Face Inference Endpoints](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-hugging-face-inference-endpoints.md)\n- [Cloud Run GPUs vs Hyperbolic](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-hyperbolic.md)\n- [Cloud Run GPUs vs Lambda Cloud](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-lambda.md)\n- [Cloud Run GPUs vs Massed Compute](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-massed-compute.md)\n- [Cloud Run GPUs vs Nebius AI Cloud](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-nebius-ai-cloud.md)\n- [Cloud Run GPUs vs Northflank](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-northflank.md)\n- [Cloud Run GPUs vs Thunder Compute](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-thunder-compute.md)\n- [Cloud Run GPUs vs Together GPU Clusters](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-together-gpu-clusters.md)\n- [Cloud Run GPUs vs Koyeb](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-koyeb.md)\n- [Cloud Run GPUs vs Modal](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-modal.md)\n- [Cloud Run GPUs vs Replicate Deployments](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-replicate-deploy.md)\n- [Cloud Run GPUs vs Runpod](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-runpod.md)\n- [Cloud Run GPUs vs Vast.ai](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-vast-ai.md)\n- [Cloud Run GPUs vs Verda](https://www.anchorterminal.com/compare/cloud-run-gpus-vs-verda.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-11-07", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Baseten vs Cloud Run GPUs", "url": "" } ], "description": "Cloud Run GPUs scores 68.4 (B) to Baseten's 62.7 (B) for gpu compute. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "Baseten B 62.7", "Cloud Run GPUs B 68.4", "scores" ], "h1": "Baseten vs Cloud Run GPUs", "image": "https://www.anchorterminal.com/assets/og/default.png", "path": "/compare/baseten-vs-cloud-run-gpus", "published": "2026-10-01", "section": "tools", "title": "Baseten vs Cloud Run GPUs for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-11-07", "url": "https://www.anchorterminal.com/compare/baseten-vs-cloud-run-gpus" }, "tokens": { "markdown": 4500, "slim": 2280 }, "version": 1 }