Baseten vs Cerebrium

Baseten

Team API keys scoped to inference-only, metrics-only or a single environment or model, plus a Viewer role since 1 September 2026. H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed.

Cerebrium

Per-second GPU prices are public, a 94-operation OpenAPI spec covers the management API, and service account tokens expire and are limited to named projects. Deployed endpoints are callable without a token unless disable_auth = false is set, and no request rate limits, 429 handling or SLA were found in the reviewed documentation.

Baseten

1. Create a team key with inference-only permission for calling models and keep full-access keys out of the agent
2. Sleep for retry_after seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute
3. Retry 429, 503 and 529 with backoff, but treat 500 as a bug in your model code
4. Set scale_down_delay below the 900-second default or every burst bills 15 idle minutes
5. Send payloads over 256 KiB to /predict, not /async_predict, unless support has raised the async limit

Cerebrium

1. Set disable_auth = false in cerebrium.toml before deploying. The default leaves the endpoint callable by anyone with the URL
2. Authenticate headless with CEREBRIUM_SERVICE_ACCOUNT_TOKEN. cerebrium login opens a browser
3. Raise response_grace_period for long work. It defaults to 15 minutes and async runs stop at 12 hours
4. Send ?async=true to get a run_id with HTTP 202, and add webhookEndpoint because async calls return no result to the caller
5. Check the plan before choosing hardware. A100, H100, H200, B200 and RTX PRO 6000 need Standard, and protected compute bills at twice the listed rate