Baseten vs Northflank

Baseten

Team API keys scoped to inference-only, metrics-only or a single environment or model, plus a Viewer role since 1 September 2026. H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed.

Northflank

OpenAPI 3.0 with over 100 paths, enums and per_page, page and cursor on every list. No scale to zero for services; minimum instances must be at least 1.

Baseten

1. Create a team key with inference-only permission for calling models and keep full-access keys out of the agent
2. Sleep for retry_after seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute
3. Retry 429, 503 and 529 with backoff, but treat 500 as a bug in your model code
4. Set scale_down_delay below the 900-second default or every burst bills 15 idle minutes
5. Send payloads over 256 KiB to /predict, not /async_predict, unless support has raised the async limit

Northflank

1. Issue the agent a team token under an API role limited to one project, not a personal token
2. Read x-ratelimit-remaining and wait x-ratelimit-reset seconds on a 429; the default is 1,000 calls an hour
3. Page lists with per_page up to 100 and the returned cursor instead of numbered pages
4. Use a job, not a service, for anything that finishes; services bill until paused or deleted
5. Fetch any docs page with .md appended to get Markdown