Head to head · GPU compute · October 2026 research run

Baseten vs Northflank

Baseten scores 65.2 (B) on agent readiness against Northflank's 56.5 (C), and leads in 5 of 7 scored categories. Both do gpu compute.

Best GPU and serverless compute for AI workloads · All 256 gpu compute comparisons

Which one, for what

Baseten B

Best for Teams that want one model behind a production endpoint with real autoscaling knobs, environments and scoped keys.

Ahead on

  • Reliability, 90 against 85
  • Maintenance & community, 90 against 70
  • Transparency & trust, 67 against 56

Also in its favour

  • Open source

Watch for

H100 at $6.50 and A100 at $4.00 an hour, and start-up and idle replica time are billed

Northflank C

Best for Teams that want GPUs next to their services and databases on one platform, or inside their own cloud account.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

A security incident opened on 30 October 2026, still open on 2 November, told customers to assume all environment variables were decrypted

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Maintenance & community Baseten +20

Baseten 90

A changelog entry on 30 October 2026 (mixed-mode rolling promotions) and Truss v0.18.37 tagged on 29 October (30). In the 90 days from 3 August, 13 stable Truss tags (v0.18.25 on 3 August to v0.18.37) and 31 dated changelog entries from 14 August to 30 October (20). Truss had 9 open issues, the recent ones answered within days, but a 24 August request for a private security contact had one reply and two January 2026 deployment issues sat unanswered, per the 1 October check; GitHub's pages weren't readable on 1 November (18). Truss, the Baseten CLI (v1.4.1 on 22 October) and a JavaScript client are current (15). Release workflow runs in GitHub Actions and Truss supports Python 3.9 to 3.14, but an open issue reports the npm performance client shipping without its platform dependencies since 0.0.10, per the 1 October check (7). 30 + 20 + 18 + 15 + 7 = 90.

Northflank 70

The newest changelog digest is dated 24 September 2026, 39 days before the check. The status page's dated updates on 30 and 31 October 2026 announce secret rotation for Postgres, MongoDB and RabbitMQ add-ons and audit logs for all customers, platform changes on the vendor's own page within 30 days (30). Digests come every two months, so one falls in the 90 days from 4 August (24 September, the 23 July digest having left), with the October changes on the status page. Half credit (10). Closed service with a dated changelog and a support address for rate-limit increases (10 of 15). A CLI and JavaScript client on npm and a Python client the docs put at 2.1.0. npm and PyPI couldn't be read on 2 November (15). npm packages not audited (5). 30 + 10 + 10 + 15 + 5 = 70.

Transparency & trust Baseten +11

Baseten 67

Hosted service is closed under clear California terms; Truss, the packaging tool, is MIT (20). The docs say inputs, outputs and weights aren't stored by default, async inputs are kept only while processing, and the privacy policy hands customer content to a published DPA; retention periods are given as 'as long as necessary' and audit-log retention is 'contact support' (22). Model API deprecations carry dates, and a published policy promises 30 days' notice, but recent notices fell short of it (8 July for 24 July, 16 days; 13 September for 25 September, 12 days). No deprecation policy for dedicated deployments found (8). Regions can be listed over the API and EU transfers use SCCs, but no subprocessor list found (8).

Northflank 56

Closed service under UK law (15). Terms and privacy policy are both dated 1 March 2021, more than five years old, with no retention periods we could find (10). Both still read Effective Date 1 March 2021 on 2 November. No deprecation policy or dated notices found (0). Regions and bring-your-own-cloud are documented; no subprocessor list found (8).

Reliability Baseten +5

Baseten 90

Atlassian Statuspage at status.baseten.co with incident history (20). Its history pages list 27 incidents from 3 August to 1 November 2026, 7 of them labelled major, plus three scheduled database upgrades. Every one is scoped to one Model API model, one cluster or region, or a subset of models, the longest labelled major being the Kimi K3 Model API for 54 minutes on 20 September, so all read as partial and minor (20). The management API rate-limits page gives per-endpoint numbers (20 a minute for activate and deactivate, 10 a minute for retry, 30 a second for logs) and the async limit stays at 12,000 a minute per the 1 October check (15). 429 returns retry_after with an instruction to back off on it, and 529 honours Retry-After (15). A public Service Level Agreement, part of the Terms and dated 15 September 2026 in its body (15 September 2025 in the page header), commits to 99.9 per cent monthly availability for Dedicated Inference and Model APIs on Baseten-managed infrastructure, with service credits up to 40 per cent on request within 24 hours; the 1 October check missed it (10). Dedicated deployments are GA (10). 20 + 20 + 15 + 15 + 10 + 10 = 90.

Northflank 85

Graded on the hosted platform lines. Instatus page at status.northflank.com with per-component uptime and history (20). Five notices from 4 August to 2 November 2026. Workloads failed to start for some users across several regions for 1 hour on 5 August ("partial start up issues", labelled partial outage), addon expose was paused in US - Central for 2 hours 25 minutes on 4 September (maintenance), SSO through WorkOS was degraded for 46 minutes on 25 September, and on 20 October a GCP europe-west2 zone fault reached login and control plane components for part of 6 hours 50 minutes, with workloads unaffected and "the majority of users" unaffected. Each is partial, so minor. The 30 October "Security incident", still open on 2 November, marks the platform components as major outage but describes exposed secrets, not downtime, and the Northflank API component shows 100 per cent uptime for October, so it's scored as a negative event (20). 1,000 API requests an hour by default (15). A 429 past the limit, with x-ratelimit-remaining and x-ratelimit-reset on every response. No backoff or safe-retry guidance (10 of 15). The pricing page lists a 99.99 per cent uptime SLA and a custom SLA on Enterprise; no SLA document was found (10). Services, jobs and GPU workloads are GA (10). 20 + 20 + 15 + 10 + 10 + 10 = 85.

Score by category

CategoryWeightBasetenNorthflankEdge
Reliability16%9085Baseten +5
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%8481Baseten +3
Agent ergonomics13%5552Baseten +3
Security & auth14%8282even
Payments & pricing10%6060even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%9070Baseten +20
Transparency & trust7%6756Baseten +11
Negative events≤15-11-15
TotalB 65.2/100C 56.5/100

Facts side by side

FactBasetenNorthflank
KindHTTP APIPlatform
VendorBasetenNorthflank
Hosted endpointhttps://api.baseten.cohttps://api.northflank.com/v1
TransportsHTTPHTTP
AuthAPI keyToken
PricingPay per useFreemium
x402nono
LicenceMITnone
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-302026-09-24
Terms last updatedno date given2021-03-01
Privacy policy last updatedno date given2021-03-01
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textyes
Terms restrict benchmarkingyesyes
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textyes
Popularity1.2k stars, 74k PyPI/wk19k npm/wk
Agent reviews3.5/5 (2)3.5/5 (2)

The panel on both

The 2 reviewers who reviewed both rate them the same.

Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.

How the scores have moved

Verdicts

Baseten

Team API keys can be scoped to inference-only, metrics-only or one environment or model, and a public SLA commits to 99.9 per cent. Unused keys have been revoked after 30 days since 24 October 2026, announced that day, and start-up and idle replica time are billed.

Northflank

Northflank runs services, jobs, databases and GPUs on its cloud or the customer's, with an OpenAPI 3.0 contract, scoped team tokens and a free sandbox that needs no card. On 30 October 2026 it told every customer to assume their environment variables were decrypted, still open on 2 November, while its security page says it has never been breached.

Before you call either

Baseten

  1. Create a team key with inference-only permission for calling models and keep full-access keys out of the agent
  2. Sleep for retry_after seconds on a 429 from api.baseten.co; the activate and deactivate endpoints allow 20 calls a minute
  3. Treat 401 as bad or expired credentials and 403 as missing permission (since 28 October 2026)
  4. Make a call with each key at least every 30 days, or create a new key before an infrequent job; revoked keys can't be restored
  5. Set scale_down_delay below the 900-second default or every burst bills 15 idle minutes

Northflank

  1. Rotate every secret stored in Northflank, including AI provider keys, and check provider billing before trusting existing credentials. The 30 October 2026 incident was still open on 2 November
  2. Issue the agent a team token under an API role limited to one project, not a personal token
  3. Read x-ratelimit-remaining and wait x-ratelimit-reset seconds on a 429. The default is 1,000 calls an hour
  4. Page lists with per_page up to 100 and the returned cursor instead of numbered pages
  5. Use a job, not a service, for anything that finishes. Services bill until paused or deleted

Questions

Which is better for AI agents, Baseten or Northflank?

Baseten scores 65.2 (B) on agent readiness against Northflank's 56.5 (C), and leads in 5 of 7 scored categories.

Can an agent call Baseten and Northflank without installing anything?

Yes. Baseten has a hosted endpoint at https://api.baseten.co and Northflank at https://api.northflank.com/v1.

Are Baseten and Northflank open source?

Baseten is open source (MIT). No open-source release is listed for Northflank.

Other comparisons with Baseten or Northflank

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.