Head to head · LLM inference · October 2026 research run

Novita AI vs SWE-2 Flash

Novita AI scores 53.9 (D) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in 5 of 7 scored categories. SWE-2 Flash leads on reliability and transparency & trust. Both do llm inference.

Best model APIs and inference for AI agents · All 562 models comparisons

Which one, for what

Novita AI D

Best for Agents that want many open-weight models at per-token prices behind one OpenAI-style key, with keys that can be limited by model, IP and expiry.

Ahead on

  • Schema & documentation, 62 against 29
  • Agent ergonomics, 72 against 10
  • Security & auth, 65 against 53
  • Payments & pricing, 35 against 20
  • Maintenance & community, 66 against 53

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

No status page or SLA was found on the home page, the docs index or the docs site map. The home page states 99.5% uptime with no supporting document

SWE-2 Flash F

Best for People already using Devin Desktop or Devin CLI who want a cheaper, faster model for routine coding work such as automations, reviews and small changes, while it is free in November 2026.

Ahead on

  • Reliability, 50 against 28
  • Transparency & trust, 64 against 57

Watch for

No model API, OpenAPI entry or model card. The Devin API's session agents list SWE-2 but not SWE-2 Flash

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Agent ergonomics Novita AI +62

Novita AI 72

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). tools with a strict flag and a worked example. The list of models that support it is drawn by script, and tool_choice is absent from the chat reference (13 of 20). response_format takes json_object and json_schema with strict in the reference, while the FAQ says only json_object works (9 of 15). Prompt caching is automatic on supported models, cache-read prices are on the pricing page and cached_tokens is returned in usage (12 of 15). Context of 1M tokens on DeepSeek V4, GLM 5.3 and Kimi K3 per the pricing page. Output caps were not read (12 of 15). OpenAI-style files and batches with a 24-hour window, one model per file and an introductory 50 per cent discount (10). The OpenAI client works with a changed base URL. Both vendor SDK repositories are archived (5 of 10). Named error codes, a 429 that separates request and token limits, and a trace_id for support (11 of 15). Per the 9 October check, not re-read on 4 November, as the terms bar automated access to the site and docs.

SWE-2 Flash 10

Model reading (tool use, structured output, caching, context, batch, SDKs). Tool use is Devin's harness, not something a caller configures; no context length, output limit or cache price is published for SWE-2 Flash (5 of 25). No documented output-size or reasoning controls for this model; SWE-2's effort levels aren't stated for Flash (0 of 20). No model-level error documentation (0 of 20). No idempotency or retry guidance (0 of 20). One flag or picker selects it and devin -p runs a single turn and prints to stdout, but there is no SDK or direct endpoint (5 of 15). 5 + 0 + 0 + 0 + 5 = 10.

Schema & documentation Novita AI +33

Novita AI 62

Model reading. The OpenAPI 3.1.0 document at /.well-known/openapi.json is a 964-byte discovery file with four paths and no schemas, and the API reference is written by hand (6 of 25). llms.txt on both hosts, a Markdown copy of every docs page and an llms-full.txt (10). Guides for function calling, structured output, prompt caching, batch and reasoning say what each is for, and the chat reference describes 136 request and response fields (14 of 20). Fields are typed with required flags and defaults. Enums and ranges are stated in prose only (10 of 15). Curl and Python examples on each guide, error tables by product, a common errors guide and a table of which statuses are billed. The FAQ says json_schema and top_logprobs are unsupported while the reference and a guide document both (10 of 15). A dated changelog with 84 entries since February 2024. The API has no version scheme beyond /v1 (12 of 15). Per the 9 October check, not re-read on 4 November, as the terms bar automated access to the site and docs.

SWE-2 Flash 29

Model reading. No model API, so no OpenAPI entry; the Devin v3 OpenAPI file lists SWE-2 agents only, and no model card was found (0). docs.devin.ai serves llms.txt and Markdown copies of every page (10). The launch post says what it is for (automations, code review, feature development, documentation) and the CLI docs say when to pick a SWE model, but the models pages don't list SWE-2 Flash yet (6 of 20). No documented model ID, reasoning settings, context or output limits to type (0 of 15). The CLI pages show --model and /model examples, with no model-specific errors (3 of 15). Named, dated model versions on Cognition's blog and public release notes, but no release note for SWE-2 Flash yet; the newest is 2 November (10 of 15). 0 + 10 + 6 + 0 + 3 + 10 = 29.

Reliability SWE-2 Flash +22

Novita AI 28

Hosted reading. No status page was found. None is linked from the home page, the pricing page, the docs introduction, either llms.txt or the docs site map (0), so there is no incident record to read (0). The rate limit page documents five account tiers set by monthly top-ups, from under $50 to $10,000 and over, and limits counted in RPM and TPM per model. The figures per model are drawn by script and were not readable, so this line takes part marks (8 of 15). 429 with RATE_LIMIT_EXCEEDED or TOKEN_LIMIT_EXCEEDED, advice to throttle and use exponential backoff, and a billing page that says 429, 500, 503 and 504 are not charged. No Retry-After header was found (10 of 15). No SLA was found. The home page states 99.5% uptime, and the terms say availability is not guaranteed (0). Generally available (10). Per the 9 October check, not re-read on 4 November, as the terms bar automated access to the site and docs.

SWE-2 Flash 50

Model reading, for the surface it runs on, Devin Desktop and Devin CLI. Status page at www.devinstatus.com (Atlassian Statuspage) with Desktop Agent and Desktop Tab components besides the cloud ones, read on 4 November 2026 (20). The history feed for the 90 days from 6 August lists 'Devin unavailable' for 20 minutes on 13 August with no component named, read as across the board and a major as on the devin listing; Devin Cloud unavailable on 13 August and the web app down on 24 September name cloud surfaces this model doesn't use; the rest are degraded-performance incidents (new sessions on 3 September, 'multiple services' on 17 September, Ask Devin on 26 October, automation triggers on 4 November) and session queuing on 10 and 11 August, read as minor and a scheduled Devin Desktop extension marketplace upgrade on 7 August, read as maintenance. One major (10). No rate limit figures for the model or the CLI; usage is a daily and weekly quota with no numbers (0). No 429, backoff or retry guidance for this surface (0). Cognition publishes an SLA (25 February 2026) with uptime and response times that applies when included in an order form, read as a contractual SLA on Enterprise, as on other listings (10). The launch post makes it available today with no preview or beta label (10). 20 + 10 + 0 + 0 + 10 + 10 = 50.

Payments & pricing Novita AI +15

Novita AI 35

No machine payment protocol was found in the docs index, the site map, the pricing page or the skill repository (0). Per-token prices for each model on the pricing page without a login, such as deepseek/deepseek-v4.1-flash at $0.30 in and $1.20 out per 1M tokens (20). Two language models are listed as free and the FAQ describes a voucher for new users. Whether a card is needed to use either was not stated in the pages read (15 of 20). A person signs up in a browser, keys are created only in the console, and the OAuth route needs the user to sign in and approve (0). Per the 9 October check, not re-read on 4 November, as the terms bar automated access to the site and docs.

SWE-2 Flash 20

Published rubric. No payment protocol (0). Plan prices are public, but no per-token price for SWE-2 Flash is on a readable page; the docs' cost table loads in the browser and the post gives only 'one-fifth the price' of SWE-2 (10). Free through 30 November 2026 on Devin Desktop and CLI, but the docs say Free tier users only have SWE-1.6, so whether the Free plan reaches it, and without a card, isn't confirmed; the in-between value used on the devin listing (10). A person signs in through a browser (0). 0 + 10 + 10 + 0 = 20.

Maintenance & community Novita AI +13

Novita AI 66

Model reading. Changelog entries per the 27 October reading of each entry page, not re-read on 4 November because Novita's terms bar automated access to the site and its linked channels. The newest entry is dated 22 October 2026 (30). Retirement notices carry a UTC time and a replacement, with notice of 1 day (22 October for xiaomimimo/mimo-v2.5 at 00:00 UTC on 23 October) to 29 days (1 September for multimodal models on 30 September). No written notice period was found (6 of 12). Nine dated entries in the 90 days from 6 August (1, 8, 18, 20, 23 and 28 September, 15, 19 and 22 October), each read on its own page (8 of 8). A dated changelog, a Discord server and a support address per the 9 October check (12 of 15). novitalabs/python-sdk and novitalabs/javascript-sdk are archived, unchanged since 8 November 2024 and 4 March 2025, and issue replies were not examined (2 of 10). The docs rely on the OpenAI client, the SDK page still named the two archived packages on 9 October, and the skill repository is unchanged since 24 September 2026 (5 of 15). The JavaScript SDK repository has a publish workflow only and the Python one has none (3 of 10). 30 + 6 + 8 + 12 + 2 + 5 + 3 = 66.

SWE-2 Flash 53

Model reading. Released 4 November 2026 (30). Churn and notice in place of release counts: SWE-1.6, SWE-1.7, SWE-1.7 Lightning, SWE-2 (10 September) and now SWE-2 Flash in a few months, with no model deprecation notice period found and short names that move to the newest model (10 of 20). Public release notes and a support address, no public tracker (10 of 25). No official SDK for the model (0 of 15). The docs are kept current but don't yet cover this model (3 of 10). 30 + 10 + 10 + 0 + 3 = 53.

Security & auth Novita AI +12

Novita AI 65

Model reading. Bearer keys with the sk_ prefix, shown once, up to 10 an account, with an expiry of 24 hours, 30 days, 90 days or none fixed at creation, deletable in the console, and a per-key model access policy and source IP allowlist that can be set by API. OAuth with PKCE and the scopes api and balance:read is described in auth.md, with no token revocation endpoint. No documented way to send a key in a URL was found (26 of 30). The terms, re-read on 4 November and still updated 5 August 2026, say content is not used to train Novita's models or improve the services by default (17 of 20). The terms state zero data retention, with exceptions for law and for what is necessary to run or support the service, and allow automated safety screening. Batch input files are kept for 15 days (11 of 15). Billing can be queried per key, and budget, monitoring and metrics pages are listed in the docs index and were not read (7 of 15). The trust centre at trust.novita.ai is drawn by script and was not read. /.well-known/security.txt returns 404, and no disclosure policy or bug bounty was found (4 of 20). The key, retention and trust-centre readings are per the 9 October check, not re-read on 4 November.

SWE-2 Flash 53

Read as a hosted model reached through Devin's local clients. The CLI signs in through a browser, or the enterprise identity provider, and stores an API token in credentials.toml that by default is persistent and does not expire and carries the user's access, with no scopes found for it (10 of 30). Devin CLI documents an OS-level sandbox with network filtering, hooks that can block tool calls, and enterprise model allowlists and team settings (14 of 20). Guardrails against prompt injection are Enterprise only and cover user messages, as on the devin listing (8 of 15). Enterprise analytics count tool calls and consumption by model and user; no per-user audit log for the CLI was found (8 of 15). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address, no bug bounty and no security.txt, per the devin listing (13 of 20). Training: self-serve customer data may train Cognition's models by default, with an opt-out on paid plans that also turns on zero data retention at model providers. Cognition withheld the weights over cyber misuse, which is recorded as a fact, not scored. 10 + 14 + 8 + 8 + 13 = 53.

Score by category

CategoryWeight this runNovita AISWE-2 FlashEdge
Reliability16%202850SWE-2 Flash +22
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26229Novita AI +33
Agent ergonomics13%16.27210Novita AI +62
Security & auth14%17.56553Novita AI +12
Payments & pricing10%12.53520Novita AI +15
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.86653Novita AI +13
Transparency & trust7%8.85764SWE-2 Flash +7
Negative events≤150-2
TotalD 53.9/100F 36.4/100

Facts side by side

FactNovita AISWE-2 Flash
KindModel APIModel API
VendorNovita AICognition AI, Inc.
Hosted endpointhttps://api.novita.ai/openaino (local only)
TransportsHTTP
AuthAPI keyOAuth or key
PricingPay per useFreemium
x402nono
LicenceProprietary service under the Novita AI Terms of Service. The agent skill and the MCP server are MITProprietary model, used through Devin Desktop and Devin CLI under Cognition's Platform Terms of Service. The weights are not public; Cognition says it is building a programme to share them with industry partners and researchers
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-222026-11-04
Terms last updated2026-08-052026-06-30
Privacy policy last updated2026-05-132026-03-09
Customer content may train modelsnot found in the textyes, with an opt-out
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waiveryesyes
Popularity6 stars, 1.4k npm/wknone

How the scores have moved

Verdicts

Novita AI

Per-token prices for about 140 language models are public, and each key can carry an expiry, a model allowlist and a source IP allowlist. No status page, SLA or security.txt was found, the per-model rate limit figures are drawn by script, and both vendor SDK repositories are archived while the docs still point to them.

SWE-2 Flash

A new small coding model from Cognition that anyone can try free in Devin Desktop and Devin CLI until 30 November 2026, with strong vendor-reported coding scores. It has no model API, no published per-token price, context length or model card, and no public weights, so an agent can reach it only by driving Devin's own CLI.

Before you call either

Novita AI

  1. Set the OpenAI client base URL to https://api.novita.ai/openai and send the key as Authorization: Bearer. Keys start with sk_
  2. Do not close a connection to stop generation. A request that reached the model is billed in full under status 499, so cap output with max_tokens
  3. On 429, check whether the code is RATE_LIMIT_EXCEEDED or TOKEN_LIMIT_EXCEEDED and back off exponentially. No Retry-After header is documented
  4. Read the changelog for retirement notices before pinning a model id. One retirement in October 2026 came with 11 days' notice
  5. Ask the account owner for a key with an expiry, a model access policy and an IP allowlist. Keys are created and deleted only in the console

SWE-2 Flash

  1. There is no endpoint to call. Run Devin CLI single-turn with devin -p and pick the model with --model; the SWE-2 Flash model ID isn't documented yet, so check /model in the CLI first
  2. Don't rely on the short name swe. The docs say it resolves to the latest model in the family, which may be SWE-2 rather than SWE-2 Flash
  3. Plan for billing to start on 1 December 2026. The free period covers Devin Desktop and CLI only, not Devin cloud sessions
  4. Treat Cognition's benchmark figures as the vendor's. No independent result for SWE-2 Flash was found
  5. Keep credentials.toml private. The token in it doesn't expire by default and carries the signed-in user's access

Questions

Which is better for AI agents, Novita AI or SWE-2 Flash?

Novita AI scores 53.9 (D) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in 5 of 7 scored categories. SWE-2 Flash leads on reliability and transparency & trust.

Do Novita AI and SWE-2 Flash need an API key?

Novita AI needs an API key. SWE-2 Flash takes an API key or an OAuth sign-in.

Can an agent call Novita AI and SWE-2 Flash without installing anything?

Novita AI has a hosted endpoint at https://api.novita.ai/openai. No hosted endpoint is listed for SWE-2 Flash.

Other comparisons with Novita AI or SWE-2 Flash

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.