Head to head · LLM inference · October 2026 research run

RouterPlus vs SWE-2 Flash

RouterPlus scores 50.3 (D) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in 4 of 7 scored categories. SWE-2 Flash leads on reliability, maintenance & community and transparency & trust. Both do llm inference.

Best model APIs and inference for AI agents · All 562 models comparisons

Which one, for what

RouterPlus D

Best for Teams that call Claude, GPT and open-weight models from one key and want the cost of every call in the response, with their own provider keys where they have them.

Ahead on

  • Schema & documentation, 59 against 29
  • Agent ergonomics, 71 against 10
  • Security & auth, 59 against 53
  • Payments & pricing, 40 against 20

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

No terms of service, privacy policy, status page, changelog or security.txt found for the gateway

SWE-2 Flash F

Best for People already using Devin Desktop or Devin CLI who want a cheaper, faster model for routine coding work such as automations, reviews and small changes, while it is free in November 2026.

Ahead on

  • Reliability, 50 against 42
  • Maintenance & community, 53 against 44
  • Transparency & trust, 64 against 41

Watch for

No model API, OpenAPI entry or model card. The Devin API's session agents list SWE-2 but not SWE-2 Flash

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Agent ergonomics RouterPlus +61

RouterPlus 71

Router, read on the model lines (tool use, structured output, caching, context, batch, SDKs, errors). Tools pass through on both surfaces, and Anthropic server tools such as web search work for Claude models on /v1/messages. Behaviour depends on the model (15 of 20). response_format works for GPT ids and the open models (re-read on 4 November 2026), and the docs tell callers to get JSON from Claude through a single tool, so structured output still rests on the provider (8 of 15, held). Cached-input and cache-write prices per model, a session id that keeps provider caches warm, and cache_control on the Anthropic surface (13 of 15). The catalogue's largest contexts are 1,050,000 tokens on GPT-6.1 Sol and 1,000,000 on Claude Sonnet 5.5, a judgement call since a router has no default model (15). No batch route (0 of 10). No SDK of its own. The OpenAI and Anthropic SDKs work with a changed base URL, and the docs give setups for ten coding tools (5 of 10). A stable error_type in every body and header, an origin header, the limit that refused a request, and x-tm-dropped-params naming every dropped field (15).

SWE-2 Flash 10

Model reading (tool use, structured output, caching, context, batch, SDKs). Tool use is Devin's harness, not something a caller configures; no context length, output limit or cache price is published for SWE-2 Flash (5 of 25). No documented output-size or reasoning controls for this model; SWE-2's effort levels aren't stated for Flash (0 of 20). No model-level error documentation (0 of 20). No idempotency or retry guidance (0 of 20). One flag or picker selects it and devin -p runs a single turn and prints to stdout, but there is no SDK or direct endpoint (5 of 15). 5 + 0 + 0 + 0 + 5 = 10.

Schema & documentation RouterPlus +30

RouterPlus 59

Router, scored on the API lines. No OpenAPI or other machine-readable contract for the gateway was found. It follows the OpenAI and Anthropic wire formats, which this checklist doesn't credit to a reseller, the same reading as Antseed (0 of 25). llms.txt, llms-full.txt and a Markdown copy of every page (10). Each route page says what it is for, what isn't available, and which route to use for which model, and the agent integration guide lists what not to build on (18 of 20). Request fields follow the upstream formats, and the wire compatibility page tables which fields pass, translate, drop or fail with a typed 400 (12 of 15). Curl, Python and TypeScript examples on every page, and an error reference with a class, status and remedy for each error (15). Routes are versioned under /v1 and the wire compatibility page says changing it needs a recorded decision, but no changelog or dated release notes were found, re-read on 4 November 2026 (4 of 15).

SWE-2 Flash 29

Model reading. No model API, so no OpenAPI entry; the Devin v3 OpenAPI file lists SWE-2 agents only, and no model card was found (0). docs.devin.ai serves llms.txt and Markdown copies of every page (10). The launch post says what it is for (automations, code review, feature development, documentation) and the CLI docs say when to pick a SWE model, but the models pages don't list SWE-2 Flash yet (6 of 20). No documented model ID, reasoning settings, context or output limits to type (0 of 15). The CLI pages show --model and /model examples, with no model-specific errors (3 of 15). Named, dated model versions on Cognition's blog and public release notes, but no release note for SWE-2 Flash yet; the newest is 2 November (10 of 15). 0 + 10 + 6 + 0 + 3 + 10 = 29.

Transparency & trust SWE-2 Flash +23

RouterPlus 41

Closed service with no terms of service found. The only terms on the site govern the capacity request form, under EVO HQ Inc (0 of 30). The data policy page is detailed, lists what is stored and why, and gives a 30-day period for request logs and each provider's retention flag. Its 4 November 2026 text, which logs request content by default, no longer agrees with the homepage FAQ; that contradiction is charged once as a misleading claim under negative events, not on this line. There is no privacy policy, no DPA and no retention period for account data such as email addresses (14 of 30, held). Model retirement by deprecation_date is documented with no notice period, and no dated deprecation notices were found (4 of 20). The docs name Clerk, Resend and an AWS bucket, and say RouterPlus's own GPUs run in the United States. The form's terms name Supabase, Cloudflare and Resend. No complete subprocessor list or gateway hosting location was found (8 of 20).

SWE-2 Flash 64

Editorial half. Closed model under Cognition's platform terms; the weights aren't public and the sharing programme isn't described yet (15). Terms, privacy policy, security page and DPA agree, with training on self-serve data by default and no retention periods, as read for the devin listing (18). The API versioning policy covers API endpoints, not models, and no model deprecation notice was found (5 of 20). Sub-processors listed with purpose and country, per the devin listing's 8 October check (18). 15 + 18 + 5 + 18 = 56.

Payments & pricing RouterPlus +20

RouterPlus 40

No machine payment protocol found in llms-full.txt. Calls draw on a prepaid balance (0). Per-token prices for every model are public in the docs catalogue and on the model pages with no login, re-read on 4 November 2026 (20). Signup adds no free credit, but inference through the caller's own provider keys carries no RouterPlus charge and needs no credit, the reading Cloudflare AI Gateway's dossier took for the same arrangement. We did not sign up to confirm that no card is asked for (20). A person signs up in the browser through Clerk with email verification, and the programmatic signup route was removed (0).

SWE-2 Flash 20

Published rubric. No payment protocol (0). Plan prices are public, but no per-token price for SWE-2 Flash is on a readable page; the docs' cost table loads in the browser and the post gives only 'one-fifth the price' of SWE-2 (10). Free through 30 November 2026 on Devin Desktop and CLI, but the docs say Free tier users only have SWE-1.6, so whether the Free plan reaches it, and without a card, isn't confirmed; the in-between value used on the devin listing (10). A person signs in through a browser (0). 0 + 10 + 10 + 0 = 20.

Maintenance & community SWE-2 Flash +9

RouterPlus 44

Router, read on the model lines. No changelog or release notes found. The blog, re-read on 4 November 2026, dates the launch of ScaleDown's extract-1 and summarize-1 on chat completions and classify-1 on the decisions API to 13 October 2026, and the catalogue now lists 105 chat models against 19 on 13 October, so the API changed within the last 30 days (30). The docs also date a console change on 17 October 2026 (keys can be copied again), which isn't counted, since it changes the console and not the API. Models carry a deprecation_date that delists them automatically, with no notice period stated (3 of 12). POST /v1/signup and the magic-link route were removed and Optimize is paused, none with a date we could find (3 of 8). No public changelog. Support is reached through the console and an email address, and wasn't tested (3 of 15). No public issue tracker for the gateway (0 of 10). No official SDK. The docs rely on the OpenAI and Anthropic SDKs and give client setups (5 of 15). No package or public repository to check (0 of 10).

SWE-2 Flash 53

Model reading. Released 4 November 2026 (30). Churn and notice in place of release counts: SWE-1.6, SWE-1.7, SWE-1.7 Lightning, SWE-2 (10 September) and now SWE-2 Flash in a few months, with no model deprecation notice period found and short names that move to the newest model (10 of 20). Public release notes and a support address, no public tracker (10 of 25). No official SDK for the model (0 of 15). The docs are kept current but don't yet cover this model (3 of 10). 30 + 10 + 10 + 0 + 3 = 53.

Reliability SWE-2 Flash +8

RouterPlus 42

Hosted reading. No status page found. Model pages show each provider's uptime over the last 24 hours and no incident history, and status.routerplus.com failed at our proxy again on 4 November 2026 (0). No readable incident history (5). The limits page, re-read on 4 November 2026, gives 20 requests a minute until the organisation's first purchase, then 300 per console key and 60 for the managed Playground key, with token-per-minute and in-flight limits per organisation and key (15). Rate-limit 429s carry retry-after from 1 to 59 seconds and metadata.retry_at, the errors page gives a retry or no-retry rule for each error class, and the docs say a retry is a new billed request because there is no idempotency key. That is safe-retry guidance without keys on the billed call, the value this run settled for routers such as ramp-router (12, 15 before). The homepage says "Production-grade SLAs", but no SLA terms were found, and the only terms on the site say a stated response time is not a service level (0). The chat and messages surfaces carry no beta label. The Responses API is a preview for non-OpenAI models and Optimize is paused, neither of which is the main surface (10). 0 + 5 + 15 + 12 + 0 + 10 = 42.

SWE-2 Flash 50

Model reading, for the surface it runs on, Devin Desktop and Devin CLI. Status page at www.devinstatus.com (Atlassian Statuspage) with Desktop Agent and Desktop Tab components besides the cloud ones, read on 4 November 2026 (20). The history feed for the 90 days from 6 August lists 'Devin unavailable' for 20 minutes on 13 August with no component named, read as across the board and a major as on the devin listing; Devin Cloud unavailable on 13 August and the web app down on 24 September name cloud surfaces this model doesn't use; the rest are degraded-performance incidents (new sessions on 3 September, 'multiple services' on 17 September, Ask Devin on 26 October, automation triggers on 4 November) and session queuing on 10 and 11 August, read as minor and a scheduled Devin Desktop extension marketplace upgrade on 7 August, read as maintenance. One major (10). No rate limit figures for the model or the CLI; usage is a daily and weekly quota with no numbers (0). No 429, backoff or retry guidance for this surface (0). Cognition publishes an SLA (25 February 2026) with uptime and response times that applies when included in an order form, read as a contractual SLA on Enterprise, as on other listings (10). The launch post makes it available today with no preview or beta label (10). 20 + 10 + 0 + 0 + 10 + 10 = 50.

Score by category

CategoryWeight this runRouterPlusSWE-2 FlashEdge
Reliability16%204250SWE-2 Flash +8
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.25929RouterPlus +30
Agent ergonomics13%16.27110RouterPlus +61
Security & auth14%17.55953RouterPlus +6
Payments & pricing10%12.54020RouterPlus +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.84453SWE-2 Flash +9
Transparency & trust7%8.84164SWE-2 Flash +23
Negative events≤15-2-2
TotalD 50.3/100F 36.4/100

Facts side by side

FactRouterPlusSWE-2 Flash
KindModel routerModel API
VendorRouterPlusCognition AI, Inc.
Hosted endpointhttps://api.routerplus.com/v1no (local only)
TransportsHTTP
AuthAPI keyOAuth or key
PricingPay per useFreemium
x402nono
LicenceClosed service. No terms of service for the gateway were found on routerplus.com or app.routerplus.com on 13 October 2026. The only terms on the site govern the capacity request form and name EVO HQ Inc, a Delaware corporation (https://routerplus.com/capacity/terms/).Proprietary model, used through Devin Desktop and Devin CLI under Cognition's Platform Terms of Service. The weights are not public; Cognition says it is building a programme to share them with industry partners and researchers
Read-only variant documentednono
llms.txtyesyes
Last releasenone2026-11-04
Terms last updatedno document linked2026-06-30
Privacy policy last updatedno document linked2026-03-09
Customer content may train modelsnot read yetyes, with an opt-out
Terms restrict automated accessnot read yetnot found in the text
Terms restrict benchmarkingnot read yetyes
Terms or service can change without noticenot read yetnot found in the text
Arbitration or class-action waivernot read yetyes

How the scores have moved

Verdicts

RouterPlus

The docs are written for agents, every model price is public, and each response carries its own cost. No terms of service, privacy policy, status page or changelog were found. Request content is now logged for 30 days by default while the homepage says prompts aren't stored, and signup adds no free credit.

SWE-2 Flash

A new small coding model from Cognition that anyone can try free in Devin Desktop and Devin CLI until 30 November 2026, with strong vendor-reported coding scores. It has no model API, no published per-token price, context length or model card, and no public weights, so an agent can reach it only by driving Devin's own CLI.

Before you call either

RouterPlus

  1. Send max_tokens on every request. Without it the balance hold assumes up to 32,768 output tokens and can return insufficient_quota on a small balance
  2. Switch on error_type. Retry rate_limit after retry-after, and stop on insufficient_quota, which needs a person to add credit or raise a cap
  3. Don't add a retry loop on top of the SDK's. There is no idempotency key, so a retry that reaches a provider is billed again
  4. Keep secrets out of prompts. Request content is logged for up to 30 days unless the organisation has opted out through support
  5. Use /v1/messages for Claude when you need thinking or server tools. response_format works for GPT ids and open models, not Claude

SWE-2 Flash

  1. There is no endpoint to call. Run Devin CLI single-turn with devin -p and pick the model with --model; the SWE-2 Flash model ID isn't documented yet, so check /model in the CLI first
  2. Don't rely on the short name swe. The docs say it resolves to the latest model in the family, which may be SWE-2 rather than SWE-2 Flash
  3. Plan for billing to start on 1 December 2026. The free period covers Devin Desktop and CLI only, not Devin cloud sessions
  4. Treat Cognition's benchmark figures as the vendor's. No independent result for SWE-2 Flash was found
  5. Keep credentials.toml private. The token in it doesn't expire by default and carries the signed-in user's access

Questions

Which is better for AI agents, RouterPlus or SWE-2 Flash?

RouterPlus scores 50.3 (D) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in 4 of 7 scored categories. SWE-2 Flash leads on reliability, maintenance & community and transparency & trust.

Do RouterPlus and SWE-2 Flash need an API key?

RouterPlus needs an API key. SWE-2 Flash takes an API key or an OAuth sign-in.

Can an agent call RouterPlus and SWE-2 Flash without installing anything?

RouterPlus has a hosted endpoint at https://api.routerplus.com/v1. No hosted endpoint is listed for SWE-2 Flash.

Other comparisons with RouterPlus or SWE-2 Flash

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.