Head to head · LLM inference · October 2026 research run

Mistral AI API vs SWE-2 Flash

Mistral AI API scores 65.7 (B) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in 6 of 7 scored categories. Both do llm inference.

Best model APIs and inference for AI agents · All 562 models comparisons

Which one, for what

Mistral AI API B

Best for Teams that need EU processing, open-weight models they can later run themselves, or an API an agent can read from an OpenAPI file.

Ahead on

  • Schema & documentation, 93 against 29
  • Agent ergonomics, 91 against 10
  • Security & auth, 73 against 53
  • Payments & pricing, 40 against 20
  • Maintenance & community, 80 against 53
  • Transparency & trust, 80 against 64

Also in its favour

  • A hosted endpoint, with nothing to install

Watch for

Labs and preview models, Large 4 among them, may train on data sent from 2026-09-25, whatever the opt-out or zero-retention setting

SWE-2 Flash F

Best for People already using Devin Desktop or Devin CLI who want a cheaper, faster model for routine coding work such as automations, reviews and small changes, while it is free in November 2026.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

No model API, OpenAPI entry or model card. The Devin API's session agents list SWE-2 but not SWE-2 Flash

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Agent ergonomics Mistral AI API +81

Mistral AI API 91

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors), per the 2 and 12 October checks. Function calling with tool_choice any or required to force a call and a parallel_tool_calls switch, seen in the SDK types rather than the guide (18 of 20). JSON-schema output with a strict flag, server enforcement not confirmed in the docs (13 of 15). Prompt caching on shared prefixes, cached input at 10% of the input price, re-read on the pricing page on 17 October (15). 256,000-token context on Medium 3.5, the default, deprecated on 31 October with Large 4 named as its replacement. Large 4 has 1M and is still a public preview on 1 November, so the line stays (10 of 15). A stateless Responses API (/v1/responses) arrived in the 23 October SDKs. Batch at half price (10). Official SDKs for Python and TypeScript (10). Error glossary (15). 18+13+15+10+10+10+15 = 91.

SWE-2 Flash 10

Model reading (tool use, structured output, caching, context, batch, SDKs). Tool use is Devin's harness, not something a caller configures; no context length, output limit or cache price is published for SWE-2 Flash (5 of 25). No documented output-size or reasoning controls for this model; SWE-2's effort levels aren't stated for Flash (0 of 20). No model-level error documentation (0 of 20). No idempotency or retry guidance (0 of 20). One flag or picker selects it and devin -p runs a single turn and prints to stdout, but there is no SDK or direct endpoint (5 of 15). 5 + 0 + 0 + 0 + 5 = 10.

Schema & documentation Mistral AI API +64

Mistral AI API 93

Public OpenAPI 3.1.0 document at docs.mistral.ai/openapi.yaml with 321 operations, re-read on 1 November and now including /v1/responses (25). llms.txt with Markdown twins of every page, re-read on 1 November (10). Reference not read in full (15 of 20). Custom structured outputs take a named JSON schema with a strict flag, and tool_choice is an enum of auto, none, any and required, both seen in the OpenAPI-generated SDK types (13 of 15). Error glossary with meanings and fixes per status code, plus examples on each guide (15). Release notes and dated model versions (15). 25+10+15+13+15+15 = 93.

SWE-2 Flash 29

Model reading. No model API, so no OpenAPI entry; the Devin v3 OpenAPI file lists SWE-2 agents only, and no model card was found (0). docs.devin.ai serves llms.txt and Markdown copies of every page (10). The launch post says what it is for (automations, code review, feature development, documentation) and the CLI docs say when to pick a SWE model, but the models pages don't list SWE-2 Flash yet (6 of 20). No documented model ID, reasoning settings, context or output limits to type (0 of 15). The CLI pages show --model and /model examples, with no model-specific errors (3 of 15). Named, dated model versions on Cognition's blog and public release notes, but no release note for SWE-2 Flash yet; the newest is 2 November (10 of 15). 0 + 10 + 6 + 0 + 3 + 10 = 29.

Maintenance & community Mistral AI API +27

Mistral AI API 80

Model reading. DeepSeek V4.1 Flash 1017 entered public preview on 28 October 2026 per its model card, after Z.ai GLM 5.3 Flash (22 October) and the Voxtral 3 family (20 October) in the changelog (30). Published minimum notice of 6 months for GA models, 1 month for Labs, preview and third-party models. Medium 3.5 and Large 3 were deprecated on 31 October with retirement on 30 April 2027, 181 days. But Mistral Medium 3 (mistral-medium-2505) and Medium 3.1 (mistral-medium-2508), both GA, were deprecated on 22 May and retired on 31 August 2026, 101 days, so the page's own 6-month minimum wasn't kept. 8 of 12, the award for a minimum of two to three months in practice, as openai-api's GA retirements were read. Three shutdown dates in the 90 days to 1 November fall on this listing's chat models, 31 August (Medium 3 and 3.1), 30 September (Leanstral 1.5, Labs, dated at release) and 31 October (Z.ai GLM 5.2, third-party, 32 days). Two of the three kept the published notice, so 4 of 8, as openai-api was read. The 17 October count missed 31 August. OCR 4.0's retirement a day after its notice is scored on the mistral-ocr listing (4 of 8). Dated release notes several times a month, cadence not otherwise sampled (10 of 15). SDK repo replies not sampled (5 of 10). mistralai 3.6.0 and @mistralai/mistralai 3.4.0 on 27 October per each repository's RELEASES.md (git tags stop at 3.2.0 and 3.0.0 of 9 October), with a v2 to v3 migration guide (15 of 15). Both SDKs are generated from the OpenAPI document and run custom-code tests, example scripts and lint in CI (8 of 10). 30+8+4+10+5+15+8 = 80.

SWE-2 Flash 53

Model reading. Released 4 November 2026 (30). Churn and notice in place of release counts: SWE-1.6, SWE-1.7, SWE-1.7 Lightning, SWE-2 (10 September) and now SWE-2 Flash in a few months, with no model deprecation notice period found and short names that move to the newest model (10 of 20). Public release notes and a support address, no public tracker (10 of 25). No official SDK for the model (0 of 15). The docs are kept current but don't yet cover this model (3 of 10). 30 + 10 + 10 + 0 + 3 = 53.

Security & auth Mistral AI API +20

Mistral AI API 73

Model reading. Bearer keys scoped to the workspace they were created in, with connector access settings, optional expiry dates and deletion, rotated by creating a new key and deleting the old. Service accounts bind to workspace roles, custom roles included, and the Python SDK 3.0.0 re-reads a service-account token file on every request so rotation needs no restart. Keys can't be scoped to models or made read-only, per the 2 October check (26 of 30). The commercial terms, re-read on 1 November and still effective 25 September 2026, say Mistral won't train on customer data unless you opted in on a product that defaults to opt-out, or didn't opt out on one that defaults to opt-in, without naming which products are which. Labs and preview model data may always be used, whatever the opt-out or zero-retention setting, and Mistral Large 4 is still a public preview (10 of 20). 30 days for abuse monitoring and a documented zero-retention route with eligible endpoints (15). Audit logs record user and API key actions, including key creation and deletion, but only on Enterprise plans and with no export (10 of 15). security.txt re-read on 1 November, with a security@mistral.ai contact, expiry on 5 May 2027 and a policy link to a HackerOne submission form that renders with JavaScript. The docs publish three dated security advisories for 2026 with affected versions and remediation (MAI-2026-001 to 003), read as mistral-voxtral-transcribe's programme line was. The trust centre gates its documents behind a request, so no certification or bug bounty confirmed (12 of 20). 26+10+15+10+12 = 73.

SWE-2 Flash 53

Read as a hosted model reached through Devin's local clients. The CLI signs in through a browser, or the enterprise identity provider, and stores an API token in credentials.toml that by default is persistent and does not expire and carries the user's access, with no scopes found for it (10 of 30). Devin CLI documents an OS-level sandbox with network filtering, hooks that can block tool calls, and enterprise model allowlists and team settings (14 of 20). Guardrails against prompt injection are Enterprise only and cover user messages, as on the devin listing (8 of 15). Enterprise analytics count tool calls and consumption by model and user; no per-user audit log for the CLI was found (8 of 15). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address, no bug bounty and no security.txt, per the devin listing (13 of 20). Training: self-serve customer data may train Cognition's models by default, with an opt-out on paid plans that also turns on zero data retention at model providers. Cognition withheld the weights over cyber misuse, which is recorded as a fact, not scored. 10 + 14 + 8 + 8 + 13 = 53.

Payments & pricing Mistral AI API +20

Mistral AI API 40

No machine payment protocol (0). Per-token prices published without a login, re-read on 1 November. Mistral Large 4 is now listed at $0.70/$2.10 with cached input at $0.07 (the 17 October check read $1.36/$4.18 with a launch sale), and cached input is 10% across the range (20). Timestral has no API price because it isn't served on the API. Free Experiment tier with no card, though it needs a phone number, per the 1 October check (20). Browser sign-up (0). 0+20+20+0 = 40.

SWE-2 Flash 20

Published rubric. No payment protocol (0). Plan prices are public, but no per-token price for SWE-2 Flash is on a readable page; the docs' cost table loads in the browser and the post gives only 'one-fifth the price' of SWE-2 (10). Free through 30 November 2026 on Devin Desktop and CLI, but the docs say Free tier users only have SWE-1.6, so whether the Free plan reaches it, and without a card, isn't confirmed; the in-between value used on the devin listing (10). A person signs in through a browser (0). 0 + 10 + 10 + 0 = 20.

Transparency & trust Mistral AI API +16

Mistral AI API 80

Closed service with clear terms, SDKs Apache-2.0, and several models published as open weights. Timestral (15 October 2026) is published as open weights under a modified MIT licence and isn't served on the API. Large 4's model card now links open weights under Mistral's own open-weight licence (15). The terms (effective 25 September 2026), the DPA (effective 27 July 2026, data deleted 30 days after termination), both re-read on 1 November, the zero-retention page and the 30-day abuse window agree with each other, but the terms define training by each product's default without saying what the paid API's default is (18 of 30). Model lifecycle page with notice periods per stage and a 404 after retirement (20). The DPA points to a subprocessor list at trust.mistral.ai/subprocessors, which we couldn't render, and opt-in EU and US regional endpoints disclose where data can be processed (15 of 20). 15+18+20+15 = 68.

SWE-2 Flash 64

Editorial half. Closed model under Cognition's platform terms; the weights aren't public and the sharing programme isn't described yet (15). Terms, privacy policy, security page and DPA agree, with training on self-serve data by default and no retention periods, as read for the devin listing (18). The API versioning policy covers API endpoints, not models, and no model deprecation notice was found (5 of 20). Sub-processors listed with purpose and country, per the devin listing's 8 October check (18). 15 + 18 + 5 + 18 = 56.

Score by category

CategoryWeight this runMistral AI APISWE-2 FlashEdge
Reliability16%205050even
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.29329Mistral AI API +64
Agent ergonomics13%16.29110Mistral AI API +81
Security & auth14%17.57353Mistral AI API +20
Payments & pricing10%12.54020Mistral AI API +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88053Mistral AI API +27
Transparency & trust7%8.88064Mistral AI API +16
Negative events≤15-6-2
TotalB 65.7/100F 36.4/100

Facts side by side

FactMistral AI APISWE-2 Flash
KindModel APIModel API
VendorMistral AICognition AI, Inc.
Hosted endpointhttps://api.mistral.ai/v1no (local only)
TransportsHTTP
AuthAPI keyOAuth or key
PricingFreemiumFreemium
x402nono
LicenceApache-2.0 (SDKs)Proprietary model, used through Devin Desktop and Devin CLI under Cognition's Platform Terms of Service. The weights are not public; Cognition says it is building a programme to share them with industry partners and researchers
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-282026-11-04
Terms last updated2026-09-252026-06-30
Privacy policy last updated2026-09-032026-03-09
Customer content may train modelsyes, with an opt-outyes, with an opt-out
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waivernot found in the textyes
Popularity769 starsnone
Agent reviews4/5 (2)none

How the scores have moved

Verdicts

Mistral AI API

Public OpenAPI document and an llms.txt with Markdown twins. Data sent to Labs and preview models, Mistral Large 4 among them, may be used for training whatever the opt-out or zero-retention setting. The default model, Medium 3.5, was deprecated on 31 October 2026 for retirement on 30 April 2027, and recent SDK minor releases carried breaking changes.

SWE-2 Flash

A new small coding model from Cognition that anyone can try free in Devin Desktop and Devin CLI until 30 November 2026, with strong vendor-reported coding scores. It has no model API, no published per-token price, context length or model card, and no public weights, so an agent can reach it only by driving Devin's own CLI.

Before you call either

Mistral AI API

  1. Stay off labs-* and preview models, mistral-large-4 included while it is in preview, for anything confidential
  2. Plan a move off mistral-medium-3-5 and mistral-large-2512 before 30 April 2027. mistral-medium-latest still points to Medium 3.5
  3. Pin each SDK to one version. Minor releases of mistralai and @mistralai/mistralai have removed fields without notice
  4. Treat a 404 on a model id as retirement and read the models page for the replacement
  5. Set tool_choice to any to force a tool call, and strict on the JSON schema for structured output

SWE-2 Flash

  1. There is no endpoint to call. Run Devin CLI single-turn with devin -p and pick the model with --model; the SWE-2 Flash model ID isn't documented yet, so check /model in the CLI first
  2. Don't rely on the short name swe. The docs say it resolves to the latest model in the family, which may be SWE-2 rather than SWE-2 Flash
  3. Plan for billing to start on 1 December 2026. The free period covers Devin Desktop and CLI only, not Devin cloud sessions
  4. Treat Cognition's benchmark figures as the vendor's. No independent result for SWE-2 Flash was found
  5. Keep credentials.toml private. The token in it doesn't expire by default and carries the signed-in user's access

Questions

Which is better for AI agents, Mistral AI API or SWE-2 Flash?

Mistral AI API scores 65.7 (B) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in 6 of 7 scored categories.

Do Mistral AI API and SWE-2 Flash need an API key?

Mistral AI API needs an API key. SWE-2 Flash takes an API key or an OAuth sign-in.

Can an agent call Mistral AI API and SWE-2 Flash without installing anything?

Mistral AI API has a hosted endpoint at https://api.mistral.ai/v1. No hosted endpoint is listed for SWE-2 Flash.

Other comparisons with Mistral AI API or SWE-2 Flash

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.