Claude API vs SWE-2 Flash

Claude API 95

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Tool use with parallel calls, 15 of 20 because tool_choice any or tool returns 400 on Opus 5.5, Sonnet 5.5, Fable 5.1 and Mythos 5.1, re-read 1 November, so a tool can't be forced on the larger current models. Structured outputs GA (15). Prompt caching with reads at 0.1x input, 0.05x on Opus 5.5 and Sonnet 5.5 and 0.025x on Fable 5.1 and Mythos 5.1 (15). 1M context on the default model (15). Batch at half price (10). Official SDKs in Python, TypeScript, Java, Go, Ruby, C# and PHP, all with new major versions on 21 October (10). Documented error types, retry-after and SDK retries with backoff (15). The request size limit for Messages and token counting rose from 32 MB to 128 MB on 28 October. 15 + 15 + 15 + 15 + 10 + 10 + 15 = 95.

SWE-2 Flash 10

Model reading (tool use, structured output, caching, context, batch, SDKs). Tool use is Devin's harness, not something a caller configures; no context length, output limit or cache price is published for SWE-2 Flash (5 of 25). No documented output-size or reasoning controls for this model; SWE-2's effort levels aren't stated for Flash (0 of 20). No model-level error documentation (0 of 20). No idempotency or retry guidance (0 of 20). One flag or picker selects it and devin -p runs a single turn and prints to stdout, but there is no SDK or direct endpoint (5 of 15). 5 + 0 + 0 + 0 + 5 = 10.

Claude API 90

No OpenAPI document in the docs. The Python SDK repository bundles a Stainless-generated OpenAPI 3.1 file (scripts/mock-spec.json.gz, 234 paths including /v1/messages, last changed 23 October, read from a clone on 1 November), which we count as half a contract (15 of 25, a judgement call). The akeyless and basecamp dossiers gave 25 for an OpenAPI file kept in an SDK repository. This one is the gzipped mock-server spec under scripts/ and the docs don't link it, so we keep the stricter reading. llms.txt indexes 845 pages, each with a Markdown twin, re-read 1 November (10). The reference documents each parameter and the models page says to start with Opus 5.5 for most workloads (20). Structured outputs and strict tool use are GA with grammar-constrained sampling, though the API doesn't enforce minimum, maximum, minLength or maxLength and the SDKs move them into descriptions, per the 15 October check (15). The errors page lists 11 error types with a request_id, re-read 1 November, and examples run through the docs (15). anthropic-version header, with a second version, 2026-10-21, released on 21 October beside 2023-06-01 and documented with a migration guide, and dated release notes with an RSS feed, newest 30 October (15). 15 + 10 + 20 + 15 + 15 + 15 = 90.

SWE-2 Flash 29

Model reading. No model API, so no OpenAPI entry; the Devin v3 OpenAPI file lists SWE-2 agents only, and no model card was found (0). docs.devin.ai serves llms.txt and Markdown copies of every page (10). The launch post says what it is for (automations, code review, feature development, documentation) and the CLI docs say when to pick a SWE model, but the models pages don't list SWE-2 Flash yet (6 of 20). No documented model ID, reasoning settings, context or output limits to type (0 of 15). The CLI pages show --model and /model examples, with no model-specific errors (3 of 15). Named, dated model versions on Cognition's blog and public release notes, but no release note for SWE-2 Flash yet; the newest is 2 November (10 of 15). 0 + 10 + 6 + 0 + 3 + 10 = 29.

Claude API 92

Model reading. Personal and service-account keys for one workspace or several, chosen at creation, with expiry from 3 hours to never (capped by org policy), disable and delete, plus Workload Identity Federation for short-lived tokens, re-read 1 November. No permission scopes below the workspace, so 25 of 30 (a judgement call, OpenAI's endpoint-scoped keys get 30). No training on API data without express permission, per the 15 October check (20). Conversation content is not retained by default except on the Covered Models (Fable 5.1, Mythos 5.1, Fable 5 and Mythos 5), which require 30-day retention and are outside ZDR unless Anthropic expressly authorises it, re-read 1 November, and the privacy centre caps retention at 30 days, per the 15 October check (12 of 15). Usage and Cost API (legacy from 29 October, replaced by the Usage and Cost Analytics API in beta with per-key and per-user grouping), a Compliance API activity feed, and OpenTelemetry export of Messages API spans in beta since 14 October (15). security.txt valid to 2026-12-31 with a HackerOne contact and a disclosure policy, re-read 1 November, and SOC 2 Type I and Type II, ISO 27001:2022 and ISO/IEC 42001:2023, per the 15 October check (20). 25 + 20 + 12 + 15 + 20 = 92.

SWE-2 Flash 53

Read as a hosted model reached through Devin's local clients. The CLI signs in through a browser, or the enterprise identity provider, and stores an API token in credentials.toml that by default is persistent and does not expire and carries the user's access, with no scopes found for it (10 of 30). Devin CLI documents an OS-level sandbox with network filtering, hooks that can block tool calls, and enterprise model allowlists and team settings (14 of 20). Guardrails against prompt injection are Enterprise only and cover user messages, as on the devin listing (8 of 15). Enterprise analytics count tool calls and consumption by model and user; no per-user audit log for the CLI was found (8 of 15). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address, no bug bounty and no security.txt, per the devin listing (13 of 20). Training: self-serve customer data may train Cognition's models by default, with an opt-out on paid plans that also turns on zero data retention at model providers. Cognition withheld the weights over cyber misuse, which is recorded as a fact, not scored. 10 + 14 + 8 + 8 + 13 = 53.

Claude API 91

Model reading. The newest release notes are dated 28 October (request size limit raised to 128 MB), 29 October (Usage and Cost Analytics API in beta) and 30 October 2026 (fast mode on Opus 4.8 deprecated, removal on 30 November) (30). Published minimum notice of 60 days for model retirements, by email and in the docs, re-read 1 November; the Opus 4.8 fast mode removal gets 31 days, which the 60-day policy doesn't cover since the model stays, and the feature is a research preview on that model (8 of 12). One model shutdown date in the last 90 days, Opus 4.1 on 5 August, kept to its notice (8 of 8). Dated release notes several times a week and a support centre (15 of 15). The Python SDK had 52 open issues, and a sampled strict-tool bug opened on 10 September had no reply three weeks later, per the 1 October check, not re-read (5 of 10). Current official SDKs, Python anthropic 2.3.0 and TypeScript sdk-v1.3.0, both tagged 23 October, after new major versions (Python 2.0.0, TypeScript 1.0.0) on 21 October that send API version 2026-10-21 by default (15). Supported runtimes stated, Python 3.10 to 3.14 (10). 30 + 8 + 8 + 15 + 5 + 15 + 10 = 91.

SWE-2 Flash 53

Model reading. Released 4 November 2026 (30). Churn and notice in place of release counts: SWE-1.6, SWE-1.7, SWE-1.7 Lightning, SWE-2 (10 September) and now SWE-2 Flash in a few months, with no model deprecation notice period found and short names that move to the newest model (10 of 20). Public release notes and a support address, no public tracker (10 of 25). No official SDK for the model (0 of 15). The docs are kept current but don't yet cover this model (3 of 10). 30 + 10 + 10 + 0 + 3 = 53.

Claude API 85

Closed service with clear commercial terms (effective 17 June 2025, re-read 1 November, with Anthropic Ireland, Limited as the contracting party for customers in the EEA, Switzerland and the UK and Anthropic, PBC elsewhere, per the 15 October check). The SDKs moved from MIT to Apache 2.0 with the major versions of 21 October, both OSI licences (15). The privacy policy is effective 10 September 2026, re-read 1 November. Retention is stated two ways, 'not retained by default' in the docs (except the Covered Models, which require 30 days) and 'automatically delete inputs and outputs on our backend within 30 days' in the privacy centre article updated 1 July 2026, per the 15 October check, so an operator can't tell which applies to a given call (20 of 30). Deprecation page with announcement and retirement dates (20). Processing countries named (US, Europe, Asia, Australia) and storage stated as US in the privacy centre, per the 15 October check, with the subprocessor list at trust.anthropic.com per the 1 October check (20). 15 + 20 + 20 + 20 = 75.

SWE-2 Flash 64

Editorial half. Closed model under Cognition's platform terms; the weights aren't public and the sharing programme isn't described yet (15). Terms, privacy policy, security page and DPA agree, with training on self-serve data by default and no retention periods, as read for the devin listing (18). The API versioning policy covers API endpoints, not models, and no model deprecation notice was found (5 of 20). Sub-processors listed with purpose and country, per the devin listing's 8 October check (18). 15 + 18 + 5 + 18 = 56.

Claude API 60

Status page at status.claude.com with component history (20). In the last 90 days (3 August to 1 November) the history pages, re-read 1 November (status.claude.com's robots.txt disallows /api/, so the incident API wasn't used), label many API incidents major and two critical, among them elevated errors across many models on 4 August (20:48 to 21:59 UTC), a critical service disruption on 16 August (21:58 to 22:34 UTC), elevated errors on Claude models on 24 August (04:50 to 07:36 UTC by the resolution note), on Mythos 5.1, Fable 5.1 and Opus 5 on 3 September (posted 13:26, impact ended 16:16 UTC), on multiple models on 22 September (posted 00:57, resolved 02:35 UTC) and on claude.ai, Claude Code, Cowork and the API on 29 September (14:00 to 14:59 UTC), so several majors (0). Since 17 October the history adds a critical incident on 23 October (Fable 5.1, Sonnet 5.5, Haiku 5.5 and fast mode on Opus 5.5, 23:28 to 23:59 UTC), and majors on Opus 5.5 on 24 October (00:31 to 00:37 UTC), Fable 5 and 5.1 on 24 October (05:16 to 05:53 UTC), Sonnet 5.5 and other models on 25 October (06:05 to 06:35 UTC by the resolution note), Fable 5.1 on 25 October (08:17 to 08:49 UTC) and Sonnet 5.5 twice on 27 October (09:14 to 09:56 and 15:09 to 15:50 UTC). The 21 and 29 July incidents left the window. Rate limits published per model, 4,000 requests a minute at the Start tier on Opus 5.5, Sonnet 5.5, Haiku 5.5 and Fable 5.x and 1,000 on older models, re-read 1 November (15). 429s carry retry-after (except the spend-cap 429) and the SDKs retry with backoff (15). No SLA on sale. Priority Tier capacity commitments are no longer available for purchase, re-read 1 November, and a target isn't a commitment (0, a judgement call). Messages API is GA (10). 20 + 0 + 15 + 15 + 0 + 10 = 60. Graded by agents running on Claude, by the same checklist as every other listing.

SWE-2 Flash 50

Model reading, for the surface it runs on, Devin Desktop and Devin CLI. Status page at www.devinstatus.com (Atlassian Statuspage) with Desktop Agent and Desktop Tab components besides the cloud ones, read on 4 November 2026 (20). The history feed for the 90 days from 6 August lists 'Devin unavailable' for 20 minutes on 13 August with no component named, read as across the board and a major as on the devin listing; Devin Cloud unavailable on 13 August and the web app down on 24 September name cloud surfaces this model doesn't use; the rest are degraded-performance incidents (new sessions on 3 September, 'multiple services' on 17 September, Ask Devin on 26 October, automation triggers on 4 November) and session queuing on 10 and 11 August, read as minor and a scheduled Devin Desktop extension marketplace upgrade on 7 August, read as maintenance. One major (10). No rate limit figures for the model or the CLI; usage is a daily and weekly quota with no numbers (0). No 429, backoff or retry guidance for this surface (0). Cognition publishes an SLA (25 February 2026) with uptime and response times that applies when included in an order form, read as a contractual SLA on Enterprise, as on other listings (10). The launch post makes it available today with no preview or beta label (10). 20 + 10 + 0 + 0 + 10 + 10 = 50.