Meta Model API vs SWE-2 Flash

Meta Model API 75

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Tool calls on all three endpoints, parallel calls, tool search with deferred loading, built-in web search and a computer-use tool, but tool_choice accepts only auto, so a call can't be forced or forbidden (15 of 20). Output constrained to the JSON Schema on every surface (15). Automatic prompt caching with no setup, and cached input at 5 per cent of the input price on Muse Wonder (15). 1,048,576-token context on Muse Wonder and every Muse Spark version, with no long-context premium (15). No batch endpoint or discount found. Background responses run asynchronously at the normal price (0). No SDK of Meta's own. The docs use the OpenAI and Anthropic SDKs against compatible endpoints, the same reading as StepFun (0). OpenAI-style error envelope with type and code, per-status fixes and named retryable codes (15). 15 + 15 + 15 + 15 + 0 + 0 + 15 = 75.

SWE-2 Flash 10

Model reading (tool use, structured output, caching, context, batch, SDKs). Tool use is Devin's harness, not something a caller configures; no context length, output limit or cache price is published for SWE-2 Flash (5 of 25). No documented output-size or reasoning controls for this model; SWE-2's effort levels aren't stated for Flash (0 of 20). No model-level error documentation (0 of 20). No idempotency or retry guidance (0 of 20). One flag or picker selects it and devin -p runs a single turn and prints to stdout, but there is no SDK or direct endpoint (5 of 15). 5 + 0 + 0 + 0 + 5 = 10.

Meta Model API 60

No OpenAPI or similar machine-readable contract found. The reference is Markdown pages with schema sections, and /openapi.json paths on dev.meta.ai return 404 (0). llms.txt at dev.meta.ai/llms.txt, and every docs page has a Markdown copy (10). The models page says when to choose Muse Wonder and when Muse Spark, and the tool-calling and structured-output guides state their limits, such as tool_choice only accepting auto and which schema keywords strict allows (16 of 20). JSON Schema tools and output, reasoning_effort an enum from minimal to max, a strict subset that returns 400 when violated, though tool_choice has one value (12 of 15). Curl, Python and TypeScript examples on each page and an error guide covering 400 to 504 with the error envelope, codes and a fix for each (15). Versioned model IDs (muse-spark-1.1 to 1.3, muse-wonder-1.0) and dated launch posts on the developer blog, but no API changelog (7 of 15). 0 + 10 + 16 + 12 + 15 + 7 = 60.

SWE-2 Flash 29

Model reading. No model API, so no OpenAPI entry; the Devin v3 OpenAPI file lists SWE-2 agents only, and no model card was found (0). docs.devin.ai serves llms.txt and Markdown copies of every page (10). The launch post says what it is for (automations, code review, feature development, documentation) and the CLI docs say when to pick a SWE model, but the models pages don't list SWE-2 Flash yet (6 of 20). No documented model ID, reasoning settings, context or output limits to type (0 of 15). The CLI pages show --model and /model examples, with no model-specific errors (3 of 15). Named, dated model versions on Cognition's blog and public release notes, but no release note for SWE-2 Flash yet; the newest is 2 November (10 of 15). 0 + 10 + 6 + 0 + 3 + 10 = 29.

Meta Model API 64

Model reading. Bearer keys per team, named, shown once and revoked by deletion, with rotation advice. No scopes, read-only keys or per-key limits found (20 of 30). The terms say Meta will not use Content submitted to the Standard Services to train Meta Models, and training applies only to the -contributor model IDs a caller picks. Content may still be used to develop and improve safety and security systems (17 of 20). Retention is 'as needed' for the service, the law, flagged violations and safety review, with no period stated. Zero data retention for qualified accounts through sales, with flagged content kept up to 2 years (10 of 15). The usage dashboard shows tokens and requests per day by model, with no per-key or per-call log found (5 of 15). No security.txt on dev.meta.ai. Meta's bug bounty at bugbounty.meta.com is named in the Muse Code SDK's security policy, and a security commitments page describes TLS 1.2 or later, PCI-DSS card handling and an ISMS, with no named certification for the API (12 of 20). 20 + 17 + 10 + 5 + 12 = 64.

SWE-2 Flash 53

Read as a hosted model reached through Devin's local clients. The CLI signs in through a browser, or the enterprise identity provider, and stores an API token in credentials.toml that by default is persistent and does not expire and carries the user's access, with no scopes found for it (10 of 30). Devin CLI documents an OS-level sandbox with network filtering, hooks that can block tool calls, and enterprise model allowlists and team settings (14 of 20). Guardrails against prompt injection are Enterprise only and cover user messages, as on the devin listing (8 of 15). Enterprise analytics count tool calls and consumption by model and user; no per-user audit log for the CLI was found (8 of 15). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address, no bug bounty and no security.txt, per the devin listing (13 of 20). Training: self-serve customer data may train Cognition's models by default, with an opt-out on paid plans that also turns on zero data retention at model providers. Cognition withheld the weights over cyber misuse, which is recorded as a fact, not scored. 10 + 14 + 8 + 8 + 13 = 53.

Meta Model API 53

Closed service with clear terms, under California law with AAA arbitration for Meta Platforms, Inc. and Irish law and courts for Meta Platforms Ireland Limited, with liability capped at the greater of 12 months of fees or $1,000. Muse Glimmer's open weights don't change the hosted service (15). The terms, the models page, the pricing page and the zero-retention help page agree that Standard content isn't used for training and Contributor content may be, but retention periods are not stated outside zero retention, and the privacy policy is Meta's general one (18 of 30). No deprecation policy or dated notices found, and the terms let Meta remove functionality without notice (0). A subprocessor list is linked from the terms but wasn't read, and no data locations were found (8 of 20). 15 + 18 + 0 + 8 = 41.

SWE-2 Flash 64

Editorial half. Closed model under Cognition's platform terms; the weights aren't public and the sharing programme isn't described yet (15). Terms, privacy policy, security page and DPA agree, with training on self-serve data by default and no retention periods, as read for the devin listing (18). The API versioning policy covers API endpoints, not models, and no model deprecation notice was found (5 of 20). Sub-processors listed with purpose and country, per the devin listing's 8 October check (18). 15 + 18 + 5 + 18 = 56.

Meta Model API 40

No status page with readable component history. The error guide's dev.meta.ai/status link now opens a Model API Status page, which showed "Status information is unavailable" to our reader on 4 November, its content drawn by script that we don't request, and the documented GET /v1/status reports only the current state (0). No readable incident history (5). Rate limits published per team and per model, 3,000 RPM and 4,000,000 TPM for muse-wonder-1.0, 150 RPM and 3,000,000 TPM for the contributor variants, 600 background submissions a minute (15). 429 and 503 carry Retry-After (60 seconds for service_overloaded and backend_unavailable), with backoff-with-jitter guidance, rate-limit headers on every token response and a documented mid-stream server_shutting_down event to retry, a generation call read as stateless as gemini-api's (15). No SLA found, and the terms let Meta throttle or suspend access without notice (0). Muse Wonder is labelled a preview. Muse Spark 1.3 carries no preview label, but the API opened on 8 July 2026 as a public preview and we found no general-availability notice, so half (5 of 10, the 12 October partial, kept). 0 + 5 + 15 + 15 + 0 + 5 = 40.

SWE-2 Flash 50

Model reading, for the surface it runs on, Devin Desktop and Devin CLI. Status page at www.devinstatus.com (Atlassian Statuspage) with Desktop Agent and Desktop Tab components besides the cloud ones, read on 4 November 2026 (20). The history feed for the 90 days from 6 August lists 'Devin unavailable' for 20 minutes on 13 August with no component named, read as across the board and a major as on the devin listing; Devin Cloud unavailable on 13 August and the web app down on 24 September name cloud surfaces this model doesn't use; the rest are degraded-performance incidents (new sessions on 3 September, 'multiple services' on 17 September, Ask Devin on 26 October, automation triggers on 4 November) and session queuing on 10 and 11 August, read as minor and a scheduled Devin Desktop extension marketplace upgrade on 7 August, read as maintenance. One major (10). No rate limit figures for the model or the CLI; usage is a daily and weekly quota with no numbers (0). No 429, backoff or retry guidance for this surface (0). Cognition publishes an SLA (25 February 2026) with uptime and response times that applies when included in an order form, read as a contractual SLA on Enterprise, as on other listings (10). The launch post makes it available today with no preview or beta label (10). 20 + 10 + 0 + 0 + 10 + 10 = 50.

Meta Model API 46

Model reading. Muse Wonder launched on 12 October 2026 (30). No deprecation policy or notice period found. All three Muse Spark versions are still served, so no retirement has tested one (0 of 12). Dated launches on the API since 6 August that we read, Muse Image on 25 August, Muse Voice Transcribe on 3 September and Muse Wonder on 12 October (8 of 8). Muse Code leaving beta on 31 August is a separate product and isn't counted. No Model API changelog. A help centre with support tickets, answered 'typically within two business days' by Meta's own account, which we didn't test (8 of 15). No SDK of Meta's own for the API (0 of 15, 0 of 10). 30 + 0 + 8 + 8 + 0 = 46.

SWE-2 Flash 53

Model reading. Released 4 November 2026 (30). Churn and notice in place of release counts: SWE-1.6, SWE-1.7, SWE-1.7 Lightning, SWE-2 (10 September) and now SWE-2 Flash in a few months, with no model deprecation notice period found and short names that move to the newest model (10 of 20). Public release notes and a support address, no public tracker (10 of 25). No official SDK for the model (0 of 15). The docs are kept current but don't yet cover this model (3 of 10). 30 + 10 + 10 + 0 + 3 = 53.