Head to head · LLM inference · October 2026 research run

SWE-2 Flash vs Vertex AI (Gemini Enterprise Agent Platform)

Vertex AI (Gemini Enterprise Agent Platform) scores 88.7 (AA) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in every scored category. Both do llm inference.

Best model APIs and inference for AI agents · All 830 models comparisons

Which one, for what

SWE-2 Flash F

Best for People already using Devin Desktop or Devin CLI who want a cheaper, faster model for routine coding work such as automations, reviews and small changes, while it is free in November 2026.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

No model API, OpenAPI entry or model card. The Devin API's session agents list SWE-2 but not SWE-2 Flash

Vertex AI (Gemini Enterprise Agent Platform) AA

Best for Google Cloud customers who need Gemini with residency, VPC-SC, provisioned throughput and an SLA, or Claude under a Google bill.

Ahead on

  • Reliability, 99 against 50
  • Schema & documentation, 94 against 29
  • Agent ergonomics, 97 against 10
  • Security & auth, 97 against 53
  • Payments & pricing, 40 against 20
  • Maintenance & community, 91 against 53
  • Transparency & trust, 90 against 64

Also in its favour

  • Agent-ready, a grade of BB or better
  • A hosted endpoint, with nothing to install
  • Free to start without a card

Watch for

The SLA drops from 99.5 to 95 per cent for short-term availability models, Gemini 3.7 and 3.6 Flash among them

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Agent ergonomics Vertex AI (Gemini Enterprise Agent Platform) +87

SWE-2 Flash 10

Model reading (tool use, structured output, caching, context, batch, SDKs). Tool use is Devin's harness, not something a caller configures; no context length, output limit or cache price is published for SWE-2 Flash (5 of 25). No documented output-size or reasoning controls for this model; SWE-2's effort levels aren't stated for Flash (0 of 20). No model-level error documentation (0 of 20). No idempotency or retry guidance (0 of 20). One flag or picker selects it and devin -p runs a single turn and prints to stdout, but there is no SDK or direct endpoint (5 of 15). 5 + 0 + 0 + 0 + 5 = 10.

Vertex AI (Gemini Enterprise Agent Platform) 97

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Function calling with FunctionCallingConfig mode ANY and allowedFunctionNames to force a named tool (20). Schema-guaranteed JSON output (15). Implicit and explicit context caching, cached input at 0.1x, $0.075 per million on 3.8 Flash through 31 December (15). 1,048,576-token context on 3.8 Flash, a unified 1,048,576-token input and output limit on Gemini 4 Argon, and 1,000,000 on Claude Opus 5.5 (15). Flex/Batch at half price on Gemini (10). Gen AI SDKs for Python and JavaScript among others, and the OpenAI libraries work with Google Cloud auth (10). 429 handling documented per quota framework, with standard Google status codes elsewhere (12 of 15).

Schema & documentation Vertex AI (Gemini Enterprise Agent Platform) +65

SWE-2 Flash 29

Model reading. No model API, so no OpenAPI entry; the Devin v3 OpenAPI file lists SWE-2 agents only, and no model card was found (0). docs.devin.ai serves llms.txt and Markdown copies of every page (10). The launch post says what it is for (automations, code review, feature development, documentation) and the CLI docs say when to pick a SWE model, but the models pages don't list SWE-2 Flash yet (6 of 20). No documented model ID, reasoning settings, context or output limits to type (0 of 15). The CLI pages show --model and /model examples, with no model-specific errors (3 of 15). Named, dated model versions on Cognition's blog and public release notes, but no release note for SWE-2 Flash yet; the newest is 2 November (10 of 15). 0 + 10 + 6 + 0 + 3 + 10 = 29.

Vertex AI (Gemini Enterprise Agent Platform) 94

Model reading. Keyless discovery document for the Agent Platform API v1, revision 20260930, with 1,128 methods and 1,493 schemas (25). No llms.txt, but every docs page answers as Markdown at .md.txt, counted as for vertex-ai-tuning (10). Model cards give limits, capabilities and retirement dates, and the 3.8 Flash card says when to use 3.7 Flash instead, but the docs mix the Vertex AI and Agent Platform names, and the OpenAI page tells new users to call the Gemini Developer API instead (16 of 20). Structured output with response_schema and response_mime_type: application/json always follows the schema per the docs, and complex schemas fail with a 400 (15). Examples on every page and a 429 guide, but we found no full error code list for generateContent (13 of 15). Versioned v1 and v1beta1 APIs and release notes with entries on most working days, newest 5 November 2026 (15).

Reliability Vertex AI (Gemini Enterprise Agent Platform) +49

SWE-2 Flash 50

Model reading, for the surface it runs on, Devin Desktop and Devin CLI. Status page at www.devinstatus.com (Atlassian Statuspage) with Desktop Agent and Desktop Tab components besides the cloud ones, read on 4 November 2026 (20). The history feed for the 90 days from 6 August lists 'Devin unavailable' for 20 minutes on 13 August with no component named, read as across the board and a major as on the devin listing; Devin Cloud unavailable on 13 August and the web app down on 24 September name cloud surfaces this model doesn't use; the rest are degraded-performance incidents (new sessions on 3 September, 'multiple services' on 17 September, Ask Devin on 26 October, automation triggers on 4 November) and session queuing on 10 and 11 August, read as minor and a scheduled Devin Desktop extension marketplace upgrade on 7 August, read as maintenance. One major (10). No rate limit figures for the model or the CLI; usage is a daily and weekly quota with no numbers (0). No 429, backoff or retry guidance for this surface (0). Cognition publishes an SLA (25 February 2026) with uptime and response times that applies when included in an order form, read as a contractual SLA on Enterprise, as on other listings (10). The launch post makes it available today with no preview or beta label (10). 20 + 10 + 0 + 0 + 10 + 10 = 50.

Vertex AI (Gemini Enterprise Agent Platform) 99

Google Cloud status dashboard with per-product history (20). Its incident feed, read on 6 November, has no incident naming Vertex Gemini API, Gemini or the Agent Platform in the 90 days. The regional incidents of 20 August, 1 September and 20 October (europe-west2) and the Cloud Storage incident of 8 and 9 October didn't list it among affected products (30). Standard PayGo publishes usage tiers by 30-day spend with baseline throughput, 2,000,000 to 50,000,000 tokens a minute for Flash models and 500,000 to 10,000,000 for Pro, plus quota tables for other methods (15). A 429 page says to use the global endpoint and truncated exponential backoff, and a retry-strategy page (15). SLA of 99.5 per cent a month on generateContent and streamGenerateContent, 95 per cent for short-term availability models, and a latency SLO on Provisioned Throughput. The 429 page says pay-as-you-go 429s don't count toward the SLA error rate (10). Gemini 4 Argon reached GA on 13 October and Gemini 3.8 Flash moved to the 12-month tier, and the v1 API, 3.5 Flash-Lite and Claude Opus 5.5 are GA, but express mode was Preview at the 6 October check (9 of 10, up from 8). Up from 98 on 6 October.

Security & auth Vertex AI (Gemini Enterprise Agent Platform) +44

SWE-2 Flash 53

Read as a hosted model reached through Devin's local clients. The CLI signs in through a browser, or the enterprise identity provider, and stores an API token in credentials.toml that by default is persistent and does not expire and carries the user's access, with no scopes found for it (10 of 30). Devin CLI documents an OS-level sandbox with network filtering, hooks that can block tool calls, and enterprise model allowlists and team settings (14 of 20). Guardrails against prompt injection are Enterprise only and cover user messages, as on the devin listing (8 of 15). Enterprise analytics count tool calls and consumption by model and user; no per-user audit log for the CLI was found (8 of 15). SOC 2 Type II and ISO/IEC 27001:2022, a disclosure address, no bug bounty and no security.txt, per the devin listing (13 of 20). Training: self-serve customer data may train Cognition's models by default, with an opt-out on paid plans that also turns on zero data retention at model providers. Cognition withheld the weights over cyber misuse, which is recorded as a fact, not scored. 10 + 14 + 8 + 8 + 13 = 53.

Vertex AI (Gemini Enterprise Agent Platform) 97

Model reading. OAuth 2.0 with IAM roles and service accounts, which the docs recommend for production, with API keys for testing. No key in a query string found in the docs we read (30). The training restriction in the Service Specific Terms says Google won't use customer data to train or fine-tune any model without permission, GA and pre-GA alike (20). Default in-memory caching for 24 hours that can be disabled, flagged prompts logged up to 90 days unless an abuse-monitoring exception is granted or the customer has a Cloud Master Agreement, the Interactions API storing by default, and Claude Fable 5 and Mythos 5 requiring 30-day retention shared with Anthropic (12 of 15, a judgement call matching the Fable exception on the Anthropic and Bedrock listings). Cloud Audit Logs, with Data Access logs off until enabled, and optional request-response logging to BigQuery (15). google.com security.txt valid to 2030-04-01, the Google VRP, and Generative AI on the platform in ISO 27001, 27017 and 27018 and SOC 1, 2 and 3 scope per the 1 October services-in-scope check for vertex-ai-tuning, not re-read on 6 October (20).

Maintenance & community Vertex AI (Gemini Enterprise Agent Platform) +38

SWE-2 Flash 53

Model reading. Released 4 November 2026 (30). Churn and notice in place of release counts: SWE-1.6, SWE-1.7, SWE-1.7 Lightning, SWE-2 (10 September) and now SWE-2 Flash in a few months, with no model deprecation notice period found and short names that move to the newest model (10 of 20). Public release notes and a support address, no public tracker (10 of 25). No official SDK for the model (0 of 15). The docs are kept current but don't yet cover this model (3 of 10). 30 + 10 + 10 + 0 + 3 = 53.

Vertex AI (Gemini Enterprise Agent Platform) 91

Model reading. Gemini Omni 1.2 Flash GA on 5 November, Grok 4.7 GA on 27 October, Gemini 4 Argon GA on 13 October and Claude Haiku 5.5 on 7 October 2026 (30). Stable models stay at least 12 months, and since 6 October Gemini 4 Argon and Gemini 3.8 Flash are in that tier, while 3.7 and 3.6 Flash remain short-term with at least 45 days' notice once a date is set (10 of 12, up from 8). Gemini 2.5 Pro, Flash and Flash-Lite were due to retire on 20 October, three models on one date after more than 12 months, with replacements named. We didn't check partner model retirements (6 of 8, down from 8). Dated release notes on most working days, newest 5 November, and Cloud Customer Care (15). python-genai replies not sampled this run (5 of 10). Current SDKs, google-genai 3.0.0 on 6 November and @google/genai 3.0.0, and google-cloud-aiplatform 2.7.0 on 28 October 2026 (15). Supported runtimes stated, Python 3.10 or later and Node 20 or later, per the 6 October check (10). Unchanged at 91.

Transparency & trust Vertex AI (Gemini Enterprise Agent Platform) +26

SWE-2 Flash 64

Editorial half. Closed model under Cognition's platform terms; the weights aren't public and the sharing programme isn't described yet (15). Terms, privacy policy, security page and DPA agree, with training on self-serve data by default and no retention periods, as read for the devin listing (18). The API versioning policy covers API endpoints, not models, and no model deprecation notice was found (5 of 20). Sub-processors listed with purpose and country, per the devin listing's 8 October check (18). 15 + 18 + 5 + 18 = 56.

Vertex AI (Gemini Enterprise Agent Platform) 90

Closed service under the Google Cloud terms, with the Gen AI SDKs under Apache-2.0 and a public discovery document (18, as for Bedrock's open service models). The zero data retention and abuse monitoring pages agree with the Cloud terms and give periods for each case, 24 hours in memory, up to 90 days for flagged prompts, 30 days for Advanced AI models, 3 days for Search grounding logs and 30 days for Maps grounding, and say which can't be switched off (27 of 30). A dated model versions table with release and retirement dates and a stated 12-month or 45-day policy, but on 6 November it still listed Gemini 2.5 Pro, Flash and Flash-Lite as available with a 20 October 2026 retirement date and left them out of the retired table (18 of 20, down from 20). The Cloud subprocessor list with locations, per the 1 October vertex-ai-tuning check, regional and multi-region endpoints, and per-model ML processing locations on the partner model cards (20).

Score by category

CategoryWeight this runSWE-2 FlashVertex AI (Gemini Enterprise Agent Platform)Edge
Reliability16%205099Vertex AI (Gemini Enterprise Agent Platform) +49
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.22994Vertex AI (Gemini Enterprise Agent Platform) +65
Agent ergonomics13%16.21097Vertex AI (Gemini Enterprise Agent Platform) +87
Security & auth14%17.55397Vertex AI (Gemini Enterprise Agent Platform) +44
Payments & pricing10%12.52040Vertex AI (Gemini Enterprise Agent Platform) +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.85391Vertex AI (Gemini Enterprise Agent Platform) +38
Transparency & trust7%8.86490Vertex AI (Gemini Enterprise Agent Platform) +26
Negative events≤15-20
TotalF 36.4/100AA 88.7/100

Facts side by side

FactSWE-2 FlashVertex AI (Gemini Enterprise Agent Platform)
KindModel APIModel API
VendorCognition AI, Inc.Google Cloud
Hosted endpointno (local only)https://aiplatform.googleapis.com/v1
TransportsHTTP
AuthOAuth or keyOAuth or key
PricingFreemiumPay per use
x402nono
LicenceProprietary model, used through Devin Desktop and Devin CLI under Cognition's Platform Terms of Service. The weights are not public; Cognition says it is building a programme to share them with industry partners and researchersProprietary service under the Google Cloud Platform terms. Partner models carry their providers' terms. The Google Gen AI SDKs are Apache-2.0
Read-only variant documentednono
llms.txtyesno
Last release2026-11-042026-11-05
Terms last updated2026-06-302026-09-02
Privacy policy last updated2026-03-092026-10-01
Customer content may train modelsyes, with an opt-outyes
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularitynone20.9M PyPI/wk

Verdicts

SWE-2 Flash

A new small coding model from Cognition that anyone can try free in Devin Desktop and Devin CLI until 30 November 2026, with strong vendor-reported coding scores. It has no model API, no published per-token price, context length or model card, and no public weights, so an agent can reach it only by driving Devin's own CLI.

Vertex AI (Gemini Enterprise Agent Platform)

Gemini, Claude and open models through one Google Cloud API with IAM, regional endpoints, schema-guaranteed JSON and a 99.5 per cent SLA, and no Vertex incident on the Cloud status page in the 90 days to 6 November 2026. Gemini 4 Argon and 3.8 Flash have 12-month availability, but short-term Flash models get a 95 per cent SLA.

Before you call either

SWE-2 Flash

  1. There is no endpoint to call. Run Devin CLI single-turn with devin -p and pick the model with --model; the SWE-2 Flash model ID isn't documented yet, so check /model in the CLI first
  2. Don't rely on the short name swe. The docs say it resolves to the latest model in the family, which may be SWE-2 rather than SWE-2 Flash
  3. Plan for billing to start on 1 December 2026. The free period covers Devin Desktop and CLI only, not Devin cloud sessions
  4. Treat Cognition's benchmark figures as the vendor's. No independent result for SWE-2 Flash was found
  5. Keep credentials.toml private. The token in it doesn't expire by default and carries the signed-in user's access

Vertex AI (Gemini Enterprise Agent Platform)

  1. Call the global location on aiplatform.googleapis.com unless data residency requires a Region. The 429 guide says it spreads load and reduces errors
  2. Back off exponentially on 429 Resource exhausted. On Standard PayGo it means shared capacity is busy, not a fixed quota
  3. Send response_schema with response_mime_type: application/json. JSON mode alone doesn't guarantee valid output
  4. Set store to false on Interactions API calls. It defaults to true and keeps prompts and responses
  5. Pin gemini-4-argon or gemini-3.8-flash, both in the 12-month tier, rather than 3.7 or 3.6 Flash, which retire on 28 January 2027 and 19 November 2026

Questions

Which is better for AI agents, SWE-2 Flash or Vertex AI (Gemini Enterprise Agent Platform)?

Vertex AI (Gemini Enterprise Agent Platform) scores 88.7 (AA) on agent readiness against SWE-2 Flash's 36.4 (F), and leads in every scored category.

Do SWE-2 Flash and Vertex AI (Gemini Enterprise Agent Platform) need an API key?

Both take an API key or an OAuth sign-in.

Can an agent call SWE-2 Flash and Vertex AI (Gemini Enterprise Agent Platform) without installing anything?

No hosted endpoint is listed for SWE-2 Flash. Vertex AI (Gemini Enterprise Agent Platform) has a hosted endpoint at https://aiplatform.googleapis.com/v1.

Other comparisons with SWE-2 Flash or Vertex AI (Gemini Enterprise Agent Platform)

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.