Gemini 4 Carbon vs Muse Spark Open

Gemini 4 Carbon 20

Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. No machine payment protocol (0). Introductory prices published in Google's 28 October announcement without a login, $2 and $10, then $4 and $20; the Gemini API pricing page as read on 10 November showed no Carbon row, so the figures rest on the announcement (20). No free tier: Google's developer post puts Carbon on the paid tier (0). A Google account and AI Studio for a key (0). 0 + 20 + 0 + 0 = 20.

Muse Spark Open 50

Self-hosted rule. Nothing to buy from Meta, and the licence grants use free of charge. The Model as a Service clause asks for a separate agreement only from licensee groups above $20M gross revenue in 12 months (20). Free to run with no card (20). Meta's own weights need a manually reviewed Hugging Face form with legal name and date of birth, or, since the 4 November re-read of Get the model, a signed-in download from Meta's own page, so an agent can't get them alone. The ungated GGUF quantisations from ggml-org and Unsloth that Meta's docs point to download without approval (the Unsloth repository is ungated on 4 November), so part of the line (10 of 20). No payment protocol (0). Hosted copies at $1.25 input and $4.25 output per million tokens need each provider's own account and are not graded. 20 + 20 + 10 + 0 = 50.

Gemini 4 Carbon 85

Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Discovery document for GenerateContent (20 of 25). llms.txt with Markdown twins (10). The Cloud developer guide says what Carbon takes and refuses, the parameters that return 400 or are ignored, and how to migrate (15 of 20). Structured output to a JSON Schema with some keywords not enforced (10 of 15). Examples and an errors page (15). Dated changelog and model versions (15). 20 + 10 + 15 + 10 + 15 + 15 = 85.

Muse Spark Open 61

Read for a model the owner serves. No specification of its own. The contract is the Jinja chat template, which renders OpenAI-format tools with additionalProperties: false added and rejects bad values, plus the OpenAI-compatible servers in vLLM and SGLang with the muse parsers (10 of 25). dev.meta.ai/llms.txt lists the Muse Spark Open overview and seven pages under it, plus three cookbook pages, each with a Markdown copy (10). The card lists seven intended uses and six limitations, the docs say when to pick BF16 or NVFP4 and which reasoning strength suits which task, and the Usage Policy states what is out of scope (17 of 20). reasoning_effort is an enum of four values and anything else returns an error, and tools take JSON Schema. Structured output is documented only for TensorRT-LLM's response_format, not in the prompting guide or for vLLM and SGLang (11 of 15). curl and Python examples for every runtime and hosted provider, the rendered prompt for each case, and the template's own error messages, but no error reference for a served model (11 of 15). One release, with no changelog or version scheme beyond the licence's version line, Muse Spark Open (2 of 15). 10 + 10 + 17 + 11 + 11 + 2 = 61.

Gemini 4 Carbon 93

Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Function calling, with forced calls by FunctionCallingConfig on the API (20). Structured output (13 of 15). Implicit caching with durable caching on by default, cached input 95% off, explicit caches not supported, per the Cloud guide read on 10 November (15). 1,048,576 tokens shared between input and output (15). Batch at half price on the platform (10). Python and JavaScript SDKs (10). Error codes with backoff guidance (10 of 15). 20 + 13 + 15 + 15 + 10 + 10 + 10 = 93.

Muse Spark Open 69

Model reading of the checklist (tool use, structured output, caching, context, throughput, defaults and SDKs, errors). OpenAI-format tools and parallel calls come back as tool_calls, and the template supports namespaced tools and deferred loading through a tool_search tool. A forced tool_choice is not documented (17 of 20). JSON mode and JSON Schema come from each runtime's guided decoding, which Meta's docs show for TensorRT-LLM only (8 of 15). Prefix caching is the runtime's. Meta's SGLang command turns on hierarchical caching, and Dynamo routes each request to the worker holding its cached context (8 of 10). 1,048,576-token context, with sliding-window attention on 46 of 62 layers holding KV memory down (15 of 15). Draft models for speculative decoding in SGLang and vLLM, and no batch mode of its own (7 of 10). Any OpenAI SDK works against a local server, but reasoning can't be turned off, defaults to the most expensive level, and needs streaming, a max_tokens budget for reasoning and the right stop tokens (6 of 15). The template raises named errors for an unsupported reasoning effort, tool arguments passed as a string and a tool message with no name. Server errors are the runtime's (8 of 15). 17 + 8 + 8 + 15 + 7 + 6 + 8 = 69.

Gemini 4 Carbon 83

Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Released to developers on 10 November 2026, with the platform's changelog (30). Deprecations with earliest dates and no stated minimum notice (4 of 12). Shutdowns in the last 90 days kept to their table (4 of 8). Dated changelog (15). SDK replies not sampled (5 of 10). Current SDKs (15). Runtimes stated (10). 30 + 4 + 4 + 15 + 5 + 15 + 10 = 83.

Muse Spark Open 60

Read for an open-weight model released three weeks ago. Released on 15 October 2026 (30). One release, BF16 and NVFP4 on the same day, with no history of revisions, successors or notice periods, and Meta Model API has no deprecation policy either (6 of 20). None of the 29 replies counted by script on 4 November across the BF16 repository's discussions came from Meta. Feedback goes to the discussions or museoss@meta.com, and Meta's docs and developer blog carry dated posts (8 of 25). Day-one support in vLLM, SGLang, TensorRT-LLM, Transformers, llama.cpp, MLX and Unsloth with Meta's own recipes, though SGLang's is a dev image and TensorRT-LLM's a feature branch (12 of 15). Current dependencies (Transformers 5.19), but no CI visible to us (4 of 10). 30 + 6 + 8 + 12 + 4 = 60.

Gemini 4 Carbon 72

Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Closed service with clear terms, SDKs Apache-2.0 (15). Paid-tier data isn't used, abuse retention has no number, and request storage is on by default for new paid projects (20 of 30). Deprecations table (15 of 20). Data may be cached anywhere Google has facilities; no subprocessor list checked (5 of 20). Every benchmark figure is Google's own. 15 + 20 + 15 + 5 = 55.

Muse Spark Open 53

Weights are downloadable under the Muse Model Licence, which is clear and broad in its grant but not an OSI licence. It adds a display requirement, a separate agreement before Model as a Service by a licensee group above $20M gross revenue, and a Usage Policy with field-of-use limits (military, nuclear, espionage, critical infrastructure, heavy machinery) and an age limit of 18. It has no regional exclusion and no governing-law clause. Training code and data aren't released (18 of 30). Inputs stay on the owner's hardware, and Meta's docs say self-hosting keeps 'every prompt and response' inside the owner's infrastructure. The access form's details, and a download from Meta's own page after signing in, go to Meta under its general privacy policy, which we didn't read, and the training data is described in outline only (20 of 30). No deprecation policy, dated notices or versioning found (0 of 20). The Get the model page says everything runs offline once the weights land, and safetensors weights carry no code. No other telemetry statement, and Meta's download form records name, date of birth, country and IP location (12 of 20). 18 + 20 + 0 + 12 = 50.

Gemini 4 Carbon 55

Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Keys bound to a service account and restricted to the Gemini API, with no scopes and a token accepted in the URL (15 of 30, the platform's deduction). Carbon is on the paid tier only, and Google's terms say paid-tier content isn't used to improve products; AI Studio use under a Google AI Ultra subscription falls under terms we didn't read, so 15 of 20 (a judgement call; the platform's 10 is for its free tier). Abuse retention with no number, and new paid projects store requests by default since 26 October (5 of 15). Request logs for billed projects (15). security.txt and a reward programme, no certification naming the API (5 of 20). 15 + 15 + 5 + 15 + 5 = 55.

Muse Spark Open 44

Read as software the owner runs. No account or key to run it. Meta's weights need manual approval on Hugging Face and an access token, and server authentication is the owner's to add (12 of 30). An agent model that calls whatever tools the operator gives it. The card recommends human-in-the-loop confirmation for irreversible actions and Meta reports agentic-risk evaluations, but nothing in the model or template enforces an approval (8 of 20). The chat template neutralises special-token sequences and media placeholders in caller text and wraps tool results in <tool_output>, and the card advises protecting internal assistant messages and layering defences against adversarial input. No indirect prompt-injection results are published (10 of 15). No call log of its own. Visibility depends on the serving stack (5 of 15). Weights are safetensors that load through Transformers' own classes from 5.19, and Meta published cyber, chemical, biological and misalignment evaluations. dev.meta.ai/.well-known/security.txt answers 404 (re-read on 4 November), research.meta.ai per the 15 October check, and no security route is on the card or in the docs, only museoss@meta.com and the Hugging Face discussions (9 of 20). 12 + 8 + 10 + 5 + 9 = 44.