Gemini 4 Hydrogen vs Muse Spark Open

Gemini 4 Hydrogen 40

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. No machine payment protocol (0). Prices published in Google's announcement without a login, $1.50 input and $7.50 output per million tokens, flat across the window; the Gemini API pricing page, now at aistudio.google.com, is still to be read for Hydrogen's row (20). A free tier with no card: Google's announcement puts Hydrogen on all tiers of the Gemini API, and the free tier needs no billing account per the gemini-api listing; its limits for Hydrogen are on that pricing page (20). A Google account and AI Studio for a key (0). 0 + 20 + 20 + 0 = 40.

Muse Spark Open 75

Self-hosted rule. Nothing to buy from Meta, and the licence grants use free of charge. The Model as a Service clause asks for a separate agreement only from licensee groups above $20M gross revenue in 12 months (20). Free to run with no card (20). Meta's own weights need a manually reviewed Hugging Face form with legal name and date of birth, or, since the 4 November re-read of Get the model, a signed-in download from Meta's own page, so an agent can't get them alone. The ungated GGUF quantisations from ggml-org and Unsloth that Meta's docs point to download without approval (the Unsloth repository is ungated on 4 November), so part of the line (10 of 20). No payment protocol (0). Hosted copies at $1.25 input and $4.25 output per million tokens need each provider's own account and are not graded. 20 + 20 + 10 + 0 = 50. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 50 is 75.

Gemini 4 Hydrogen 85

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Released on 12 November 2026, recorded in Google Cloud's release notes; the Gemini API changelog, last updated 30 October, has no entry for it yet (30). Google Cloud states a minimum of 45 days' notice before Hydrogen is retired, short and stated for Cloud only; the Gemini API's deprecations give earliest dates with no stated minimum (6 of 12). Shutdowns in the last 90 days kept to their table (4 of 8). Dated changelog (15). SDK replies not sampled (5 of 10). Current SDKs; the developer guide names the minimum google-genai, @google/genai, Go and Java versions (15). Runtimes stated (10). 30 + 6 + 4 + 15 + 5 + 15 + 10 = 85.

Muse Spark Open 60

Read for an open-weight model released three weeks ago. Released on 15 October 2026 (30). One release, BF16 and NVFP4 on the same day, with no history of revisions, successors or notice periods, and Meta Model API has no deprecation policy either (6 of 20). None of the 29 replies counted by script on 4 November across the BF16 repository's discussions came from Meta. Feedback goes to the discussions or museoss@meta.com, and Meta's docs and developer blog carry dated posts (8 of 25). Day-one support in vLLM, SGLang, TensorRT-LLM, Transformers, llama.cpp, MLX and Unsloth with Meta's own recipes, though SGLang's is a dev image and TensorRT-LLM's a feature branch (12 of 15). Current dependencies (Transformers 5.19), but no CI visible to us (4 of 10). 30 + 6 + 8 + 12 + 4 = 60.

Gemini 4 Hydrogen 85

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Discovery document for GenerateContent (20 of 25). llms.txt with Markdown twins (10). The Cloud developer guide says what Hydrogen takes, every parameter that's ignored or returns 400, the thought-signature rules and how to migrate from Gemini 3.8 Flash, though it doesn't document forced calls (15 of 20). Structured output to a JSON Schema with some keywords not enforced (10 of 15). Examples and an errors page (15). Dated changelog and model versions (15). 20 + 10 + 15 + 10 + 15 + 15 = 85.

Muse Spark Open 61

Read for a model the owner serves. No specification of its own. The contract is the Jinja chat template, which renders OpenAI-format tools with additionalProperties: false added and rejects bad values, plus the OpenAI-compatible servers in vLLM and SGLang with the muse parsers (10 of 25). dev.meta.ai/llms.txt lists the Muse Spark Open overview and seven pages under it, plus three cookbook pages, each with a Markdown copy (10). The card lists seven intended uses and six limitations, the docs say when to pick BF16 or NVFP4 and which reasoning strength suits which task, and the Usage Policy states what is out of scope (17 of 20). reasoning_effort is an enum of four values and anything else returns an error, and tools take JSON Schema. Structured output is documented only for TensorRT-LLM's response_format, not in the prompting guide or for vLLM and SGLang (11 of 15). curl and Python examples for every runtime and hosted provider, the rendered prompt for each case, and the template's own error messages, but no error reference for a served model (11 of 15). One release, with no changelog or version scheme beyond the licence's version line, Muse Spark Open (2 of 15). 10 + 10 + 17 + 11 + 11 + 2 = 61.

Gemini 4 Hydrogen 90

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Function calling, with forced calls by FunctionCallingConfig on the API (20). Structured output to a response_schema, listed as supported on the Cloud model page (13 of 15). Implicit caching on prefixes of 4,096 tokens or more with durable caching on by default and explicit caches not supported, per the Cloud model page; the announcement names no cached-input price (12 of 15). 1,048,576 tokens shared between input and output, with background long decode up to 1M (15). Batch at half price on the platform (10). Python and JavaScript SDKs, and an OpenAI-compatible Chat Completions surface (10). Error codes with backoff guidance (10 of 15). 20 + 13 + 12 + 15 + 10 + 10 + 10 = 90.

Muse Spark Open 69

Model reading of the checklist (tool use, structured output, caching, context, throughput, defaults and SDKs, errors). OpenAI-format tools and parallel calls come back as tool_calls, and the template supports namespaced tools and deferred loading through a tool_search tool. A forced tool_choice is not documented (17 of 20). JSON mode and JSON Schema come from each runtime's guided decoding, which Meta's docs show for TensorRT-LLM only (8 of 15). Prefix caching is the runtime's. Meta's SGLang command turns on hierarchical caching, and Dynamo routes each request to the worker holding its cached context (8 of 10). 1,048,576-token context, with sliding-window attention on 46 of 62 layers holding KV memory down (15 of 15). Draft models for speculative decoding in SGLang and vLLM, and no batch mode of its own (7 of 10). Any OpenAI SDK works against a local server, but reasoning can't be turned off, defaults to the most expensive level, and needs streaming, a max_tokens budget for reasoning and the right stop tokens (6 of 15). The template raises named errors for an unsupported reasoning effort, tool arguments passed as a string and a tool message with no name. Server errors are the runtime's (8 of 15). 17 + 8 + 8 + 15 + 7 + 6 + 8 = 69.

Gemini 4 Hydrogen 72

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Closed service with clear terms, SDKs Apache-2.0 (15). Free-tier content is used to improve products, paid-tier content isn't, abuse retention has no number, and request storage is on by default for new paid projects; the statements agree with each other (20 of 30). Deprecations table, and a stated 45-day minimum on Cloud (15 of 20). Data may be cached anywhere Google has facilities; no subprocessor list checked (5 of 20). A DeepMind model card gives a March 2026 knowledge cutoff, automated safety results and Frontier Safety Framework outcomes, with the full safety report marked coming soon. Every benchmark figure is Google's own. 15 + 20 + 15 + 5 = 55.

Muse Spark Open 53

Weights are downloadable under the Muse Model Licence, which is clear and broad in its grant but not an OSI licence. It adds a display requirement, a separate agreement before Model as a Service by a licensee group above $20M gross revenue, and a Usage Policy with field-of-use limits (military, nuclear, espionage, critical infrastructure, heavy machinery) and an age limit of 18. It has no regional exclusion and no governing-law clause. Training code and data aren't released (18 of 30). Inputs stay on the owner's hardware, and Meta's docs say self-hosting keeps 'every prompt and response' inside the owner's infrastructure. The access form's details, and a download from Meta's own page after signing in, go to Meta under its general privacy policy, which we didn't read, and the training data is described in outline only (20 of 30). No deprecation policy, dated notices or versioning found (0 of 20). The Get the model page says everything runs offline once the weights land, and safetensors weights carry no code. No other telemetry statement, and Meta's download form records name, date of birth, country and IP location (12 of 20). 18 + 20 + 0 + 12 = 50.

Gemini 4 Hydrogen 50

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Keys bound to a service account and restricted to the Gemini API, with no scopes and a token accepted in the URL (15 of 30, the platform's deduction). Hydrogen is on the free tier, where Google's terms say content is used to improve products and may be read by humans; paid-tier content isn't (10 of 20, the platform's reading; Carbon, paid tier only, got 15). Abuse retention has no number and new paid projects store requests by default since 26 October; Google's prompt-injection figure (2.3 times more resilient on Gray Swan's benchmark) is its own, and the model card says jailbreak resistance is still being improved (5 of 15). Request logs for billed projects (15). security.txt and a reward programme, no certification naming the API (5 of 20). 15 + 10 + 5 + 15 + 5 = 50.

Muse Spark Open 44

Read as software the owner runs. No account or key to run it. Meta's weights need manual approval on Hugging Face and an access token, and server authentication is the owner's to add (12 of 30). An agent model that calls whatever tools the operator gives it. The card recommends human-in-the-loop confirmation for irreversible actions and Meta reports agentic-risk evaluations, but nothing in the model or template enforces an approval (8 of 20). The chat template neutralises special-token sequences and media placeholders in caller text and wraps tool results in <tool_output>, and the card advises protecting internal assistant messages and layering defences against adversarial input. No indirect prompt-injection results are published (10 of 15). No call log of its own. Visibility depends on the serving stack (5 of 15). Weights are safetensors that load through Transformers' own classes from 5.19, and Meta published cyber, chemical, biological and misalignment evaluations. dev.meta.ai/.well-known/security.txt answers 404 (re-read on 4 November), research.meta.ai per the 15 October check, and no security route is on the card or in the docs, only museoss@meta.com and the Hugging Face discussions (9 of 20). 12 + 8 + 10 + 5 + 9 = 44.