Amazon Bedrock vs Muse Spark Open

Amazon Bedrock 98

Model reading. IAM with SigV4, roles and STS session credentials, policies down to a model or inference-profile ARN, short-term API keys that expire within 12 hours, long-term keys with expiry and reset, and condition keys that can deny bearer tokens altogether (30). The security page says customer data isn't shared with model providers or used to improve the base models (20). The abuse detection page says Bedrock stores no inputs or outputs by default, and a per-Region none mode blocks models that require retention, but Claude Fable 5 and 5.1 keep all traffic up to 30 days and GPT-6 and GPT-5.x keep flagged traffic up to 30 days (13 of 15, a judgement call; Anthropic's own API got 12 for the same Fable exception without an account-level block). CloudTrail logs API calls, and model invocation logging can send prompts and responses to S3 or CloudWatch Logs (15). Bedrock is in ISO, SOC and CSA STAR Level 2 scope, HIPAA eligible and FedRAMP High in GovCloud (US-West) per its security page, with a vulnerability disclosure programme on HackerOne, and the aws.amazon.com security.txt, expired on 6 October, was renewed with Expires 2027-10-16 when read on 6 November (20). Up from 96 on 6 October for that reason.

Muse Spark Open 44

Read as software the owner runs. No account or key to run it. Meta's weights need manual approval on Hugging Face and an access token, and server authentication is the owner's to add (12 of 30). An agent model that calls whatever tools the operator gives it. The card recommends human-in-the-loop confirmation for irreversible actions and Meta reports agentic-risk evaluations, but nothing in the model or template enforces an approval (8 of 20). The chat template neutralises special-token sequences and media placeholders in caller text and wraps tool results in <tool_output>, and the card advises protecting internal assistant messages and layering defences against adversarial input. No indirect prompt-injection results are published (10 of 15). No call log of its own. Visibility depends on the serving stack (5 of 15). Weights are safetensors that load through Transformers' own classes from 5.19, and Meta published cyber, chemical, biological and misalignment evaluations. dev.meta.ai/.well-known/security.txt answers 404 (re-read on 4 November), research.meta.ai per the 15 October check, and no security route is on the card or in the docs, only museoss@meta.com and the Hugging Face discussions (9 of 20). 12 + 8 + 10 + 5 + 9 = 44.

Amazon Bedrock 80

AWS Health Dashboard with per-service, per-Region feeds and a public history file (20). The history lists Amazon Bedrock as disrupted in ME-CENTRAL-1 (UAE) and ME-SOUTH-1 (Bahrain) since March 2026, where AWS said on 15 September 2026 (still inside the 90-day window on 6 November) that it can't restore resources held only there. No other Bedrock event appears in the history in the 90 days to 6 November; an EU-SOUTH-2 packet-loss event on 4 October named Bedrock AgentCore, not Bedrock. This counts as one major event (10). StatusGator's third-party mirror shows 'Increased Error Rates' warnings on 24, 26 and 27 August and 10 September that we couldn't find in AWS's own history, so we didn't score them. Per-model token quotas with default values in the AWS General Reference, such as 30,000,000 tokens a minute for Opus 5.5 global inference (15). The error guide gives exponential backoff with jitter for 429, 503 and 529 and says to honour Retry-After, and the SDKs retry ModelNotReadyException up to five times (15). SLA of 99.9 per cent a month per Region for the model APIs, last updated 4 October 2023 (10). Converse and the current Claude, GPT-6 and Nova 2 Lite models are GA (10).

Muse Spark Open 42

Read with the local-software lines, since the owner serves the weights. Meta's weights come from two Hugging Face repositories gated with manual review. The docs state Python 3.10 or later, Transformers 5.19 or later, Docker images for SGLang and vLLM and the GPUs for each checkpoint (4 × B300 for NVFP4, 8 × B300 for BF16), but SGLang's image is a dev tag and TensorRT-LLM's support sits on a feature branch (13 of 20). No CI or test suite of Meta's for the model was found. github.com/meta-models answered 403 to our fetcher, so its repositories are unchecked (0 of 25). On 4 November the BF16 repository's discussions page lists 13 open threads from 15 October to 1 November, 10 discussions and 3 pull requests (one a draft). A script counted 29 replies across the seven threads with replies, six discussions and the draft pull request, none from the repository owner or a Meta member, and their text wasn't read, so crash reports weren't separated from other posts (15 of 25, held from 15 October and flagged). No changelog, version tags or revision notes, and the commit history needs gated access (2 of 15). Released as a final checkpoint with no preview label from Meta, and both repositories unchanged since 15 October, though runtime support ships as launch-specific images and a branch, and Groq lists it as a preview (12 of 15). 13 + 0 + 15 + 2 + 12 = 42.

Amazon Bedrock 94

Model reading. No OpenAPI, but the bedrock-runtime and bedrock Smithy models are public in aws/api-models-aws with types, required members and enums, counted as for S3 (25). llms.txt for the user guide with about 2,000 lines, each page with a Markdown twin (10). Model cards state context, output limits, endpoints and supported functions per model, and the guide now recommends bedrock-runtime for new work, but support for each API, endpoint and feature changes model by model (16 of 20). Structured outputs compile JSON Schema to a grammar, with minimum, maximum and string lengths supported, though some inference profiles don't support it, such as Haiku 4.5 through the India profile (13 of 15). Every operation lists typed errors with HTTP codes and links to a troubleshooting page with causes and fixes, and examples run through the guide (15). API version 2023-09-30 and a dated document history with an RSS feed, newest entry 30 October 2026, with structured outputs for Claude on both endpoints added on 18 October (15).

Muse Spark Open 61

Read for a model the owner serves. No specification of its own. The contract is the Jinja chat template, which renders OpenAI-format tools with additionalProperties: false added and rejects bad values, plus the OpenAI-compatible servers in vLLM and SGLang with the muse parsers (10 of 25). dev.meta.ai/llms.txt lists the Muse Spark Open overview and seven pages under it, plus three cookbook pages, each with a Markdown copy (10). The card lists seven intended uses and six limitations, the docs say when to pick BF16 or NVFP4 and which reasoning strength suits which task, and the Usage Policy states what is out of scope (17 of 20). reasoning_effort is an enum of four values and anything else returns an error, and tools take JSON Schema. Structured output is documented only for TensorRT-LLM's response_format, not in the prompting guide or for vLLM and SGLang (11 of 15). curl and Python examples for every runtime and hosted provider, the rendered prompt for each case, and the template's own error messages, but no error reference for a served model (11 of 15). One release, with no changelog or version scheme beyond the licence's version line, Muse Spark Open (2 of 15). 10 + 10 + 17 + 11 + 11 + 2 = 61.

Amazon Bedrock 85

Closed service under the AWS Customer Agreement and Service Terms, with the SDKs and Smithy models under Apache-2.0 (18, as for S3). The data retention, abuse detection and security pages agree that Bedrock stores nothing by default, name the models that retain traffic and for how long, and say retained data isn't shared with providers. The retention page's default mode says AWS 'may retain the data for safety and abuse-prevention purposes' without a period, and a legacy provider_data_share mode is kept though sharing isn't supported (25 of 30). A written lifecycle policy with Legacy and EOL dates per model, but the legacy table's 34-day Legacy periods for five Claude models in some Regions contradict its own 6-month floor (15 of 20, down from 18). AWS's sub-processor list, per the 4 October S3 check, and per-Region, geographic and global inference options, with global routing able to process data in any commercial Region (18 of 20).

Muse Spark Open 53

Weights are downloadable under the Muse Model Licence, which is clear and broad in its grant but not an OSI licence. It adds a display requirement, a separate agreement before Model as a Service by a licensee group above $20M gross revenue, and a Usage Policy with field-of-use limits (military, nuclear, espionage, critical infrastructure, heavy machinery) and an age limit of 18. It has no regional exclusion and no governing-law clause. Training code and data aren't released (18 of 30). Inputs stay on the owner's hardware, and Meta's docs say self-hosting keeps 'every prompt and response' inside the owner's infrastructure. The access form's details, and a download from Meta's own page after signing in, go to Meta under its general privacy policy, which we didn't read, and the training data is described in outline only (20 of 30). No deprecation policy, dated notices or versioning found (0 of 20). The Get the model page says everything runs offline once the weights land, and safetensors weights carry no code. No other telemetry statement, and Meta's download form records name, date of birth, country and IP location (12 of 20). 18 + 20 + 0 + 12 = 50.

Amazon Bedrock 92

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Converse takes tools with toolChoice auto, any or a named tool and strict: true, but forced choice depends on the model behind it (17 of 20). Structured outputs on supported models only (13 of 15). Explicit and implicit prompt caching, cache reads at $0.20 per million on Opus 5.5, 0.05x input, with 5-minute and 1-hour TTLs (15). 1M-token context on Opus 5.5, Sonnet 5.5 and Nova 2 Lite, a judgement call since Bedrock has no default model (15). Batch at half price on supported models, but the pricing page shows none for Opus 5.5 or Sonnet 5.5, while Flex is half price on Nova (7 of 10). AWS SDKs in every major language plus token generators for Python, JavaScript and Java (10). Typed errors with recovery advice per code (15).

Muse Spark Open 69

Model reading of the checklist (tool use, structured output, caching, context, throughput, defaults and SDKs, errors). OpenAI-format tools and parallel calls come back as tool_calls, and the template supports namespaced tools and deferred loading through a tool_search tool. A forced tool_choice is not documented (17 of 20). JSON mode and JSON Schema come from each runtime's guided decoding, which Meta's docs show for TensorRT-LLM only (8 of 15). Prefix caching is the runtime's. Meta's SGLang command turns on hierarchical caching, and Dynamo routes each request to the worker holding its cached context (8 of 10). 1,048,576-token context, with sliding-window attention on 46 of 62 layers holding KV memory down (15 of 15). Draft models for speculative decoding in SGLang and vLLM, and no batch mode of its own (7 of 10). Any OpenAI SDK works against a local server, but reasoning can't be turned off, defaults to the most expensive level, and needs streaming, a max_tokens budget for reasoning and the right stop tokens (6 of 15). The template raises named errors for an unsupported reasoning effort, tool arguments passed as a string and a tool message with no name. Server errors are the runtime's (8 of 15). 17 + 8 + 8 + 15 + 7 + 6 + 8 = 69.

Amazon Bedrock 81

Model reading. The last model or API change is 30 October 2026 (OpenAI model API support and cross-Region inference in GovCloud), after structured outputs for Claude on both endpoints on 18 October (30). Models launched since 7 September 2026 get a 6-month or 45-day Legacy period, but the legacy page, which promises at least 6 months in Legacy, lists Claude 3 Haiku, 3 Sonnet, 3.5 Sonnet, 3.5 Sonnet v2 and 3.7 Sonnet as Legacy from 10 or 13 October with end of life on 13 November in several Regions, about 34 days (6 of 12, down from 10). Six models reached end of life in the 90 days to 6 November on five dates, Command R and R+ on 19 August, Claude 3 Haiku on 10 September, Nova Sonic on 14 September, Nova Canvas and Nova Reel on 30 September and Claude Sonnet 4 on 14 October (3 of 8, down from 4). Dated document history several times a month, What's New and re:Post, with direct support on a paid plan (12 of 15). SDK issue replies not sampled (5 of 10). Current official SDKs, boto3 1.43.125 on 5 November and @aws-sdk/client-bedrock-runtime 3.1163.0 (15). Supported runtimes stated, Python 3.10 or later and Node 20 or later (10). Down from 86 on 6 October.

Muse Spark Open 60

Read for an open-weight model released three weeks ago. Released on 15 October 2026 (30). One release, BF16 and NVFP4 on the same day, with no history of revisions, successors or notice periods, and Meta Model API has no deprecation policy either (6 of 20). None of the 29 replies counted by script on 4 November across the BF16 repository's discussions came from Meta. Feedback goes to the discussions or museoss@meta.com, and Meta's docs and developer blog carry dated posts (8 of 25). Day-one support in vLLM, SGLang, TensorRT-LLM, Transformers, llama.cpp, MLX and Unsloth with Meta's own recipes, though SGLang's is a dev image and TensorRT-LLM's a feature branch (12 of 15). Current dependencies (Transformers 5.19), but no CI visible to us (4 of 10). 30 + 6 + 8 + 12 + 4 = 60.