Head to head · LLM inference · October 2026 research run

Azure OpenAI in Foundry Models vs Muse Spark Open

Azure OpenAI in Foundry Models scores 80 (A) on agent readiness against Muse Spark Open's 53.4 (D), and leads in 6 of 7 scored categories. Muse Spark Open leads on payments & pricing. Both do llm inference.

Best model APIs and inference for AI agents · All 830 models comparisons

Which one, for what

Azure OpenAI in Foundry Models A

Best for Teams on Azure that need OpenAI models with Entra ID, private networking, EU or US data zones or FedRAMP scope, and one resource that also serves DeepSeek, Llama, Mistral and Grok models.

Ahead on

  • Reliability, 80 against 42
  • Schema & documentation, 87 against 61
  • Agent ergonomics, 98 against 69
  • Security & auth, 95 against 44
  • Maintenance & community, 86 against 60
  • Transparency & trust, 83 against 53

Also in its favour

  • Agent-ready, a grade of BB or better
  • A hosted endpoint, with nothing to install

Watch for

Intermittent failures and 5xx errors in Sweden Central for about six hours on 29 September 2026

Muse Spark Open D

Best for A team with a four-GPU Blackwell node, or two to four Mac Studios, that wants a 1M-token multimodal coding and agent model on its own hardware with no prompts leaving it.

Ahead on

  • Payments & pricing, 50 against 20

Also in its favour

  • No key needed to call it

Watch for

The NVFP4 checkpoint (about 537 GB) serves on four B300 GPUs and the BF16 one (about 1.65 TB) on eight

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth Azure OpenAI in Foundry Models +51

Azure OpenAI in Foundry Models 95

Model reading. Microsoft Entra ID tokens with Azure roles (the Cognitive Services OpenAI User role for calls), managed identities, and key authentication that can be disabled per resource, or two regenerable resource keys in the api-key header. No documented route puts the key in a URL query string (30). Prompts, completions, embeddings and training data aren't used to train foundation models without the customer's permission or instruction, per the data privacy page updated 4 August 2026 (20). Flagged prompts and completions may be stored in the customer's geography for human abuse review, with no retention period stated, and approved customers can turn that storage off through modified abuse monitoring. Responses API data is kept 30 days by default unless store is false (12 of 15). Azure Monitor resource logs and the subscription activity log, as read in the Foundry fine-tuning dossier (15). MSRC coordinated disclosure policy and Microsoft's bounty programme, both named in microsoft.com's security.txt, and Azure OpenAI is listed in FedRAMP High and DoD IL2 scope in Azure public regions. The security.txt passed its Expires date on 2026-09-23 and was still expired on 6 November, which the Bedrock and S3 dossiers mark down by 2, applied here too (18 of 20, down from 20 on 6 October for consistency).

Muse Spark Open 44

Read as software the owner runs. No account or key to run it. Meta's weights need manual approval on Hugging Face and an access token, and server authentication is the owner's to add (12 of 30). An agent model that calls whatever tools the operator gives it. The card recommends human-in-the-loop confirmation for irreversible actions and Meta reports agentic-risk evaluations, but nothing in the model or template enforces an approval (8 of 20). The chat template neutralises special-token sequences and media placeholders in caller text and wraps tool results in <tool_output>, and the card advises protecting internal assistant messages and layering defences against adversarial input. No indirect prompt-injection results are published (10 of 15). No call log of its own. Visibility depends on the serving stack (5 of 15). Weights are safetensors that load through Transformers' own classes from 5.19, and Meta published cyber, chemical, biological and misalignment evaluations. dev.meta.ai/.well-known/security.txt answers 404 (re-read on 4 November), research.meta.ai per the 15 October check, and no security route is on the card or in the docs, only museoss@meta.com and the Hugging Face discussions (9 of 20). 12 + 8 + 10 + 5 + 9 = 44.

Reliability Azure OpenAI in Foundry Models +38

Azure OpenAI in Foundry Models 80

Azure status page with post-incident reviews, listing Azure OpenAI Service, Foundry Models and Foundry Agent Service as components (20). One incident in the 90 days to 6 November 2026 names Azure OpenAI, and no review after it does, intermittent request failures, higher latency and HTTP 5xx errors in Sweden Central from 10:03 to 15:58 UTC on 29 September 2026 (tracking 7QL5-Z50), counted as one major outage as in the Foundry fine-tuning dossier. The 23 July West US review and the 30 September gateway incident don't name it (10). Quota tiers from Free to Tier 6 with TPM and RPM per model and deployment type, 1,000 RPM and 1,000,000 TPM for each GPT-6 model on Global Standard at Tier 1 (15). 429 responses carry retry-after-ms, every response carries x-ratelimit-* headers, and the quota guide gives exponential backoff with jitter and SDK retry settings (15). The models page says models sold by Azure are covered by Azure service-level agreements and links the Online Services SLA. The consolidated SLA document wouldn't download on 6 October and wasn't retried on 6 November, so the clause rests on Microsoft's docs, read the same way as the 5 October Azure Speech check (10). The v1 API is GA and the GPT-6 models carry no preview label (10).

Muse Spark Open 42

Read with the local-software lines, since the owner serves the weights. Meta's weights come from two Hugging Face repositories gated with manual review. The docs state Python 3.10 or later, Transformers 5.19 or later, Docker images for SGLang and vLLM and the GPUs for each checkpoint (4 × B300 for NVFP4, 8 × B300 for BF16), but SGLang's image is a dev tag and TensorRT-LLM's support sits on a feature branch (13 of 20). No CI or test suite of Meta's for the model was found. github.com/meta-models answered 403 to our fetcher, so its repositories are unchecked (0 of 25). On 4 November the BF16 repository's discussions page lists 13 open threads from 15 October to 1 November, 10 discussions and 3 pull requests (one a draft). A script counted 29 replies across the seven threads with replies, six discussions and the draft pull request, none from the repository owner or a Meta member, and their text wasn't read, so crash reports weren't separated from other posts (15 of 25, held from 15 October and flagged). No changelog, version tags or revision notes, and the commit history needs gated access (2 of 15). Released as a final checkpoint with no preview label from Meta, and both repositories unchanged since 15 October, though runtime support ships as launch-specific images and a branch, and Groq lists it as a preview (12 of 15). 13 + 0 + 15 + 2 + 12 = 42.

Payments & pricing Muse Spark Open +30

Azure OpenAI in Foundry Models 20

No x402, MPP or L402 (0). Per-1M-token prices are public in the Azure Retail Prices API without a login, while the pricing page fills its table with JavaScript and showed GPT-6 prices as pending on 6 October (20). The quota tiers include a Free tier, but an Azure subscription needs a payment method (0). A person signs up for Azure in a browser and creates a resource and a deployment before the first call (0).

Muse Spark Open 50

Self-hosted rule. Nothing to buy from Meta, and the licence grants use free of charge. The Model as a Service clause asks for a separate agreement only from licensee groups above $20M gross revenue in 12 months (20). Free to run with no card (20). Meta's own weights need a manually reviewed Hugging Face form with legal name and date of birth, or, since the 4 November re-read of Get the model, a signed-in download from Meta's own page, so an agent can't get them alone. The ungated GGUF quantisations from ggml-org and Unsloth that Meta's docs point to download without approval (the Unsloth repository is ungated on 4 November), so part of the line (10 of 20). No payment protocol (0). Hosted copies at $1.25 input and $4.25 output per million tokens need each provider's own account and are not graded. 20 + 20 + 10 + 0 = 50.

Transparency & trust Azure OpenAI in Foundry Models +30

Azure OpenAI in Foundry Models 83

Closed service under the Microsoft Product Terms, with the v1 spec under MIT and the OpenAI SDKs under Apache-2.0 (15). The data privacy page agrees with the product terms on no training and states where data is processed and stored by deployment type, but gives no retention period for the human-review store and sits beside a 30-day default for Responses data (24 of 30). A published lifecycle policy and a retirement schedule with dates and replacements, but on 6 November the schedule listed gpt-realtime-mini 2025-10-06 and 2025-12-15 twice each with different retirement dates, and no GPT-6 model yet (18 of 20, down from 20). Data locations stated for Standard, Data Zone and Global deployments, and a public sub-processor list per the 5 October Azure Speech check, not re-read (20).

Muse Spark Open 53

Weights are downloadable under the Muse Model Licence, which is clear and broad in its grant but not an OSI licence. It adds a display requirement, a separate agreement before Model as a Service by a licensee group above $20M gross revenue, and a Usage Policy with field-of-use limits (military, nuclear, espionage, critical infrastructure, heavy machinery) and an age limit of 18. It has no regional exclusion and no governing-law clause. Training code and data aren't released (18 of 30). Inputs stay on the owner's hardware, and Meta's docs say self-hosting keeps 'every prompt and response' inside the owner's infrastructure. The access form's details, and a download from Meta's own page after signing in, go to Meta under its general privacy policy, which we didn't read, and the training data is described in outline only (20 of 30). No deprecation policy, dated notices or versioning found (0 of 20). The Get the model page says everything runs offline once the weights land, and safetensors weights carry no code. No other telemetry statement, and Meta's download form records name, date of birth, country and IP location (12 of 20). 18 + 20 + 0 + 12 = 50.

Agent ergonomics Azure OpenAI in Foundry Models +29

Azure OpenAI in Foundry Models 98

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Tool use with parallel calls and a forced call by naming the function in tool_choice, 18 of 20 because gpt-6.1-sol calls tools only through the Responses API (18). Strict structured outputs (15). Prompt caching from 1,024 tokens, cached input at 0.1x on GPT-6 ($1 per million on Astra) and cache writes at 1.25x from GPT-5.6 on, with explicit breakpoints (15). 1,050,000-token context on GPT-6 and GPT-6.1, input capped at 922,000 (15). Batch at 50% off Global Standard with a 24-hour target (10). The docs use OpenAI's own SDKs for Python, JavaScript, C#, Go and Java against the v1 endpoint (10). 429 and quota errors documented with retry headers (15). Calls name a deployment rather than a model, so each model must be deployed in the resource first, which the model checklist doesn't score.

Muse Spark Open 69

Model reading of the checklist (tool use, structured output, caching, context, throughput, defaults and SDKs, errors). OpenAI-format tools and parallel calls come back as tool_calls, and the template supports namespaced tools and deferred loading through a tool_search tool. A forced tool_choice is not documented (17 of 20). JSON mode and JSON Schema come from each runtime's guided decoding, which Meta's docs show for TensorRT-LLM only (8 of 15). Prefix caching is the runtime's. Meta's SGLang command turns on hierarchical caching, and Dynamo routes each request to the worker holding its cached context (8 of 10). 1,048,576-token context, with sliding-window attention on 46 of 62 layers holding KV memory down (15 of 15). Draft models for speculative decoding in SGLang and vLLM, and no batch mode of its own (7 of 10). Any OpenAI SDK works against a local server, but reasoning can't be turned off, defaults to the most expensive level, and needs streaming, a max_tokens budget for reasoning and the right stop tokens (6 of 15). The template raises named errors for an unsupported reasoning effort, tool arguments passed as a string and a tool message with no name. Server errors are the runtime's (8 of 15). 17 + 8 + 8 + 15 + 7 + 6 + 8 = 69.

Schema & documentation Azure OpenAI in Foundry Models +26

Azure OpenAI in Foundry Models 87

OpenAPI 3.2 spec for the v1 data plane in Azure/azure-rest-api-specs (azure-v1-v1-generated.json, 71 paths and 852 schemas), linked from the v1 API page (25). No llms.txt at learn.microsoft.com (404). Learn pages offer Copy Markdown and the Markdown sources are public in MicrosoftDocs/azure-ai-docs, last merged 5 October (5 of 10). The models page lists each model's capabilities, context and API support, but the model choice guide, dated 19 May 2026, doesn't cover GPT-6 (15 of 20). Structured outputs with strict: true on schemas and function tools, though not together with parallel function calls (15). Examples in Python, C#, JavaScript, Go, Java and REST, and an error table on the quotas page with a fix for 429 and other codes (15). The v1 path replaces monthly api-version values, with preview capabilities opted into by header, a dated API version changelog and dated model versions. On 6 November the Foundry what's new still covered August, though updated on 5 November, and no Azure OpenAI what's new was found at learn.microsoft.com/en-us/azure/foundry/openai/whats-new, which answered 404 (12 of 15).

Muse Spark Open 61

Read for a model the owner serves. No specification of its own. The contract is the Jinja chat template, which renders OpenAI-format tools with additionalProperties: false added and rejects bad values, plus the OpenAI-compatible servers in vLLM and SGLang with the muse parsers (10 of 25). dev.meta.ai/llms.txt lists the Muse Spark Open overview and seven pages under it, plus three cookbook pages, each with a Markdown copy (10). The card lists seven intended uses and six limitations, the docs say when to pick BF16 or NVFP4 and which reasoning strength suits which task, and the Usage Policy states what is out of scope (17 of 20). reasoning_effort is an enum of four values and anything else returns an error, and tools take JSON Schema. Structured output is documented only for TensorRT-LLM's response_format, not in the prompting guide or for vLLM and SGLang (11 of 15). curl and Python examples for every runtime and hosted provider, the rendered prompt for each case, and the template's own error messages, but no error reference for a served model (11 of 15). One release, with no changelog or version scheme beyond the licence's version line, Muse Spark Open (2 of 15). 10 + 10 + 17 + 11 + 11 + 2 = 61.

Score by category

CategoryWeight this runAzure OpenAI in Foundry ModelsMuse Spark OpenEdge
Reliability16%208042Azure OpenAI in Foundry Models +38
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28761Azure OpenAI in Foundry Models +26
Agent ergonomics13%16.29869Azure OpenAI in Foundry Models +29
Security & auth14%17.59544Azure OpenAI in Foundry Models +51
Payments & pricing10%12.52050Muse Spark Open +30
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88660Azure OpenAI in Foundry Models +26
Transparency & trust7%8.88353Azure OpenAI in Foundry Models +30
Negative events≤1500
TotalA 80/100D 53.4/100

Facts side by side

FactAzure OpenAI in Foundry ModelsMuse Spark Open
KindModel APIModel API
VendorMicrosoftMeta
Hosted endpointhttps://<resource>.openai.azure.com/openai/v1no (local only)
TransportsHTTPHTTP
AuthOAuth or keyNone
PricingPay per useFree
x402nono
LicenceProprietary service under the Microsoft Product Terms. The v1 OpenAPI spec is MIT, and the OpenAI SDKs the docs use are Apache-2.0Muse Model Licence (source-available weights, not an OSI licence), free of charge with an attribution notice, a separate agreement with Meta before Model as a Service by a licensee group above $20M gross revenue, and the Muse Spark Open Usage Policy
Read-only variant documentednono
llms.txtnoyes
Last release2026-10-262026-10-15
Terms last updatedno date given2026-10-15
Privacy policy last updated2026-09-01no document linked
Customer content may train modelsyesnot found in the text
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waivernot found in the textnot found in the text
Popularity454k npm/wknone

What the same task costs

TaskAzure OpenAI in Foundry ModelsMuse Spark Open
Research a product and write a sourced reportgpt-6-astra on Azure OpenAI in Foundry Models, meta/muse-spark-open on Muse Spark Open$110$2.03
Build a small four-page websitegpt-6-astra on Azure OpenAI in Foundry Models, meta/muse-spark-open on Muse Spark Open$25.07$0.63
Find and fix a bug in a large codebasegpt-6-astra on Azure OpenAI in Foundry Models, meta/muse-spark-open on Muse Spark Open$5.41$0.15

Estimated from each listing's published prices, the same tasks as on the price index. Plans, minimums and free allowances aren't counted.

How the scores have moved

Verdicts

Azure OpenAI in Foundry Models

An OpenAI-compatible v1 API with a public OpenAPI spec, Entra ID roles in place of shared keys and FedRAMP High scope, with GPT-6 and GPT-6.1 at OpenAI's list prices on Global Standard. Access needs an Azure subscription with a card and a deployment per model, and a 29 September 2026 incident caused about six hours of failures in Sweden Central.

Muse Spark Open

Muse Spark Open runs on the owner's hardware in seven runtimes, with OpenAI-compatible servers in vLLM and SGLang, standard tool calls, a 1M-token context and Meta's own serving docs. Serving the 537 GB NVFP4 checkpoint takes four B300 GPUs, Meta's download is gated by manual review, and the licence adds attribution and a revenue threshold for model resellers.

Before you call either

Azure OpenAI in Foundry Models

  1. Point the OpenAI SDK at https://<resource>.openai.azure.com/openai/v1/ and pass the deployment name as model, not the model id
  2. Prefer Entra ID with the Cognitive Services OpenAI User role over the resource key, which opens the whole data plane
  3. On 429 wait for retry-after-ms, then back off with jitter. The OpenAI SDK retries twice by default
  4. Set store: false on Responses calls you don't need kept. Stored responses persist 30 days by default
  5. Keep remote MCP approvals on for servers you don't control. They're required by default

Muse Spark Open

  1. Start vLLM or SGLang with --reasoning-parser muse --tool-call-parser muse (vLLM also --enable-auto-tool-choice), or tool calls come back as raw text
  2. Set reasoning_effort to low or medium for short tasks. The default is xhigh, reasoning can't be turned off, and other values return an error
  3. Stop only on <|eot|> and end of text. Stopping on <|eom|> cuts off tool calls and final answers
  4. Stream long generations and leave max_tokens room for reasoning, or content can come back empty with finish_reason length
  5. Don't call Meta Model API for this model. Use a self-hosted server or a hosted provider's model string, such as meta-models/muse-spark-open

Questions

Which is better for AI agents, Azure OpenAI in Foundry Models or Muse Spark Open?

Azure OpenAI in Foundry Models scores 80 (A) on agent readiness against Muse Spark Open's 53.4 (D), and leads in 6 of 7 scored categories. Muse Spark Open leads on payments & pricing.

Do Azure OpenAI in Foundry Models and Muse Spark Open need an API key?

Azure OpenAI in Foundry Models takes an API key or an OAuth sign-in. Muse Spark Open needs no key.

Can an agent call Azure OpenAI in Foundry Models and Muse Spark Open without installing anything?

Azure OpenAI in Foundry Models has a hosted endpoint at https://<resource>.openai.azure.com/openai/v1. No hosted endpoint is listed for Muse Spark Open.

Other comparisons with Azure OpenAI in Foundry Models or Muse Spark Open

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.