Beam 1.0 vs xAI API (Grok)

Beam 1.0 45

Model reading. API keys per project, revocable, shown once and disabled when their creator leaves, with no scopes, expiry or rotation API found (20 of 30). Training 10 of 20, partial kept. The API reference says each response's reflection-data-retention header reports contributor when content may be used to train Reflection's models "under contributor terms your organization accepted". The API safety page and commercial terms read on 17 October are struck (reflection.ai now disallows our crawler), so whether training is off by default can't be read. Retention 5 of 15, partial kept. The header can report zero, standard or contributor, and no readable page states periods or whether zero retention is offered. x-request-id on every response and the retention header, with usage dashboards behind the login and not read (5 of 15). Security programme 5 of 20 (was 6). The model card names reports@reflection.ai for security vulnerabilities; developers.reflection.ai has no security.txt (404 on 17 October), and the safety report and reflection.ai's security.txt can't be read. No bug bounty, SOC 2 or ISO 27001 found on a readable page. 20 + 10 + 5 + 5 + 5 = 45.

xAI API (Grok) 97

Model reading. Team API keys with ACLs per endpoint and per model, QPM and TPM caps, expiry, and create, rotate, disable and delete through the Management API, plus documented mTLS. GitHub secret scanning disables leaked keys and emails the owner (30). The security FAQ says SpaceXSI never trains on API inputs or outputs without explicit permission (20). Requests and responses are kept 30 days for abuse auditing, then deleted, and team admins can switch on zero data retention themselves, confirmed by an x-zero-data-retention header on every response (15). Console audit log and a Management API audit-events endpoint, plus optional per-key request logging (15). security.txt valid to 2027-06-29 with a HackerOne bug bounty and a separate safety contact for prompt-injection issues. SOC 2 Type 2 is claimed in the security FAQ with the reports behind an NDA in the trust centre, so 17 of 20. Remote MCP doesn't support require_approval, which the model checklist doesn't score but reviewers should see. New in October, a guidelines array lets the caller make the model decline nsfw, violence or profanity content, which the checklist doesn't score.

Beam 1.0 50

Model reading. The weights were published on 16 October 2026, the date on the Hugging Face model page (the repository was created on 7 October); later commits to 30 October add evaluation results and a guide, which record no model change (30). One model, with a shutdown_date field and a lifecycle section in the docs but no notice period for retirements, and no history of releases or retirements yet (4 of 20). No changelog. Support through the platform and developers@reflection.ai for higher limits, and the model card names reports@reflection.ai. The Hub page shows 15 discussions (10 open, 5 closed), replies not sampled (6 of 25). No first-party SDK, the docs rely on the OpenAI SDKs (5 of 15). Reflection's serving guides for vLLM, SGLang, TokenSpeed, Transformers and Dynamo, a Beam Verifier repository, and fine-tuning recipes now published for NeMo AutoModel, Megatron Bridge, Axolotl and TRL (5 of 10, partial kept). 30 + 4 + 6 + 5 + 5 = 50.

xAI API (Grok) 77

Model reading. grok-imagine-image-quality and grok-imagine-image-pro retired on 2 November 2026 as announced in September, Grok Voice 3.0 and custom moderation controls in October, Grok 4.7 on 21 September (30). No minimum notice period found. Retirements come as dated migration guides, retired slugs redirect to a replacement rather than failing, billed at the replacement's price, and grok-voice-2.0 was deprecated in October with no end date (4 of 12). Shutdowns in the last 90 days with dates given in advance, grok-voice-transcribe-1.0 on 2 October and grok-imagine-image-quality on 2 November (8 of 8). Release notes several times a month but dated only by month, support by email and a Discord #help channel, not tested. On xai-sdk-python a collaborator commented on 2 of the 16 most recent threads with replies, and most outside pull requests since 23 October are open without a maintainer reply (10 of 15, down from 12). The repository has CI, release and version-bump workflows (5 of 10). One current first-party SDK, xai-sdk 1.21.0 tagged on 23 October, Python only (10 of 15). Supported runtimes stated, Python 3.10 or later (10).

Beam 1.0 67

Model reading (tool use, structured output, caching, context, batch, SDKs and defaults, errors). tool_choice of auto, none, required or a named function, parallel_tool_calls, strict tools and up to 128 tools. The tool-calling loop needs reasoning_content sent back on every assistant turn, and the docs say the model sometimes returns a tool-call step without it, after which every request in the session fails (12 of 20). json_object and strict json_schema (15). Cached prompt tokens are reported in usage, but caching can't be steered, the prompt_cache_* options are ignored and no cached price exists in the beta (5 of 10). 1,048,576-token context and 131,072 output tokens (15). No batch endpoint (0 of 10). No Reflection SDK, the OpenAI Python and TypeScript SDKs are documented, and defaults cost an agent turns, with reasoning always on at max, stop and seed ignored and a default output budget not reduced to fit the prompt (5 of 10). Machine-readable error.code values with param, x-should-retry, Retry-After and x-request-id (15). 12 + 15 + 5 + 15 + 0 + 5 + 15 = 67, per the 17 October reading of the developers guides, not re-read on 4 November beyond the models and rate-limits pages.

xAI API (Grok) 90

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Function calling with parallel calls on by default and tool_choice of auto, required, none or a named function (20). Guaranteed structured outputs (15). Automatic prompt caching, cached input at 0.25x on grok-4.7 ($0.50 per million) and 0.16x on grok-4.3 (15). 500,000-token context on grok-4.7 and 1,000,000 on grok-4.3, 13 of 15 for the default model's 500K. The Batch API is now 20% off on grok-4.7, 4.6 and 4.5 as well as the older models, with batch requests outside the rate limits (10 of 10, up from 5 on 6 October). One first-party SDK, xai-sdk for Python, with the OpenAI SDKs and Vercel's AI SDK documented as alternatives (5 of 10). Status codes documented with fixes, no Retry-After header found (12 of 15).

Beam 1.0 10

Graded on the Reflection API. No x402, MPP or L402 (0). No per-token, plan or allocation price is published on any readable page; the beta pricing page on reflection.ai is struck (0, was 10). Free tier 10 of 20, partial kept. The rate-limits page describes a daily token allowance and asks those requesting higher limits whether they are "interested in paid usage", and the authentication page says some organisations must verify a credit card before keys work. A person signs up in the browser at platform.reflection.ai to get a key (0). 0 + 0 + 10 + 0 = 10.

xAI API (Grok) 20

No x402, MPP or L402 (0). Per-token and per-call prices published without a login on docs.x.ai/developers/pricing (20). No free tier found for the text API, and the quickstart says to load the account with credits (0). Sign-up is in the browser at console.x.ai. The Management API can create keys and top up prepaid credit, but only with a management key made by a person in the console, so no line credit (0).

Beam 1.0 57

Weights under Apache-2.0, an OSI licence, per the model card, which says the licence doesn't restrict distillation or training on outputs. The hosted API is a closed service whose commercial terms are on reflection.ai and can no longer be read (25 of 30, kept). Data handling 10 of 30, partial kept. What remains readable is the API reference's retention header (zero, standard, contributor) and the rate-limits page's request for data retention requirements; the terms, privacy policy, API safety page and zero-retention page are struck. Deprecation 4 of 20 (was 6). A shutdown_date field and a lifecycle section that says to move off a model before that date, with no notice period or dated notice; the fee-increase notice came from the struck terms. Subprocessors 0 of 20 (was 18). The list read on 17 October is on reflection.ai and struck, and no readable page names subprocessors or data locations. 25 + 10 + 4 + 0 = 39.

xAI API (Grok) 63

Closed service under xAI's enterprise terms, with the Python SDK under Apache-2.0 (15). The docs agree with each other on no training, 30-day abuse retention, 30-day storage of stateful responses and the ZDR route, but the privacy policy, enterprise terms and DPA at x.ai/legal answered a Cloudflare block page on 6 October and again on 6 November, so they couldn't be compared (15 of 30). Dated migration guides and redirect tables for each retirement, but no written deprecation policy, and Chat Completions, Anthropic compatibility and grok-voice-2.0 are labelled deprecated with no date (12 of 20). The US regional endpoint states what stays in the US, the global endpoint guarantees no region, and no subprocessor list was readable (10 of 20).