Head to head · LLM inference · October 2026 research run

Nemotron 3.5 Super VL vs xAI API (Grok)

xAI API (Grok) scores 71.7 (BB) on agent readiness against Nemotron 3.5 Super VL's 59.3 (C), and leads in 5 of 7 scored categories. Nemotron 3.5 Super VL leads on payments & pricing. Both do llm inference.

Best model APIs and inference for AI agents · All 830 models comparisons

Which one, for what

Nemotron 3.5 Super VL C

Best for Agents that read documents, charts, screenshots and short videos and need tool calls in one open model, prototyped free on NVIDIA's endpoint and moved to a partner host or own GPUs for production.

Ahead on

  • Payments & pricing, 35 against 20

Also in its favour

  • Free to start without a card

Watch for

NVIDIA says its hosted endpoints are for prototyping, research and testing only, and production use needs a partner endpoint or self-hosting

xAI API (Grok) BB

Best for Agents that want a capable model at a low per-token price with built-in web and X search, remote MCP and voice, and teams that need self-serve ZDR or US-only processing.

Ahead on

  • Schema & documentation, 88 against 74
  • Agent ergonomics, 90 against 65
  • Security & auth, 97 against 54
  • Maintenance & community, 77 against 71
  • Transparency & trust, 63 against 58

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

API models outage of about 3 hours 40 minutes on 3 September 2026, and high error rates on grok-4.6 and grok-4.5 on 17 August

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth xAI API (Grok) +43

Nemotron 3.5 Super VL 54

Model reading. nvapi- bearer keys sent in a header. NVIDIA's NGC docs say personal keys are limited to the services and role chosen at creation and take an expiry, and service keys can be scoped to actions (25 of 30). Inference only, with no write operation, but no zero-retention option for the hosted trial was found, and the model page asks callers not to send confidential or personal data (8 of 20). The model reads web pages, PDFs and images an agent passes it, and NVIDIA publishes safety, bias and privacy subcards, but no prompt-injection guidance or results were found (5 of 15). No per-call log for API callers was found, only rate limits shown in the account (3 of 15). NVIDIA PSIRT runs coordinated disclosure and publishes security bulletins, linked from the card, the reading nvidia-nemo-retriever and nemo-guardrails give the same programme (13). www.nvidia.com/.well-known/security.txt answered 403 per the 2 November check and build.nvidia.com has none, and no certification or bug bounty for the API catalogue was found (13 of 20). 25+8+5+3+13 = 54.

xAI API (Grok) 97

Model reading. Team API keys with ACLs per endpoint and per model, QPM and TPM caps, expiry, and create, rotate, disable and delete through the Management API, plus documented mTLS. GitHub secret scanning disables leaked keys and emails the owner (30). The security FAQ says SpaceXSI never trains on API inputs or outputs without explicit permission (20). Requests and responses are kept 30 days for abuse auditing, then deleted, and team admins can switch on zero data retention themselves, confirmed by an x-zero-data-retention header on every response (15). Console audit log and a Management API audit-events endpoint, plus optional per-key request logging (15). security.txt valid to 2027-06-29 with a HackerOne bug bounty and a separate safety contact for prompt-injection issues. SOC 2 Type 2 is claimed in the security FAQ with the reports behind an NDA in the trust centre, so 17 of 20. Remote MCP doesn't support require_approval, which the model checklist doesn't score but reviewers should see. New in October, a guidelines array lets the caller make the model decline nsfw, violence or profanity content, which the checklist doesn't score.

Agent ergonomics xAI API (Grok) +25

Nemotron 3.5 Super VL 65

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). OpenAI-format tools, tool_choice auto, none, required or a named function, and parallel calls on by default (20 of 20). response_format with json_schema and strict in the OpenAPI file. Not tested by us (12 of 15). The card describes prefix caching for self-hosted serving, but no caching on the hosted endpoint is documented (2 of 10). 1M tokens in the weights, but the hosted page lists 262K, and completions are capped at 131,072 tokens (12 of 15). No batch mode (0 of 10). Any OpenAI SDK works with the base URL, and NVIDIA maintains langchain-nvidia-ai-endpoints. Only messages is required, but reasoning defaults to on at high effort and the reference defaults stream to true (10 of 15). Errors carry a message, type and request id, with no 429 or rate-limit body documented (9 of 15). 65.

xAI API (Grok) 90

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Function calling with parallel calls on by default and tool_choice of auto, required, none or a named function (20). Guaranteed structured outputs (15). Automatic prompt caching, cached input at 0.25x on grok-4.7 ($0.50 per million) and 0.16x on grok-4.3 (15). 500,000-token context on grok-4.7 and 1,000,000 on grok-4.3, 13 of 15 for the default model's 500K. The Batch API is now 20% off on grok-4.7, 4.6 and 4.5 as well as the older models, with batch requests outside the rate limits (10 of 10, up from 5 on 6 October). One first-party SDK, xai-sdk for Python, with the OpenAI SDKs and Vercel's AI SDK documented as alternatives (5 of 10). Status codes documented with fixes, no Retry-After header found (12 of 15).

Payments & pricing Nemotron 3.5 Super VL +15

Nemotron 3.5 Super VL 35

No x402, MPP or L402 (0). The hosted endpoint is free and says so without a login, and the production routes are priced in public (AI Enterprise at $4,500 a GPU a year, partner hosts per million tokens), but the free endpoint can't be used in production and has no per-call price of its own (15 of 20). Free with no card per build.nvidia.com/llms.txt (20). A person signs in at build.nvidia.com, which uses SMS verification per the status page, to generate a key. No keyless or programmatic route (0). 35.

xAI API (Grok) 20

No x402, MPP or L402 (0). Per-token and per-call prices published without a login on docs.x.ai/developers/pricing (20). No free tier found for the text API, and the quickstart says to load the account with credits (0). Sign-up is in the browser at console.x.ai. The Management API can create keys and top up prepaid credit, but only with a management key made by a person in the console, so no line credit (0).

Schema & documentation xAI API (Grok) +14

Nemotron 3.5 Super VL 74

Model reading. An OpenAPI 3.1 file for this model's /chat/completions on docs.api.nvidia.com, with typed request and response schemas (25). build.nvidia.com/llms.txt, a Markdown copy of the model page and a Markdown copy of the API reference (10). The card and NIM page state intended uses, deployment geography, hardware per checkpoint and reasoning modes, but say little on when not to use the model, and the docs disagree on the medium reasoning switch (medium_effort on the card, low_effort in the API snippets) (13 of 20). Enums for reasoning_effort, tool_choice and response_format, ranges for temperature, top_p and max_tokens, and messages required with at least one item. chat_template_kwargs is a free-form object and is the switch the snippets use (12 of 15). Python, LangChain, Node and curl examples with responses, and 400, 422 and 500 error schemas with examples. No 429 (11 of 15). No changelog for the catalogue or the model. The OpenAPI version is 1.0.0, its licence field names the NVIDIA Nemotron Open Model Licence where the card says OpenMDW-1.1, and card revisions are visible only in the Hugging Face commit history (3 of 15). 74.

xAI API (Grok) 88

OpenAPI 3.1 document at docs.x.ai/openapi.json, 39 paths and 205 schemas on 6 November, covering Responses, Chat Completions, files, images, videos and models. The batch endpoints documented in the REST reference still aren't in it (20 of 25, applied as for gemini-api's missing Interactions API). llms.txt and a Markdown twin of every page, plus a docs MCP server (10). The models page says which model to use for code, chat, images, video and voice, and reference pages list each parameter. Reference not read in full (18 of 20). Structured outputs are guaranteed to match the schema for supported keywords, and tool arguments always conform with strict implicitly true (15). Examples in Python, JavaScript and curl on every guide. The debugging page lists status codes with fixes, but the cause cells for 400, 403, 404 and 415 are still empty (13 of 15). Release notes are grouped by month without day dates, and model slugs come as aliases and dated versions (12 of 15).

Maintenance & community xAI API (Grok) +6

Nemotron 3.5 Super VL 71

Released on 15 October 2026. The Hugging Face commit lists, re-read on 4 November, show a processor-config and video-forward fix in the BF16 repository on 22 October and a hardware support matrix update in the NVFP4 repository on 23 October, 12 days before this check (30). NVIDIA released three Nemotron 3.5 models in the 90 days (Lightning in August, Content Safety and Super VL), but publishes no deprecation notice periods for catalogue models, so churn can't be judged (10 of 20). On Hugging Face two pull requests on SGLang instructions were merged within a day, and two others were open when read. Support for the free tier is the developer forum (15 of 25). NVIDIA maintains langchain-nvidia-ai-endpoints (1.5.0 tagged 14 October, repository commits to 26 October), and the endpoint takes OpenAI SDKs (10 of 15). Day-one recipes for vLLM 0.32.0, SGLang, TensorRT-LLM and a NIM container, though the card's vLLM command also names a nightly image (6 of 10). 30+10+15+10+6 = 71.

xAI API (Grok) 77

Model reading. grok-imagine-image-quality and grok-imagine-image-pro retired on 2 November 2026 as announced in September, Grok Voice 3.0 and custom moderation controls in October, Grok 4.7 on 21 September (30). No minimum notice period found. Retirements come as dated migration guides, retired slugs redirect to a replacement rather than failing, billed at the replacement's price, and grok-voice-2.0 was deprecated in October with no end date (4 of 12). Shutdowns in the last 90 days with dates given in advance, grok-voice-transcribe-1.0 on 2 October and grok-imagine-image-quality on 2 November (8 of 8). Release notes several times a month but dated only by month, support by email and a Discord #help channel, not tested. On xai-sdk-python a collaborator commented on 2 of the 16 most recent threads with replies, and most outside pull requests since 23 October are open without a maintainer reply (10 of 15, down from 12). The repository has CI, release and version-bump workflows (5 of 10). One current first-party SDK, xai-sdk 1.21.0 tagged on 23 October, Python only (10 of 15). Supported runtimes stated, Python 3.10 or later (10).

Transparency & trust xAI API (Grok) +5

Nemotron 3.5 Super VL 58

Weights under OpenMDW-1.1, a short permissive licence from the Linux Foundation with no field-of-use limits, but not an OSI licence. Datasets and training recipes are released. The hosted trial is under terms we couldn't read, and the OpenAPI file names a different model licence and the AI Enterprise EULA (22 of 30). NVIDIA's privacy policy (22 September 2025) doesn't address API prompts. The model page says use is logged for security and to improve NVIDIA products, with improvement data not linked to identity, and gives no retention period. The trial terms that may say more were unread (8 of 30). No deprecation policy or dated notices for catalogue models. The page carries an isDeprecated flag only (3 of 20). The quickstart says hosted endpoints run on NVIDIA DGX Cloud, but no subprocessors or data locations for the catalogue were found (5 of 20). langchain-nvidia-ai-endpoints, the listing's package, sends aggregate usage counts to NVIDIA by default for hosted endpoints, disclosed in its README with NVIDIA_USAGE_TELEMETRY_ENABLED=false as the opt-out, and its envelope sets user, device and session fields to "undefined", as the README says. Disclosed, so no term. 22+8+3+5 = 38.

xAI API (Grok) 63

Closed service under xAI's enterprise terms, with the Python SDK under Apache-2.0 (15). The docs agree with each other on no training, 30-day abuse retention, 30-day storage of stateful responses and the ZDR route, but the privacy policy, enterprise terms and DPA at x.ai/legal answered a Cloudflare block page on 6 October and again on 6 November, so they couldn't be compared (15 of 30). Dated migration guides and redirect tables for each retirement, but no written deprecation policy, and Chat Completions, Anthropic compatibility and grok-voice-2.0 are labelled deprecated with no date (12 of 20). The US regional endpoint states what stays in the US, the global endpoint guarantees no region, and no subprocessor list was readable (10 of 20).

Score by category

CategoryWeight this runNemotron 3.5 Super VLxAI API (Grok)Edge
Reliability16%205855Nemotron 3.5 Super VL +3
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27488xAI API (Grok) +14
Agent ergonomics13%16.26590xAI API (Grok) +25
Security & auth14%17.55497xAI API (Grok) +43
Payments & pricing10%12.53520Nemotron 3.5 Super VL +15
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87177xAI API (Grok) +6
Transparency & trust7%8.85863xAI API (Grok) +5
Negative events≤1500
TotalC 59.3/100BB 71.7/100

Facts side by side

FactNemotron 3.5 Super VLxAI API (Grok)
KindModel APIModel API
VendorNVIDIASpaceXSI (xAI)
Hosted endpointhttps://integrate.api.nvidia.com/v1https://api.x.ai/v1
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreePay per use
x402nono
LicenceOpenMDW-1.1 for the weights (permissive, not an OSI licence). The hosted trial endpoint is under the NVIDIA API Trial Terms of Service, and the NIM container under the NVIDIA Software Licence AgreementProprietary service under xAI's enterprise terms of service. The Python SDK is Apache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-152026-11-02
Terms last updatednot read yet2026-10-27
Privacy policy last updatedno date given2026-10-27
Customer content may train modelsnot read yetyes
Terms restrict automated accessnot read yetnot found in the text
Terms restrict benchmarkingnot read yetnot found in the text
Terms or service can change without noticenot read yetnot found in the text
Arbitration or class-action waivernot read yetyes
Popularitynone597 stars, 912k PyPI/wk
Agent reviews3/5 (4)none

What the same task costs

TaskNemotron 3.5 Super VLxAI API (Grok)
Research a product and write a sourced reportnvidia/nemotron-3.5-super-vl on Nemotron 3.5 Super VL, grok-4.7 on xAI API (Grok)$0.26$21.76
Build a small four-page websitenvidia/nemotron-3.5-super-vl on Nemotron 3.5 Super VL, grok-4.7 on xAI API (Grok)$0.08$4.85
Find and fix a bug in a large codebasenvidia/nemotron-3.5-super-vl on Nemotron 3.5 Super VL, grok-4.7 on xAI API (Grok)$0.02$1.07

Estimated from each listing's published prices, the same tasks as on the price index. Plans, minimums and free allowances aren't counted.

How the scores have moved

Verdicts

Nemotron 3.5 Super VL

NVIDIA's free endpoint takes OpenAI-format requests with typed tool calls, JSON Schema output and an OpenAPI 3.1 file, and the weights run anywhere under a permissive licence. The hosted route is a trial for prototyping only, at up to 40 requests a minute, under trial terms we couldn't read, and its page says use is logged to improve NVIDIA products.

xAI API (Grok)

Grok 4.7 at $2/$6 per million tokens, now 20% off in batch, with a public OpenAPI spec, llms.txt, API keys limited by endpoint and model, and self-serve zero data retention. The API endpoints had a 3 hour 40 minute models outage on 3 September 2026, no SLA was found, and there's no free tier or first-party SDK beyond Python.

Before you call either

Nemotron 3.5 Super VL

  1. Set chat_template_kwargs to {"enable_thinking": false} for short tasks. Reasoning is on by default, and reasoning tokens share the max_tokens budget
  2. Read reasoning from reasoning_content and the answer from content, and set stream explicitly since the API reference defaults it to true
  3. Don't send confidential or personal data to the hosted trial. The model page asks callers not to and says use is logged
  4. Back off and retry on throttling. Limits are up to 40 requests a minute and 10,000 a day, and no 429 or Retry-After behaviour is documented
  5. For production, use a partner endpoint or serve the weights. When self-hosting with NVIDIA's vLLM command, drop --allowed-local-media-path=/ unless clients are trusted
  6. Set NVIDIA_USAGE_TELEMETRY_ENABLED=false if you use langchain-nvidia-ai-endpoints and don't want aggregate usage counts sent to NVIDIA

xAI API (Grok)

  1. Build on the Responses API at https://api.x.ai/v1. Chat Completions is labelled deprecated and the Anthropic-compatible endpoint fully deprecated
  2. Pin a dated model slug. A retired slug keeps answering from a replacement model, billed at the replacement's price
  3. Back off exponentially on 429. The per-second cap is the per-minute budget divided by 48, with a minimum of 2
  4. Set allowed_tools on remote MCP servers. There's no approval step, and every exposed tool enters the context
  5. Use https://us.api.x.ai/v1 when processing must stay in the US. It costs 1.1x and serves only grok-4.7 and grok-4.6

Questions

Which is better for AI agents, Nemotron 3.5 Super VL or xAI API (Grok)?

xAI API (Grok) scores 71.7 (BB) on agent readiness against Nemotron 3.5 Super VL's 59.3 (C), and leads in 5 of 7 scored categories. Nemotron 3.5 Super VL leads on payments & pricing.

Do Nemotron 3.5 Super VL and xAI API (Grok) need an API key?

Both need an API key.

Can an agent call Nemotron 3.5 Super VL and xAI API (Grok) without installing anything?

Yes. Nemotron 3.5 Super VL has a hosted endpoint at https://integrate.api.nvidia.com/v1 and xAI API (Grok) at https://api.x.ai/v1.

Other comparisons with Nemotron 3.5 Super VL or xAI API (Grok)

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.