Nemotron 3.5 Super VL vs Novita AI

Nemotron 3.5 Super VL

NVIDIA's free endpoint takes OpenAI-format requests with typed tool calls, JSON Schema output and an OpenAPI 3.1 file, and the weights run anywhere under a permissive licence. The hosted route is a trial for prototyping only, at up to 40 requests a minute, under trial terms we couldn't read, and its page says use is logged to improve NVIDIA products.

Novita AI

Per-token prices for about 140 language models are public, and each key can carry an expiry, a model allowlist and a source IP allowlist. No status page, SLA or security.txt was found, the per-model rate limit figures are drawn by script, and both vendor SDK repositories are archived while the docs still point to them.

Nemotron 3.5 Super VL

1. Set chat_template_kwargs to {"enable_thinking": false} for short tasks. Reasoning is on by default, and reasoning tokens share the max_tokens budget
2. Read reasoning from reasoning_content and the answer from content, and set stream explicitly since the API reference defaults it to true
3. Don't send confidential or personal data to the hosted trial. The model page asks callers not to and says use is logged
4. Back off and retry on throttling. Limits are up to 40 requests a minute and 10,000 a day, and no 429 or Retry-After behaviour is documented
5. For production, use a partner endpoint or serve the weights. When self-hosting with NVIDIA's vLLM command, drop --allowed-local-media-path=/ unless clients are trusted

Novita AI

1. Set the OpenAI client base URL to https://api.novita.ai/openai and send the key as Authorization: Bearer. Keys start with sk_
2. Do not close a connection to stop generation. A request that reached the model is billed in full under status 499, so cap output with max_tokens
3. On 429, check whether the code is RATE_LIMIT_EXCEEDED or TOKEN_LIMIT_EXCEEDED and back off exponentially. No Retry-After header is documented
4. Read the changelog for retirement notices before pinning a model id. One retirement in October 2026 came with 11 days' notice
5. Ask the account owner for a key with an expiry, a model access policy and an IP allowlist. Keys are created and deleted only in the console