DeepInfra vs RouterPlus

DeepInfra

The model list, context sizes and per-token prices are readable without a key, and keys can carry an IP allowlist, a monthly spending cap and model-limited JWTs. Deprecated models get one week's notice and are then redirected to another model, there is no changelog or SLA, and an account needs a card or prepayment before any call.

RouterPlus

The docs are written for agents, every model price is public, and each response carries its own cost. No terms of service, privacy policy, status page or changelog were found. Signup adds no free credit, and the chat catalogue is Claude and GPT only.

DeepInfra

1. Call GET https://api.deepinfra.com/v1/openai/models at start-up for ids, context sizes and prices. No key is needed
2. Check the model field of each response. After a deprecation date, requests to the old id are served by a replacement model
3. Ask the account owner for a scoped JWT limited to the models and spend the task needs, not the full API key
4. Stay under 200 concurrent requests per model. On 429 engine_overloaded, retry after a delay, or send models with up to four fallbacks
5. Never inspect a JWT with GET /v1/scoped-jwt?jwtoken=, which puts the token in the URL. Keep credentials in the Authorization header

RouterPlus

1. Send max_tokens on every request. Without it the balance hold assumes up to 32,768 output tokens and can return insufficient_quota on a small balance
2. Switch on error_type. Retry rate_limit after retry-after, and stop on insufficient_quota, which needs a person to add credit or raise a cap
3. Don't add a retry loop on top of the SDK's. There is no idempotency key, so a retry that reaches a provider is billed again
4. Copy model ids from GET /v1/models or /api/models.json. An unknown id is a 404 and the gateway never substitutes one
5. Use /v1/messages for Claude when you need thinking or server tools, and /v1/chat/completions with response_format only for GPT ids