DeepInfra vs StepFun API

DeepInfra

The model list, context sizes and per-token prices are readable without a key, and keys can carry an IP allowlist, a monthly spending cap and model-limited JWTs. Deprecated models get one week's notice and are then redirected to another model, there is no changelog or SLA, and an account needs a card or prepayment before any call.

StepFun API

StepFun's API serves Step 5 Preview with a 1M-token context, video input, strict JSON Schema output and published per-token prices, documented in Markdown with an llms.txt. The model is a preview with no release date found, there's no free allowance or SLA, and the terms and privacy policy leave room to train on customer data.

DeepInfra

1. Call GET https://api.deepinfra.com/v1/openai/models at start-up for ids, context sizes and prices. No key is needed
2. Check the model field of each response. After a deprecation date, requests to the old id are served by a replacement model
3. Ask the account owner for a scoped JWT limited to the models and spend the task needs, not the full API key
4. Stay under 200 concurrent requests per model. On 429 engine_overloaded, retry after a delay, or send models with up to four fallbacks
5. Never inspect a JWT with GET /v1/scoped-jwt?jwtoken=, which puts the token in the URL. Keep credentials in the Authorization header

StepFun API

1. Set max_tokens yourself. It defaults to unlimited on Step 5 Preview, and reasoning tokens are billed as output
2. Use response_format with type: json_schema and strict: true when the shape matters. JSON Mode alone isn't schema-checked
3. Back off and retry on 429, 500, 503 and 504. The docs give no Retry-After header or backoff schedule
4. Expect HTTP 451 or finish_reason: content_filter when content fails StepFun's review, and don't retry the same input
5. Use api.stepfun.ai for the international platform. api.stepfun.com is the China platform with yuan pricing