SambaCloud vs StepFun API

SambaCloud

Per-token prices and the model list are readable without a key at /v1/models, and a free tier needs no card. Production models get two to three weeks' notice before removal, 13 model ids left between March and June 2026, and the docs disagree with the live catalogue on MiniMax-M2.7.

StepFun API

StepFun's API serves Step 5 Preview with a 1M-token context, video input, strict JSON Schema output and published per-token prices, documented in Markdown with an llms.txt. The model is a preview with no release date found, there's no free allowance or SLA, and the terms and privacy policy leave room to train on customer data.

SambaCloud

1. Call GET https://api.sambanova.ai/v1/models at start-up and use only ids it returns. The docs name models the endpoint no longer lists
2. Read x-ratelimit-remaining-requests and x-ratelimit-remaining-requests-day on every response. The free tier allows 20 requests a day per model
3. Treat 429 queue_full and 503 maintenance as retryable after a delay, and 410 model_deprecated as a signal to change model
4. Validate JSON output yourself. Schema enforcement is best effort and strict: true changes nothing
5. Check max_completion_tokens per model. DeepSeek-V3.1 caps output at 7,168 tokens and Llama 3.3 70B at 3,072

StepFun API

1. Set max_tokens yourself. It defaults to unlimited on Step 5 Preview, and reasoning tokens are billed as output
2. Use response_format with type: json_schema and strict: true when the shape matters. JSON Mode alone isn't schema-checked
3. Back off and retry on 429, 500, 503 and 504. The docs give no Retry-After header or backoff schedule
4. Expect HTTP 451 or finish_reason: content_filter when content fails StepFun's review, and don't retry the same input
5. Use api.stepfun.ai for the international platform. api.stepfun.com is the China platform with yuan pricing