GroqCloud vs StepFun API

GroqCloud

Free plan with no card, at 30 requests a minute and 1,000 a day on gpt-oss. Four model shutdown dates between 2026-07-17 and 2026-09-21, with no stated minimum notice.

StepFun API

StepFun's API serves Step 5 Preview with a 1M-token context, video input, strict JSON Schema output and published per-token prices, documented in Markdown with an llms.txt. The model is a preview with no release date found, there's no free allowance or SLA, and the terms and privacy policy leave room to train on customer data.

GroqCloud

1. Call /models at start-up. Four model ids stopped working this quarter
2. Read retry-after on a 429 and the x-ratelimit-remaining-tokens header before the next call
3. Free plan allows 8,000 tokens a minute on gpt-oss, so keep prompts small or batch them
4. Don't build on Qwen 3.8 27B. It's a preview and previews can go at short notice
5. Treat a 498 as Flex capacity and retry later; 5xx responses aren't billed

StepFun API

1. Set max_tokens yourself. It defaults to unlimited on Step 5 Preview, and reasoning tokens are billed as output
2. Use response_format with type: json_schema and strict: true when the shape matters. JSON Mode alone isn't schema-checked
3. Back off and retry on 429, 500, 503 and 504. The docs give no Retry-After header or backoff schedule
4. Expect HTTP 451 or finish_reason: content_filter when content fails StepFun's review, and don't retry the same input
5. Use api.stepfun.ai for the international platform. api.stepfun.com is the China platform with yuan pricing