Jais 3 vs StepFun API

Jais 3

Jais 3 runs on the owner's hardware through OpenAI-compatible servers in vLLM and SGLang, with tool calls, three reasoning levels and a 512K context, from a 2.2 GB 0.9B model to a 758 GB 375B one. The weights download without sign-up under Apache-2.0, but every launch command trusts remote code, and no technical report or security contact is published.

StepFun API

StepFun's API serves Step 5 Preview with a 1M-token context, video input, strict JSON Schema output and published per-token prices, documented in Markdown with an llms.txt. The model is a preview with no release date found, there's no free allowance or SLA, and the terms and privacy policy leave room to train on customer data.

Jais 3

1. Start vLLM or SGLang with --reasoning-parser k2_horizon, and add --tool-call-parser k2_horizon (vLLM also --enable-auto-tool-choice) for tools, or tool calls come back as raw text
2. Pass reasoning_effort (high, medium or low) and tool_call_format inside chat_template_kwargs. Other values return a template error
3. Send each earlier assistant turn back with reasoning_content as a string, even an empty one. A missing or null thinking field makes the template raise an error
4. Send your own system message, or set default_system_prompt to an empty string. Without one the template inserts an identity prompt naming IFM, Inception42 and Cerebras
5. Budget at least 32,768 output tokens at high effort, which the cards recommend for every request

StepFun API

1. Set max_tokens yourself. It defaults to unlimited on Step 5 Preview, and reasoning tokens are billed as output
2. Use response_format with type: json_schema and strict: true when the shape matters. JSON Mode alone isn't schema-checked
3. Back off and retry on 429, 500, 503 and 504. The docs give no Retry-After header or backoff schedule
4. Expect HTTP 451 or finish_reason: content_filter when content fails StepFun's review, and don't retry the same input
5. Use api.stepfun.ai for the international platform. api.stepfun.com is the China platform with yuan pricing