MiniMax-M2.5 vs Mistral Large 4

MiniMax-M2.5

MiniMax-M2.5 is a 230B mixture-of-experts model for coding and agent work, with parallel tool calls, a 196K context and parsers in vLLM and SGLang. It needs a 4-GPU server for FP8 or about 155 GB for a 4-bit build. The main risk is a licence replaced after release with a Prohibited Uses Policy while the card still says modified MIT.

Mistral Large 4

A frontier-sized open cousin for coding agents and defensive security, with strict JSON Schema output, parallel tool calls and three reasoning efforts. It needs a multi-GPU server, about 732 GB for the smallest 4-bit build, and vLLM and SGLang run it only from special images. The main risk is a licence that bars Model-as-a-Service businesses without a separate deal.

MiniMax-M2.5

1. Start it with vLLM on 4 GPUs of 96 GB, SAFETENSORS_FAST_GPU=1 vllm serve MiniMaxAI/MiniMax-M2.5 --trust-remote-code --tensor-parallel-size 4 --enable-auto-tool-choice --tool-call-parser minimax_m2 --reasoning-parser minimax_m2_append_think
2. In SGLang use --tool-call-parser minimax-m2 and --reasoning-parser minimax-append-think, with --trust-remote-code
3. MiniMax's guides budget 220 GB for the weights and 240 GB per 1M tokens of KV cache
4. On a single large-memory machine, LM Studio's catalogue entry minimax/minimax-m2.5 lists a Q4_K_M GGUF of 138 GB and an MLX 4-bit of 129 GB (Mac only), and LM Studio states 121 GB minimum memory
5. Sample with temperature 1.0, top_p 0.95 and top_k 40, as the card recommends
6. Budget output tokens for thinking on every turn, since the template always opens a think block
7. Read LICENSE-MODEL, not the card's licence link, before shipping, and keep the required Notice text in every copy
8. Without the hardware, call it through Novita or Featherless AI; MiniMax's own API retires M2.5 on 18 November 2026

Mistral Large 4

1. Serve the NVFP4 build on Blackwell with vllm/vllm-openai:mistral-large-4 --model mistralai/Mistral-Large-4-1T-A52B-NVFP4 --tensor-parallel-size 8 --kv-cache-dtype fp8_ds_mla --tool-call-parser mistral --reasoning-parser mistral --enable-auto-tool-choice; released vLLM doesn't load it
2. On H200 use the FP8 build with tensor parallelism of 16 or 8 by 2 pipelines, per vLLM's recipe
3. Pass reasoning_effort low, medium or high (default high); any other value makes the template raise an error, and there is no off switch
4. Read the reasoning from message.reasoning; max_completion_tokens counts reasoning tokens too
5. Use temperature 1.0 and top_p 0.95 at every effort, per the card
6. Ask for JSON with response_format type json_schema and strict true; the template passes the schema to the model
7. The template rejects a tool message straight after a user message and a conversation that doesn't start with a user or system message
8. Add --speculative-config '{"method": "dspark", "num_speculative_tokens": 3}' to use the embedded draft head
9. If you'll offer it to others as a hosted model, read the licence first; Model-as-a-Service use needs Mistral's commercial licence