Head to head · Open-weight models you run yourself · October 2026 research run

Mistral Large 4 vs Ornith-1.5-397B

Ornith-1.5-397B scores 59 (C) on agent readiness against Mistral Large 4's 54.6 (C), and leads in 1 of 4 scored categories. Mistral Large 4 leads on risk, agent interface and documentation and upkeep. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 3588 open weights comparisons

Which one, for what

Mistral Large 4 C

Best for Operators with an 8-GPU Blackwell or H200 node who want a frontier-sized open model for coding agents and defensive security, with a hosted twin on Mistral's API.

Ahead on

  • Risk, 75 against 50
  • Agent interface, 95 against 85
  • Documentation and upkeep, 64 against 36

Watch for

The smallest 4-bit build needs about 732 GB, so nothing fits a single workstation or a 128 GB machine

Ornith-1.5-397B C

Best for A self-hosted frontier-scale coding agent on an 8-GPU server, where a clear licence file and an answering publisher aren't required

Ahead on

  • Reach, 65 against 50

Watch for

Needs about 290 GB of memory at 4 bits and about 970 GB in BF16, so it doesn't fit the reference machine

Score by category

CategoryWeight this runMistral Large 4Ornith-1.5-397BEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%255065Ornith-1.5-397B +15
Risk20%207550Mistral Large 4 +25
Agent interface10%109585Mistral Large 4 +10
Documentation and upkeep10%106436Mistral Large 4 +28
Negative events≤1500
TotalC 54.6/100C 59/100

Facts side by side

FactMistral Large 4Ornith-1.5-397B
KindOpen-weight modelOpen-weight model
VendorMistral AIOrnith
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceMistral Ecosystem Open-Weight License (modified MIT)MIT
Read-only variant documentednono
llms.txtnono
Last release2026-10-292026-08-23
Terms last updatedno document linkedno document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviewsnone2/5 (4)

Verdicts

Mistral Large 4

A frontier-sized open cousin for coding agents and defensive security, with strict JSON Schema output, parallel tool calls and three reasoning efforts. It needs a multi-GPU server, about 732 GB for the smallest 4-bit build, and vLLM and SGLang run it only from special images. The main risk is a licence that bars Model-as-a-Service businesses without a separate deal.

Ornith-1.5-397B

Ornith's flagship coding and terminal-agent cousin, with XML tool calls that vLLM and SGLang parse and 262,144 tokens of context. It needs about 290 GB even at 4 bits, so a multi-GPU server, not the 128 GB reference machine. The main risk is an absent publisher, with no licence file, no safety results and files replaced without a note.

Before you call either

Mistral Large 4

  1. Serve the NVFP4 build on Blackwell with vllm/vllm-openai:mistral-large-4 --model mistralai/Mistral-Large-4-1T-A52B-NVFP4 --tensor-parallel-size 8 --kv-cache-dtype fp8_ds_mla --tool-call-parser mistral --reasoning-parser mistral --enable-auto-tool-choice; released vLLM doesn't load it
  2. On H200 use the FP8 build with tensor parallelism of 16 or 8 by 2 pipelines, per vLLM's recipe
  3. Pass reasoning_effort low, medium or high (default high); any other value makes the template raise an error, and there is no off switch
  4. Read the reasoning from message.reasoning; max_completion_tokens counts reasoning tokens too
  5. Use temperature 1.0 and top_p 0.95 at every effort, per the card
  6. Ask for JSON with response_format type json_schema and strict true; the template passes the schema to the model
  7. The template rejects a tool message straight after a user message and a conversation that doesn't start with a user or system message
  8. Add --speculative-config '{"method": "dspark", "num_speculative_tokens": 3}' to use the embedded draft head
  9. If you'll offer it to others as a hosted model, read the licence first; Model-as-a-Service use needs Mistral's commercial licence

Ornith-1.5-397B

  1. Start it with the card's vLLM command at --tensor-parallel-size 8, or ollama run ornith-1.5:397b on a machine with about 300 GB of memory
  2. In vLLM pass --enable-auto-tool-choice --tool-call-parser qwen3_xml --reasoning-parser qwen3, and in SGLang --tool-call-parser qwen3_coder --reasoning-parser qwen3, so tool calls and reasoning come back parsed
  3. Thinking is on by default. Send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
  4. Pin which template your runtime loads, since chat_template.jinja keeps earlier reasoning and the tokenizer_config.json template drops it
  5. When downloading the NVFP4 build, fetch only the files its model.safetensors.index.json names (the 25-shard set, 241.7 GB), not the eight extra shards
  6. Pin a revision when you download, since Ornith has replaced files in place
  7. Validate JSON output yourself, since structured output isn't documented

Questions

Which is better for AI agents, Mistral Large 4 or Ornith-1.5-397B?

Ornith-1.5-397B scores 59 (C) on agent readiness against Mistral Large 4's 54.6 (C), and leads in 1 of 4 scored categories. Mistral Large 4 leads on risk, agent interface and documentation and upkeep.

Other comparisons with Mistral Large 4 or Ornith-1.5-397B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.