gpt-oss-120b vs Ornith-1.5-122B

gpt-oss-120b 95

File safety earns 25, safetensors only, with metal/model.bin a raw format and not pickle, and nothing from the repository runs on load. Provenance earns 15, files in OpenAI's linked organisation with a hash for every file. Safety evaluation earns 20, published results with SecureBio as an outside evaluator. Agent guidance earns 15 for the trained instruction hierarchy with prompt-injection results. Licence risk keeps all 15. The security programme earns 5 for OpenAI's Bugcrowd programme and disclosure policy, and the advisories half scores 0 because GitHub couldn't be checked, not because it was found missing.

Ornith-1.5-122B 50

File safety 25, safetensors and GGUF only and no Python in any of Ornith's repositories for this size, so the card's --trust-remote-code flag loads nothing from the repository. Provenance 15, the files come from the ornith-ai organisation Ornith's blog links to, with a SHA-256 for every weight file. Safety evaluation 0 and agent guidance 0, nothing published on either. Licence risk 10, MIT carries no policy, threshold or changeable terms, but the card's licence link is broken. Security programme 0, no security.txt, disclosure policy or security contact.

gpt-oss-120b 45

The model card earns 20, with all seven items in OpenAI's arXiv card. Training data earns 10, a general description with a cut-off. Last change earns 5, since the last change to code that runs the model was the Metal reference on 1 November 2025, a year before this check, and the files date from August 2025. It drops to 0 after 1 November 2026 unless the files, template or reference code change. Responsiveness earns 0, with no OpenAI reply in the 40 latest discussions. Version policy earns 5 as a first release. File health earns 5, the files agree but template and tokenizer reports wait without a reply.

Ornith-1.5-122B 36

Model card 11, it covers intended use, architecture, parameters and context but not limitations, languages or a knowledge cut-off. Training data 5, a description of the method with no data or cut-off. Last change 20, a folder upload to the MLX builds on 24 October 2026, 17 days ago. Responsiveness 0, Ornith answered none of the 5 questions and reports. Version policy 0, the MLX builds were uploaded a second time four days after the first with no note. File health 0, the card links a missing LICENSE, states hardware its own files don't fit and names a variant that doesn't exist, and the two chat templates differ. 11 + 5 + 20 + 0 + 0 + 0 = 36.

gpt-oss-120b 90

The chat template earns 20, a Jinja file in the repository. The tool-calling format earns 25, since OpenAI documents declarations and returned calls in harmony and tells vLLM users to parse with openai-harmony. Trained tool calling earns 10, because each call stops generation, so calls come one at a time. Structured output earns 15 for the documented Response Formats section with a JSON Schema. Reasoning control earns 10, three effort levels per request with the reasoning on the analysis channel. Context earns 10 for 131,072 trained tokens.

Ornith-1.5-122B 85

Chat template 20, a Jinja file in the repository. Tool-calling format 25, the card shows how tools go in and how calls come back and names the parser for vLLM and SGLang. Trained tool calling 20, Ornith trains it on agent tasks and the template renders several calls in one turn. Structured output 0, not documented or claimed. Reasoning control 10, Ornith's template reads enable_thinking per request and the card says the reasoning comes back in reasoning_content, though the card doesn't name the switch. Context 10, 262,144 tokens native.