Arete-27B vs gpt-oss-20b

Arete-27B 50

Memory 10, the only build from Nous Research is the 54.7 GB BF16 release, which needs about 66 GB and fits the reference machine. Runtimes 15, vLLM, SGLang and Transformers run the base's architecture from those files, and llama.cpp isn't credited because Nous Research publishes no GGUF. Builds 0, no quantised build of its own. Terms 15, Apache 2.0. Download 10, not gated. Hosted 0, no provider. 10 + 15 + 0 + 15 + 10 + 0 = 50.

gpt-oss-20b 90

Memory earns 25, since OpenAI's own MXFP4 build is 13.76 GB and a fifth on top is 16.5 GB, just past the 16 GB band, and Ollama's 14 GB build lands in the same 24 GB band. Runtimes earn the full 25 from model code in released Transformers, vLLM and SGLang, the architecture in llama.cpp and the model in Ollama's library. Builds earn 10, because OpenAI ships one quantised precision, MXFP4, and the original and metal folders are the same weights for its reference code. Terms earn 15 for Apache 2.0, whose usage policy only asks users to follow the law. Download earns 10, since the repository isn't gated. Hosted earns 5, with five inference providers live for it on its Hugging Face page on 1 November 2026, while OpenAI's own API lists it with no usable rate limit and isn't counted.

Arete-27B 55

File safety 25, safetensors only and no remote code. Provenance 15, Nous Research's own organisation, linked from its blog, with a hash on every file. Safety evaluation 0 and agent guidance 0, nothing published on either. Licence risk 15, plain Apache 2.0. Security programme 0, no way to report a flaw found. 25 + 15 + 0 + 0 + 15 + 0 = 55.

gpt-oss-20b 85

File safety earns 25, since the weights are safetensors and metal/model.bin is OpenAI's own raw Metal format rather than pickle, and nothing in the repository runs as code (a judgement call on the .bin name). Provenance earns 15, files in OpenAI's own organisation and a checksum on every file. Safety evaluation earns 10, because the published safety results for this size are OpenAI's own, and the outside review covered gpt-oss-120b. Agent guidance earns 15 for an instruction hierarchy the model was trained to follow, with prompt-injection results, though OpenAI reports it trails o4-mini there. Licence risk keeps 15, with nothing to deduct under Apache 2.0. The security programme earns 5 for OpenAI's security.txt with a Bugcrowd contact. Public advisories for the gpt-oss code couldn't be checked, so that half scores as absent.

Arete-27B 60

Chat template 20, a Jinja file in the repository. Tool-calling format 10, only the template says it. Trained tool calling 20, several calls a turn and agentic work as an intended use. Structured output 0 and reasoning control 0, neither is documented on the card. Context 10, 262,144 tokens native. 20 + 10 + 20 + 0 + 0 + 10 = 60.

gpt-oss-20b 90

The chat template earns 20, a Jinja file in the repository. The tool-calling format earns 25, since OpenAI's harmony guide says how functions are declared and how calls come back, and OpenAI ships the openai-harmony parser. Trained tool calling earns 10, because each call ends the message and waits for its result, so it makes one call at a time. Structured output earns 15 for a JSON Schema given in the developer message, documented in the harmony guide. Reasoning control earns 10, with low, medium or high effort per request and the reasoning on its own channel, though it can't be switched off. Context earns 10 for 131,072 tokens, which OpenAI describes as trained in even though the config reaches it with YaRN.

Arete-27B 63

Model card 8, no limitations, context length, languages or cut-off. Training data 20, the training pairs and the evaluation set are published with their counts. Last change 20, a commit on 6 November 2026. Responsiveness 0, none of 13 discussions has a reply from Nous Research. Version policy 5, a first release. File health 10, the files agree. 8 + 20 + 20 + 0 + 5 + 10 = 63.

gpt-oss-20b 42

The model card earns 17, covering six of the seven points and missing a statement of supported languages. Training data earns 10, a general description with a June 2024 cut-off and no sources or mix. Last change earns 5, because the files haven't changed since August 2025 and the reference code and harmony parser last changed on 1 and 5 November 2025, still within a year on 1 November 2026, while this year's commits only touch the browser tool, CI and a version number. Responsiveness earns 0, with no OpenAI reply to any of the 40 most recent discussions and none at all since August 2025. Version policy earns 5 for a first release kept in its own repository. File health earns 5, since template reports and an install report wait without a reply.