Cola2 vs Nemotron 3 Ultra 550B A55B

Cola2 20

Chat template 20, A chat template in tokenizer_config.json (4,116 characters), which came with the Qwen3 tokenizer. Tool-calling format 0, none. Trained tool calling 0, not trained for tool calling. Structured output 0, Nothing about JSON or schema-constrained output. Reasoning control 0, no reasoning mode. Context 0, no context length is stated. 20 + 0 + 0 + 0 + 0 + 0 = 20.

Nemotron 3 Ultra 550B A55B 90

The chat template earns 20, a Jinja file in the repository. The tool-calling format earns 25, since the card names the qwen3_coder parser and shows a tool call declared and read back. Trained tool calling earns 20, with tool-use training and several calls per turn in the template. Structured output earns 5, claimed from training with no instructions. Reasoning control earns 10, thinking off or medium effort per request with a runtime parser that returns the reasoning apart. Context earns 10 for up to 1M tokens.

Cola2 25

Memory 15, the only build is the F32 safetensors set, 35.07 GB, and 35.07 GB × 1.2 = 42.1 GB, within 64 GB. Loaded as BF16, as the card's example does, it needs about half, but the line reads the file size. Runtimes 0, none of the six runs it in a released version. Builds 0, one set of weights and no quantised build. Terms 0, no licence for the weights. Download 10, the Hub API reports gated false on 10 November 2026, so the files download with no account and nothing to accept. Hosted 0, Hugging Face maps no inference provider to it, and nothing names an API that serves it. 15 + 0 + 0 + 0 + 10 + 0 = 25.

Nemotron 3 Ultra 550B A55B 55

Memory earns 0, because the smallest 4-bit build, NVIDIA's 352 GB NVFP4, needs about 423 GB with the fifth added, above the 256 GB band, and no runtime library has a local build. Runtimes earn 20 from released vLLM, SGLang, llama.cpp and Transformers, with Ollama's cloud-only entry not counted. Builds earn 10 for the single NVFP4 build. Terms earn 10, because OpenMDW-1.1 is permissive with no threshold or use policy but isn't an OSI licence. Download earns 10, with no gate or account. Hosted earns 5, since NVIDIA's own API serves it and two providers host it.

Cola2 40

File safety 15, safetensors only, no .bin, .pt or .pth files (25). Provenance 15, the files sit in the ByteDance-Seed organisation, which the ByteDance-Seed GitHub repository for the model links to (10). Safety evaluation 0, no safety results. Agent guidance 5, General cautions in the GitHub model card: not instruction-tuned or safety-aligned, not for use as an assistant, for facts or advice, or for high-impact decisions about people. Licence risk 0, With no licence for the weights there is nothing to hold ByteDance to. Security programme 5, the GitHub repository's SECURITY.md sends reports to ByteDance's security centre and says how they're assessed (5). 15 + 15 + 0 + 5 + 0 + 5 = 40.

Nemotron 3 Ultra 550B A55B 70

File safety earns 15, safetensors only but with 10 off because the documented commands pass trust-remote-code and the repository ships Python files. Provenance earns 15, files in NVIDIA's linked organisation with a hash for every file. Safety evaluation earns 0, since NVIDIA describes safety training but publishes no results. Agent guidance earns 15, as the technical report documents training the model to ignore instructions injected through tool output, beside the subcard's warnings and safeguards. Licence risk keeps all 15 under OpenMDW-1.1. The security programme earns 10 for the reporting route on the card and NVIDIA's public bulletins.

Cola2 58

Model card 8, Intended use and limitations (the out-of-scope list, and the unconverged latent model) and the architecture are on the card and the GitHub model card it links. Training data 15, the GitHub model card names the source (OLMo 2 pretraining text, retokenised) and the mix by stage with token counts, 346.03B in all. Last change 20, All six commits are from 6 November 2026, four days before this check, the last one updating a checksum in the README. Responsiveness 0, no discussions on the repository, so nobody has asked anything yet and the line reads as none answered, as settled in calibration. Version policy 5, A first release. File health 10, Config, files and card agree: F32 weights, a float32 config and a card that says to load them as bfloat16, with SHA256SUMS to check the download. 8 + 15 + 20 + 0 + 5 + 10 = 58.

Nemotron 3 Ultra 550B A55B 70

The model card earns 20, all seven items with limitations in the linked subcard. Training data earns 20, datasets listed with sources and token counts, cut-offs and filtering, and the corpora published. Last change earns 20, counting NVIDIA's own inference code for the model. The repositories last changed on 24 August, but NVIDIA's TensorRT-LLM, the runtime the card's own serving commands use, changed its Nemotron-H model code on 14 October, 18 days ago. Responsiveness earns 0, with no NVIDIA reply to any of nine questions. Version policy earns 5 as a first release. File health earns 5, since there is no LICENSE file, the BF16 card's SGLang command names a parser SGLang doesn't have, and tool-call reports wait without a reply.