Carbon-X vs MiniCPM-V 4.7 35B-A3B

Carbon-X

• no change on 3 November 2026: new evidence

MiniCPM-V 4.7 35B-A3B

No score change since it was listed.

Carbon-X

A DNA specialist cousin that another agent calls for variant-effect and sequence questions, with DNA kept on the machine. Hugging Face's Q4_K_M GGUF needs about 12 GB and Q8_0 about 19 GB, on llama.cpp b11742 or later. It isn't clinically validated, isn't trained for tool calls or reasoning, and its Python tokenizer runs repository code.

MiniCPM-V 4.7 35B-A3B

A vision-language cousin for images and video that fits a 24 to 32 GB machine from OpenBMB's own GGUF, under plain Apache 2.0, with a publisher that answers. The card says little about limits, training data or how tool calls come back, so test the tool format in your runtime before relying on it.

Carbon-X

1. Quickest start is llama-server -hf HuggingFaceBio/Carbon-X-GGUF:Q8_0 -ngl 99 -c 40960 --jinja --chat-template-kwargs '{"enable_thinking": false}' --temp 0.6 --top-p 0.95 --top-k 20 --min-p 0, on llama.cpp b11742 or later
2. With vLLM or Transformers pass trust_remote_code, and expect the tokenizer to fetch Qwen/Qwen3-4B-Base at a pinned revision on first load
3. Keep enable_thinking false and the card's sampling (temperature 0.6, top_p 0.95, top_k 20), the settings every reported result used
4. Keep DNA in files and pass sequences by name, compute positions and base changes in code and send them as context, the card says the model miscounts long sequences
5. Only A, C, G and T form 6-mers, so filter N and other IUPAC codes first or they become a single oov token
6. Strip the dna tags from answers if you need bare sequence, llama.cpp keeps them in the text
7. Cap max_tokens for next-base questions, long DNA generation is slow and degrades

MiniCPM-V 4.7 35B-A3B

1. Start it with llama-server -hf openbmb/MiniCPM-V-4.7-35B-A3B-gguf:Q4_K_M --jinja, or ollama run openbmb/minicpm-v4.7:35b-a3b
2. For image input in llama.cpp add mmproj-model-f16.gguf, or the 4x projector for more visual detail at a higher cost
3. The GGUF files at the repository root have thinking off. Use the files in thinking/ when you want the trace
4. With Transformers pass enable_thinking to apply_chat_template, and pass downsample_mode to both apply_chat_template and generate
5. Use temperature 0.7, top_p 0.95 and top_k 100 in instruct mode, as the card recommends
6. Check tool calls in your runtime first, since the card names no parser. The template uses the Qwen3.5 function-block format
7. Validate JSON output yourself, since structured output isn't documented