Agents-A1-4B vs MiniCPM-V 4.7 35B-A3B

Agents-A1-4B

A small agent cousin for search, research and tool-calling loops, with vision and 262,144 tokens of context. It runs in about 4 GB from InternScience's Q4_K_M GGUF, in vLLM, SGLang, Transformers or llama.cpp. The main risks are an undeclared base, no safety results or agent guidance, and a template that adds its own dated system prompt when you send none.

MiniCPM-V 4.7 35B-A3B

A vision-language cousin for images and video that fits a 24 to 32 GB machine from OpenBMB's own GGUF, under plain Apache 2.0, with a publisher that answers. The card says little about limits, training data or how tool calls come back, so test the tool format in your runtime before relying on it.

Agents-A1-4B

1. Quickest start is llama-server -hf InternScience/Agents-A1-4B-Q4_K_M-GGUF --jinja, about 3.4 GB with the vision projector
2. With vLLM use --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, as on the card, and add --language-model-only for text-only work
3. Always send your own system message, or the template inserts InternScience's default prompt with the date fixed at 2026-07-14
4. The card recommends temperature 0.85, top_p 0.95, top_k 20, min_p 0 and presence_penalty 1.1, and there is no generation_config.json to set them
5. Thinking is on by default, send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
6. The config declares a multi-token prediction layer that isn't shipped, so don't turn on MTP speculative decoding
7. Validate JSON output yourself, since structured output isn't documented

MiniCPM-V 4.7 35B-A3B

1. Start it with llama-server -hf openbmb/MiniCPM-V-4.7-35B-A3B-gguf:Q4_K_M --jinja, or ollama run openbmb/minicpm-v4.7:35b-a3b
2. For image input in llama.cpp add mmproj-model-f16.gguf, or the 4x projector for more visual detail at a higher cost
3. The GGUF files at the repository root have thinking off. Use the files in thinking/ when you want the trace
4. With Transformers pass enable_thinking to apply_chat_template, and pass downsample_mode to both apply_chat_template and generate
5. Use temperature 0.7, top_p 0.95 and top_k 100 in instruct mode, as the card recommends
6. Check tool calls in your runtime first, since the card names no parser. The template uses the Qwen3.5 function-block format
7. Validate JSON output yourself, since structured output isn't documented