Agents-A1-4B vs Olmo 3 7B Think

Agents-A1-4B

A small agent cousin for search, research and tool-calling loops, with vision and 262,144 tokens of context. It runs in about 4 GB from InternScience's Q4_K_M GGUF, in vLLM, SGLang, Transformers or llama.cpp. The main risks are an undeclared base, no safety results or agent guidance, and a template that adds its own dated system prompt when you send none.

Olmo 3 7B Think

A fully open 7B reasoning cousin for maths, code and step-by-step answers, with every dataset and checkpoint published and its safety results rerunnable. Ollama's 4-bit build needs about 5.4 GB. It always thinks, wasn't trained for tool calls, has 65K of context, and Ai2 hasn't answered its discussions.

Agents-A1-4B

1. Quickest start is llama-server -hf InternScience/Agents-A1-4B-Q4_K_M-GGUF --jinja, about 3.4 GB with the vision projector
2. With vLLM use --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder, as on the card, and add --language-model-only for text-only work
3. Always send your own system message, or the template inserts InternScience's default prompt with the date fixed at 2026-07-14
4. The card recommends temperature 0.85, top_p 0.95, top_k 20, min_p 0 and presence_penalty 1.1, and there is no generation_config.json to set them
5. Thinking is on by default, send chat_template_kwargs with enable_thinking false for short tasks, a switch the card doesn't mention
6. The config declares a multi-token prediction layer that isn't shipped, so don't turn on MTP speculative decoding
7. Validate JSON output yourself, since structured output isn't documented

Olmo 3 7B Think

1. Quickest start is ollama run olmo-3:7b-think, about 4.5 GB
2. With vLLM, vllm serve allenai/Olmo-3-7B-Think --max-model-len 65536; vLLM runs it through its Transformers backend
3. Sample at temperature 0.6 and top_p 0.95 with up to 32,768 output tokens, as the card recommends, since thinking traces are long
4. Every reply starts with a think block; strip it yourself or use a reasoning parser that reads think tags
5. Pass your own system prompt; the template's default says the cut-off is November 2024 and that no functions are available
6. For tool calls use Olmo 3 7B Instruct instead, which Ai2 trained for function calling
7. A discussion reports endless reasoning loops when served with vLLM, unanswered, so cap max_tokens
8. Check the use against Ai2's Responsible Use Guidelines, which bar automated social-media posting and undisclosed automated content outside research