BigBang-v1 vs Gemma 4 31B IT

BigBang-v1

A Qwen3.6-35B-A3B fine-tuned on synthetic research problems, under plain Apache 2.0, for search, science and coding work. The publisher ships BF16 only, about 86 GB to run, and has no report, safety results or replies to questions, so smaller builds and support come from others.

Gemma 4 31B IT

A dense multimodal cousin with documented tool calling, optional thinking and a 256K context, for general agent work and image reading on one 24 GB GPU through Google's 4-bit build. It runs in every major runtime under plain Apache 2.0. The main risk is that Google publishes no safety results and has gone quiet on the repository since July.

BigBang-v1

1. On the reference machine use vllm serve endless-frontier/BigBang-v1 --max-model-len 131072 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder
2. The card says to keep at least 128K of context so its thinking isn't cut short
3. Thinking control isn't documented, try the base template's enable_thinking false in chat_template_kwargs and check the output
4. For a smaller build you'll need someone else's quantisation, the publisher has none
5. Validate JSON output yourself or use the runtime's guided decoding

Gemma 4 31B IT

1. On the reference machine run llama-server -hf google/gemma-4-31B-it-qat-q4_0-gguf --hf-file gemma-4-31B_q4_0-it.gguf --jinja -c 32768, adding gemma-4-31B-it-mmproj.gguf for images
2. Or ollama run gemma4:31b for the 20 GB Q4_K_M build
3. In vLLM serve with --enable-auto-tool-choice --tool-call-parser gemma4 --reasoning-parser gemma4, as vLLM's recipe does
4. Thinking is off by default, so pass enable_thinking: true in chat_template_kwargs to turn it on, and expect the reasoning in the thought channel block
5. Drop earlier thoughts from the history except on tool-call turns, as the card asks
6. Use the card's sampling, temperature 1.0, top_p 0.95, top_k 64
7. Validate function names and arguments before running a call, and check JSON output yourself or use the runtime's guided decoding
8. The w4a16 build relies on Marlin INT4 kernels that vLLM marks unsupported on AMD, so use the GGUF on the reference machine