Muse Glimmer 30B vs Nanbeige4.3-33B

Muse Glimmer 30B

A dense 30B multimodal cousin for local agent and coding work with images, documented tool calls and adjustable reasoning. Meta's 17 GB GGUF fits a 24 GB card and runs in llama.cpp, Ollama, vLLM, SGLang and Transformers. The main risks are one tool call per turn, no documented JSON output and a usage policy that adds limits to Apache 2.0.

Nanbeige4.3-33B

A dense 33B Llama-architecture cousin for long agentic coding and office tasks, with per-request thinking, XML tool calls that stock vLLM and SGLang parse, and 512K of context. It needs about 96 GB at BF16, as Nanbeige ships no quantised build. Its agentic results so far are Nanbeige's own, with no safety results, training data notes or licence file.

Muse Glimmer 30B

1. Start it with llama serve -hf meta-models/Muse-Glimmer-30B-GGUF --hf-file Muse-Glimmer-30B-KQuant-17GB-Q4_K_M.gguf -ngl 99 -c 131072 --host 127.0.0.1 --port 8080 --chat-template-kwargs '{"reasoning_strength":"high"}' on llama.cpp b10353 or later, or ollama run muse-glimmer on Ollama 0.32.7 or later
2. In vLLM pass --tool-call-parser muse_glimmer --reasoning-parser muse_glimmer, in SGLang muse for both, in ExecuTorch --tool-parser atem. Without them tool calls come back as plain text
3. Set reasoning per request with chat_template_kwargs.reasoning_strength (low, medium, high or xhigh). llama.cpp and ExecuTorch don't read reasoning_effort, and ExecuTorch rejects it with a 400
4. Expect one tool call per turn and return each result before the next. ExecuTorch's server rejects tool_choice="required"
5. Keep temperature 1.0, top_p 0.95 and top_k 64, don't run greedy, and never stop on <|eom|>
6. Leave max_tokens room for reasoning, since in llama.cpp a request cut off mid-thought returns empty content with finish_reason length
7. For images add Meta's 1.4 GB mmproj GGUF, which takes the build to about 22 GB with the runtime's fifth

Nanbeige4.3-33B

1. Serve with vllm serve Nanbeige/Nanbeige4.3-33B --enable-auto-tool-choice --reasoning-parser qwen3 --tool-call-parser qwen3_coder, as the card says, or SGLang with the same two parsers
2. Keep tool_call_format at its default xml, since qwen3_coder parses that format; the json option writes Hermes-style JSON calls, which need a different parser such as vLLM's hermes
3. Pass chat_template_kwargs {"preserve_thinking": true} for multi-turn tool use and coding, and {"enable_thinking": false} to skip reasoning, as the card recommends
4. Use temperature 1.0, top_p 0.95 and up to 65,536 new tokens for agent work, and temperature 0.6 for reasoning and chat, per the card
5. Send your own system prompt, since without one the template injects a Chinese identity line, or a Chinese tool-expert prompt when tools are passed
6. Send one system message at the start only, as the template raises an error for a later one
7. In plain Transformers pass use_cache=True to generate, since config.json and generation_config.json set it false; trust_remote_code isn't needed