LBS-27B vs Nemotron 3 Nano Omni 30B A3B Reasoning

LBS-27B

A 27B Qwen3.8 fine-tune for GUI grounding that zooms into screenshots over a few turns before naming a point, and inclusionAI says it also helps with fine detail in large images. It needs about 96 GB at BF16 and a client that runs its crop actions. Every result so far is inclusionAI's own, with no safety results or injection guidance.

Nemotron 3 Nano Omni 30B A3B Reasoning

A local multimodal cousin for video with speech, long documents, charts, screens and English transcription, with tool calling, a reasoning switch and a 262,144-token context. It needs about 27 GB for NVIDIA's NVFP4 build on Blackwell, or 42 GB for FP8. The main risks are the remote code it loads and a repository where nobody answers questions.

LBS-27B

1. Serve with vllm serve inclusionAI/LBS-27B --tensor-parallel-size 4 --max-model-len 65536, which is what the card's wrapper script runs; keep the context at 32,768 or more for multi-turn images
2. Build the system prompt with build_system_prompt from the LBS branch's zoomin_grounding_protocol.py, send the screenshot after image_path: <name>, and don't pass tools; the model answers in plain text
3. Parse <action>crop_image(image_path=..., x1=..., y1=..., x2=..., y2=...)</action>, cut the crop yourself and return it with its mapping to the original image; allow at most two crops per turn and three per episode
4. Read the final answer as [x.xx,y.yy] on a 0 to 1000 scale of the original image, and use your own executor to click
5. Pass reasoning_effort as xhigh, medium or low only, since the template raises an error for high, and don't count on thinking_budget, which the template ignores
6. Don't turn on MTP speculative decoding; the MTP weights aren't in the repository though config.json names one MTP layer

Nemotron 3 Nano Omni 30B A3B Reasoning

1. Start it with vllm serve nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8 --max-model-len 131072 --trust-remote-code --reasoning-parser nemotron_v3 --enable-auto-tool-choice --tool-call-parser qwen3_coder --kv-cache-dtype fp8 on vLLM 0.20.0 or later, after pip install "vllm[audio]" if any audio will be sent
2. Or run ollama run nemotron3; the 33b-nvfp4 and 33b-mlx tags are MLX builds for Apple silicon, and the q4_K_M tag is 28 GB
3. Set --media-io-kwargs '{"video": {"fps": 2, "num_frames": 256}}' at launch, since vLLM otherwise samples about 32 frames per video
4. Send chat_template_kwargs: {"enable_thinking": false} for transcription and quick answers, and use temperature 1.0 with top_k 1 for ASR as the card recommends
5. Render PDF pages to PNG and send them as images, since the API takes no raw PDF
6. Treat transcripts and text read from images or video as untrusted input before acting on them