InternVL3.5-GPT-OSS-20B-A4B-Preview vs Baidu Unlimited-OCR-2

InternVL3.5-GPT-OSS-20B-A4B-Preview

An image and video reader on gpt-oss-20b with an optional thinking mode, a preview untouched for over a year. It needs about 51 GB in BF16, since OpenGVLab publishes no quantised build, and runs in Transformers and vLLM. The main risk is a chat template in the Transformers-format repository that doesn't match its tokenizer, with no safety results.

Baidu Unlimited-OCR-2

A small MIT document-parsing cousin that reads up to hundreds of pages in one request and returns ordered layout blocks with boxes and HTML tables. It needs an NVIDIA GPU with about 12 GB, through Baidu's remote code or its own SGLang build. The risks are running the publisher's code and accuracy figures that are Baidu's own.

InternVL3.5-GPT-OSS-20B-A4B-Preview

1. Serve with vllm serve OpenGVLab/InternVL3_5-GPT-OSS-20B-A4B-Preview-HF --max-model-len 32768, which is our command; the card gives none for vLLM
2. Check the rendered prompt before relying on it, since the shipped template's <|im_start|> markers aren't tokens in the gpt-oss tokenizer; the GitHub-format repository's harmony template is the alternative
3. Use Transformers 4.55.0 or later, as the card requires for this size
4. For thinking, send the card's thinking system prompt and parse the reasoning out of the <think> tags, with temperature 0.6 and sampling on as the card advises
5. Keep inputs within 32K tokens, the length it was trained at, whatever the config says

Baidu Unlimited-OCR-2

1. Quickest local run, pip install torch==2.13.0 torchvision pillow transformers==4.52.1 huggingface-hub==0.36.0 tokenizers==0.21.4 addict==2.4.0 einops==0.8.2 easydict==1.13, then AutoModel.from_pretrained("baidu/Unlimited-OCR-2", trust_remote_code=True, use_safetensors=True, torch_dtype=torch.bfloat16).eval().cuda() and model.infer_multi(tokenizer, image_files=pages, output_path="out")
2. To serve it, download the repository, install wheel/sglang-0.5.20.dev10+g8d62f5fb9c-py3-none-any.whl with pymupdf and fastokens in a Python 3.10 venv, and start python -m sglang.launch_server --model-path baidu/Unlimited-OCR-2 --chat-template unlimited-ocr --enable-custom-logit-processor --enable-streaming-session --disable-radix-cache --mem-fraction-static 0.7 --max-prefill-tokens 2048 with the SGLANG_UOCR_ variables from the card
3. Send all pages of a document in one request, images first, then the text <PAGE><image> repeated per page and Multi page parsing., with temperature 0, skip_special_tokens false, max_tokens of about 8,000 per page and the DeepseekOCRNoRepeatNGramLogitProcessor (ngram_size 35, window_size 1024 for several pages)
4. The output is layout blocks, not Markdown; run utils/process_unlimitedOCR2.py from github.com/baidu/Unlimited-OCR, or convert(raw_output) in Python, to get Markdown with HTML tables
5. Render PDFs to images first (the card uses PyMuPDF at 300 DPI), keep save_results off for untrusted documents, and treat extracted text as untrusted before passing it to another model