Baidu Releases Unlimited OCR with Flat KV Cache

Baidu released Unlimited OCR, a 3B-parameter Mixture-of-Experts model with 500M active parameters. It uses Reference Sliding Window Attention to keep the KV cache constant, enabling parsing of dozens of pages in one forward pass under a 32K maximum length. The model scores 93.