Accelerating Gemini Nano models on Pixel with frozen Multi-Token Prediction

Google retrofitted Multi-Token Prediction onto frozen Gemini Nano v3 models, accelerating on-device inference on Pixel 9 and 10 series. The approach overcomes the autoregressive bottleneck, making features like AI Notification Summaries and Proofread generate text significantly faster without sending private data off device.