Google Releases Open-Source TPU Sync Library

Google Cloud releases TPU Sync, an open-source C++ library for moving KV caches on Cloud TPUs. It targets a growing bottleneck by treating TPU HBM and host DRAM as one memory hierarchy. Google reports over 90% lower KV transfer latency on 235B to 480B parameter MoE models.