Google Launches TPU Sync for AI

Google Cloud introduces TPU Sync, an open-source C++ library that unifies memory hierarchies for AI inference and reinforcement learning. The tool slashes KV transfer latency by over 90% and reduces Time to First Token by an average of 90% for heavyweight models. It integrates with PyTorch and JAX frameworks to optimize data movement across TPU clusters.