Google Releases Open llm-d 1.0 Stack

Google Cloud released llm-d 1.0 at the PyTorch Conference, an open-source stack for distributed LLM inference co-founded with Red Hat and IBM. The system handles multi-step agents and RL rollouts using cache-aware routing on Google Cloud TPUs and GPUs.