Nvidia maps KV caches to cut model handoff costs

Nvidia researchers introduced a cross-model KV cache transfer technique that maps a source model's prefilled cache into a target model, avoiding full recomputation. The method cuts compute costs and latency for agentic AI systems that hand tasks between small and large models.