ByteDance Identifies DeepSeek Retrieval Flaw

ByteDance researchers identify that chunked KV-cache compression causes retrieval accuracy differences of up to 40 percentage points in DeepSeek models. This phase sensitivity occurs because attention components specialize in retrieving information from different positions within the compression window.