DeepSeek Redesigns Residual Connections Powering AI

Residual connections, introduced in 2015 with ResNets, remain a core routing mechanism in nearly all AI models. DeepSeek-AI researchers published a paper proposing "Manifold-Constrained Hyper-Connections" (mHC) as a complete redesign of this signal propagation system, addressing limitations in current methods.