Proposes Manifold-Constrained Hyper-Connections, projecting residual connection space onto a specific manifold to restore identity mapping while maintaining diverse connectivity patterns. Shows improvements on reasoning tasks with only 6.7% additional training overhead. Co-authored by founder Liang Wenfeng.

Paper

arXiv: 2512.24880

architectureresearchefficiency