mHC: Manifold-Constrained Hyper-Connections
paperProposes Manifold-Constrained Hyper-Connections, projecting residual connection space onto a specific manifold to restore identity mapping while maintaining diverse connectivity patterns. Shows improvements on reasoning tasks with only 6.7% additional training overhead. Co-authored by founder Liang Wenfeng.
Paper
arXiv: 2512.24880