Development

DeepSeek widens the residual stream for free

development2026-01-02

Claim

DeepSeek introduced Manifold-Constrained Hyper-Connections, expanding the residual stream into parallel projections for better performance at no extra compute.

Reporting date: 2026-01-02 (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Welcome to January 2, 2026 (theinnermostloop.substack.com)

Knowledge graphopen in browser →

Reported in

Welcome to January 2, 2026

Actor

DeepSeek

Evidence for

Referenced by

Cite or correct this record

Citation formatCitation text

DeepSeek widens the residual stream for free
Innermost Loop KB — secondary record
Reporting date: 2026-01-02
KB permalink: https://nicholsn.github.io/innermost-loop-kb/developments/2026-01-02-deepseek-hyper-connections
Claim: DeepSeek introduced Manifold-Constrained Hyper-Connections, expanding the residual stream into parallel projections for better performance at no extra compute.
Attributed sources:
- Welcome to January 2, 2026 — https://theinnermostloop.substack.com/p/welcome-to-january-2-2026
This citation does not imply independent verification of linked-source claims.

Suggest a correction — opens a GitHub draft for you to review and submit.