Skip to main content
Back to leaderboard

llm

xHC: Expanded Hyper-Connections

📄 Trending Paper (48⬆️): Hyper-Connections (HC) expand the residual stream of Transformers into N parallel streams, providing a form of memory scaling beyond model width and depth. Manifold-Constrained HC (mHC) stabilizes this formulation at scale. The large gains from N{=}1 to N{=}4 suggest residual-stream expansion as a p...

Source: HuggingFace_Papers

What it does

📄 Trending Paper (48⬆️): Hyper-Connections (HC) expand the residual stream of Transformers into N parallel streams, providing a form of memory scaling beyond model width and depth. Manifold-Constrained HC (mHC) stabilizes this formulation at scale. The large gains from N{=}1 to N{=}4 suggest residual-stream expansion as a p...

Who is it for

Not available

Pricing

Not available

Strengths

  • Not available

Limits

  • Not available

Want to integrate it in your business? Book a free call

Book now
xHC: Expanded Hyper-Connections | ToolAI - StudioCentOS