Preview - rendered architecture diagrams; full validated atlas + dataset coming.
Back to models

GLA (Gated Linear Attention, per-key-dim decay)

history gla gated validation pending

Architecture diagram

Rendered with TorchLens / Graphviz

Open SVG
Unrolled - full
GLA (Gated Linear Attention, per-key-dim decay) architecture diagram