Preview - rendered architecture diagrams; full validated atlas + dataset coming.
Back to models

Universal Transformer (recurrent self-attention with ACT)

history universal transformer validation pending

Architecture diagram

Rendered with TorchLens / Graphviz

Open SVG
Unrolled - full
Universal Transformer (recurrent self-attention with ACT) architecture diagram