Preview - rendered architecture diagrams; full validated atlas + dataset coming.
Back to models

gshard_moe

history gshard moe validation pending

Architecture diagram

Rendered with TorchLens / Graphviz

Open SVG
Unrolled - full
gshard_moe architecture diagram