Preview - rendered architecture diagrams; full validated atlas + dataset coming.
Back to models

Jamba (hybrid Transformer-Mamba-MoE language model)

history jamba hybrid validation pending

Architecture diagram

Rendered with TorchLens / Graphviz

Open SVG
Unrolled - full
Jamba (hybrid Transformer-Mamba-MoE language model) architecture diagram