Mila::Dnn::GemmaBlockWorkspaceWidths Struct Reference

Max-geometry slot widths, shared by the allocation and the transformer's footprint. More...

Public Member Functions
std::vector< dim_t >	slotWidths () const

Public Attributes
dim_t	hidden_dim { 0 }
dim_t	kv_width { 0 }
dim_t	model_dim { 0 }
dim_t	q_width { 0 }
dim_t	qkv_width { 0 }
dim_t	routed_stream_slots { 0 }

Detailed Description

Max-geometry slot widths, shared by the allocation and the transformer's footprint.

---

The documentation for this struct was generated from the following file:

• Mila/Src/Dnn/Components/Transformers/Gemma/Gemma.Block.Workspace.ixx