Dnn.Components.MultiHeadAttention Module Reference

Exported Modules
module	Compute.DeviceTypeTraits
module	Dnn.TensorDataType
module	Dnn.TensorTypes
module	Compute.IKvCacheLifecycle
module	Dnn.ComponentType
module	Compute.DeviceId
module	Compute.Device
module	Dnn.Tensor
module	Compute.IPackedKvInference
module	Compute.OperationTraits
module	Compute.Observation
module	Compute.DeviceAllocation
module	Compute.MemoryResource
module	Compute.ExecutionContextFactory
module	Dnn.TensorDataTypeTraits
module	Serialization.ModelArchive
module	Compute.CpuMemoryResource
module	Dnn.Component
module	Dnn.ITensor
module	Compute.ExecutionContext
module	Compute.DeviceType
module	Serialization.Mode
module	Dnn.Components.MultiHeadAttentionConfig

Classes
class	Mila::Dnn::MultiHeadAttention< TDeviceType, TPrecision >
	Multi-Head Attention module that accepts concatenated QKV input. More...

Files
file	Mila/Src/Dnn/Components/Attention/MHA/MultiHeadAttention.ixx
	Multi-Head Attention module (concatenated QKV input).