Mila
Deep Neural Network Library
Loading...
Searching...
No Matches
Dnn.Components.MultiHeadAttention Module Reference

Exported Modules

module  Dnn.TensorDataType
module  Dnn.TensorTypes
module  Dnn.TensorDataTypeTraits
module  Serialization.ModelArchive
module  Compute.ExecutionContext
module  Compute.DeviceType
module  Dnn.ITensor
module  Serialization.Mode
module  Dnn.Components.MultiHeadAttentionConfig
module  Compute.OperationTraits
module  Compute.IKvCacheLifecycle
module  Dnn.ComponentType
module  Compute.MemoryResource
module  Compute.DeviceTypeTraits
module  Compute.CpuMemoryResource
module  Dnn.Component
module  Compute.ExecutionContextFactory
module  Compute.Device
module  Compute.IPackedKvInference
module  Compute.DeviceId
module  Dnn.Tensor

Classes

class  Mila::Dnn::MultiHeadAttention< TDeviceType, TPrecision >
 Multi-Head Attention module that accepts concatenated QKV input. More...

Files

file  Mila/Src/Dnn/Components/Attention/MHA/MultiHeadAttention.ixx
 Multi-Head Attention module (concatenated QKV input).