Mila
Deep Neural Network Library
Loading...
Searching...
No Matches
Dnn.Components.GatedMLP Module Reference

Exported Modules

module  Dnn.ComponentType
module  Compute.CpuMemoryResource
module  Dnn.Component
module  Dnn.ActivationType
module  Compute.MemoryResource
module  Dnn.Components.Swiglu
module  Compute.DeviceTypeTraits
module  Compute.ExecutionContextFactory
module  Serialization.Mode
module  Dnn.ITensor
module  Compute.DeviceType
module  Compute.ExecutionContext
module  Dnn.TensorTypes
module  Compute.DeviceId
module  Dnn.Tensor
module  Compute.Device
module  Dnn.TensorDataType
module  Dnn.Components.Linear
module  Serialization.ModelArchive
module  Dnn.TensorDataTypeTraits
module  Compute.IExecutionContext
module  Dnn.CompositeComponent

Classes

class  Mila::Dnn::GatedMLP< TDeviceType, TPrecision, TGate >
 Gated feed-forward (GatedMLP) composite component. More...
class  Mila::Dnn::GatedMLPConfig
 Configuration class for the gated feed-forward (GatedMLP) block. More...

Files

file  Mila/Src/Dnn/Components/FFN/GatedMLP/GatedMLP.ixx
 Gated feed-forward (GatedMLP) block: fused gate+up -> Swiglu gate -> down.
file  Mila/Src/Dnn/Components/FFN/GatedMLP/GatedMLP.Config.ixx
 Configuration for the gated feed-forward (GatedMLP) block.