Mila
Deep Neural Network Library
Loading...
Searching...
No Matches
Dnn.Components.Router Module Reference

Exported Modules

module  Dnn.Components.RmsNorm
module  Compute.DeviceId
module  Dnn.Tensor
module  Dnn.TensorTypes
module  Dnn.TensorDataType
module  Serialization.SafeTensors
module  Dnn.Components.Linear
module  Dnn.TensorDataTypeTraits
module  Serialization.ModelArchive
module  Compute.ExecutionContextFactory
module  Serialization.Tensor
module  Dnn.Component
module  Compute.CpuMemoryResource
module  Dnn.ComponentType
module  Serialization.Mode
module  Dnn.ITensor
module  Compute.ExecutionContext
module  Compute.DeviceType
module  Compute.DeviceTypeTraits
module  Compute.DeviceAllocation
module  Compute.Observation
module  Dnn.TensorOps
module  Compute.OperationTraits
module  Compute.IExecutionContext
module  Dnn.CompositeComponent
module  Dnn.Components.RouterConfig

Classes

class  Mila::Dnn::Router< TDeviceType, TPrecision >
 Routes each token to its top_k experts. More...
struct  Mila::Dnn::Router< TDeviceType, TPrecision >::Routing
 One call's result. Both views are router-owned and valid until the next forward(). More...

Files

file  Mila/Src/Dnn/Components/MixtureOfExperts/Router.ixx
 Mixture-of-experts router: which experts each token runs, and with what combine weights.