Mila
Deep Neural Network Library
Loading...
Searching...
No Matches
Dnn.Component Module Reference

Exported Modules

module  Compute.CpuMemoryResource
module  Dnn.TensorTypes
module  Dnn.ComponentType
module  Serialization.Tensor
module  Compute.DeviceTypeTraits
module  Compute.Observation
module  Dnn.TensorDataType
module  Compute.IExecutionContext
module  Dnn.TensorDataTypeTraits
module  Serialization.ModelArchive
module  Serialization.SafeTensors
module  Compute.DeviceId
module  Dnn.Tensor
module  Compute.Device
module  Serialization.Mode
module  Dnn.ITensor
module  Compute.DeviceType

Classes

class  Mila::Dnn::BuildContext
 Build-time context for Component::build(). More...
class  Mila::Dnn::Component< TDeviceType, TPrecision >
 Abstract base class for neural network components. More...
struct  Mila::Dnn::DeploymentFootprint
 What a deployment would cost, and how it would prefill. More...
struct  Mila::Dnn::MemoryStats
 Memory allocation breakdown for a single component. More...
struct  Mila::Dnn::PrefillChunking
 How a transformer would chunk a prefill pass at a given context length. More...

Enumerations

enum class  Mila::Dnn::TrainingMode : uint8_t { Normal , Eval }
 Runtime behavioral state for Components built with RuntimeMode::Training. More...

Functions

template<TensorDataType TDataType>
constexpr std::size_t Mila::Dnn::storageBytes (dim_t element_count) noexcept
 Storage bytes occupied by an element count of a given tensor data type.
MemoryStats Mila::Dnn::operator+ (MemoryStats lhs, const MemoryStats &rhs) noexcept
 Aggregate two MemoryStats instances.

Files

file  Mila/Src/Dnn/Core/Component.ixx
 Base component interface for Mila DNN components.
file  Mila/Src/Dnn/Core/Component.BuildContext.ixx
 Build-time context passed to Component::build().
file  Mila/Src/Dnn/Core/Component.MemoryStats.ixx
 Memory allocation statistics for component inspection, and the vocabulary for describing what a deployment would cost before it is built.
file  Mila/Src/Dnn/Core/Component.TrainingMode.ixx
 Runtime behavioral mode for training-built Components.