|
Mila
Deep Neural Network Library
|
Device-templated Encoder module for token and positional embeddings. More...
#include <memory>#include <vector>#include <string>#include <iostream>#include <sstream>#include <type_traits>#include <stdexcept>#include <cstdint>#include <optional>#include <cmath>#include <numeric>#include <algorithm>import Dnn.TensorHelpers;import Serialization.SafeTensors;import Serialization.Tensor;import Serialization.ModelArchive;import Compute.IPositionalDecode;import Compute.ExecutionContextFactory;import Compute.MemoryResource;import Dnn.Component;import Serialization.Metadata;import Dnn.ITensor;import Logging.Logger;import Compute.OperationTraits;import Dnn.TensorTypes;import Compute.DeviceTypeTraits;import Dnn.TensorOps;import Dnn.TensorDataType;import Compute.DeviceId;import Serialization.Mode;import Compute.CpuMemoryResource;import Dnn.TensorDataTypeTraits;import Dnn.Tensor;import Compute.Device;import Dnn.ComponentType;import Compute.DeviceType;import Dnn.Components.LpeConfig;import Compute.ExecutionContext;Classes | |
| class | Mila::Dnn::Lpe< TDeviceType, TIndex, TPrecision > |
| Encoder module for token and positional embeddings (device-templated). More... | |
Namespaces | |
| namespace | Mila |
| Mila main API namespace. | |
Device-templated Encoder module for token and positional embeddings.
Delegates compute to a UnaryOperation backend. Module owns token (wte) and positional (wpe) embedding parameters and exposes them to callers.