|
Mila
Deep Neural Network Library
|
Base interface for Mila token samplers. More...
#include <cstdint>import Compute.DeviceType;import Dnn.SamplingParams;import Dnn.TensorDataTypeTraits;import Dnn.TensorDataType;import Dnn.TensorTypes;import Compute.DeviceTypeTraits;import Dnn.Tensor;import Dnn.ITensor;Classes | |
| class | Mila::Dnn::Sampler< TDeviceType, TPrecision > |
| Abstract base for token samplers. More... | |
Namespaces | |
| namespace | Mila |
| Mila main API namespace. | |
Base interface for Mila token samplers.
Defines the abstract Sampler class template: a model-owned orchestrator tool (the structural sibling of Optimizer) that selects the next token from a logits tensor. Not a graph Component – it runs after the network produces logits. See Specifications/TokenSampling.md.