TokenEmbedding.Config.ixx File Reference

Configuration for the TokenEmbedding component. More...

#include <stdexcept>
#include <string>
#include <utility>
#include <sstream>
#include <cmath>
import Serialization.Metadata;
import Dnn.TensorTypes;
import Dnn.ComponentConfig;

Classes
class	Mila::Dnn::TokenEmbeddingConfig
	Configuration for the TokenEmbedding component. More...

Namespaces
namespace	Mila
	Mila main API namespace.

Detailed Description

Configuration for the TokenEmbedding component.

Derived from LpeConfig with all positional embedding fields removed. TokenEmbedding is a pure vocabulary lookup – sequence position is handled downstream by a dedicated encoding component (RoPE, ALiBi, or Learned).