Mila::Dnn::RouterConfig Class Reference

Inheritance diagram for Mila::Dnn::RouterConfig:

Public Member Functions
	RouterConfig (dim_t hidden_size, dim_t num_experts, dim_t top_k)
void	fromMetadata (const SerializationMetadata &meta) override
	Populate configuration from provided metadata.
float	getEpsilon () const noexcept
dim_t	getHiddenSize () const noexcept
dim_t	getNumExperts () const noexcept
dim_t	getTopK () const noexcept
	Experts each token is dispatched to.
SerializationMetadata	toMetadata () const override
	Convert configuration into a SerializationMetadata object.
std::string	toString () const override
	Produce a short, human-readable summary of the configuration.
void	validate () const override
	Validate configuration parameters.
template<typename Self>
decltype(auto)	withEpsilon (this Self &&self, float epsilon)
	Epsilon of the router's unscaled RMS norm (Gemma 4: rms_norm_eps).
Public Member Functions inherited from Mila::Dnn::ComponentConfig
virtual	~ComponentConfig ()=default
	Virtual destructor for polymorphic base.

Member Function Documentation

fromMetadata()

void Mila::Dnn::RouterConfig::fromMetadata ( const SerializationMetadata & meta )

inlineoverridevirtual

Populate configuration from provided metadata.

Implementations should read available keys and leave missing keys at their current/default values to preserve forward/backward compatibility.

Parameters

meta	Metadata to read configuration values from.

Implements Mila::Dnn::ComponentConfig.

toMetadata()

SerializationMetadata Mila::Dnn::RouterConfig::toMetadata ( ) const

inlineoverridevirtual

Convert configuration into a SerializationMetadata object.

Implementations should include any fields required to fully reconstruct the configuration via fromMetadata.

Returns

SerializationMetadata Metadata representation of the config.

Implements Mila::Dnn::ComponentConfig.

toString()

std::string Mila::Dnn::RouterConfig::toString ( ) const

inlineoverridevirtual

Produce a short, human-readable summary of the configuration.

Implementations should return a compact, single-line description suitable for logging and debugging.

Returns

std::string Human-readable summary of the configuration.

Implements Mila::Dnn::ComponentConfig.

validate()

void Mila::Dnn::RouterConfig::validate ( ) const

inlineoverridevirtual

Validate configuration parameters.

Called by callers to ensure the configuration represents a valid, constructible component. Implementations must throw std::invalid_argument (or a derived exception) when validation fails.

Exceptions

std::invalid_argument

If the configuration is invalid.

Implements Mila::Dnn::ComponentConfig.

---

The documentation for this class was generated from the following file:

• Mila/Src/Dnn/Components/MixtureOfExperts/Router.Config.ixx