Mila::Dnn::MixtureOfExpertsConfig Class Reference

Inheritance diagram for Mila::Dnn::MixtureOfExpertsConfig:

Public Member Functions
	MixtureOfExpertsConfig (dim_t hidden_size, dim_t expert_intermediate_size, dim_t num_experts, dim_t top_k)
void	fromMetadata (const SerializationMetadata &meta) override
	Populate configuration from provided metadata.
dim_t	getExpertIntermediateSize () const noexcept
	One expert's gated width I: gate_up_proj is [E, 2I, H], down_proj is [E, H, I].
dim_t	getHiddenSize () const noexcept
dim_t	getNumExperts () const noexcept
dim_t	getTopK () const noexcept
	Experts each token is dispatched to; the routing tensors are [..., top_k].
SerializationMetadata	toMetadata () const override
	Convert configuration into a SerializationMetadata object.
std::string	toString () const override
	Produce a short, human-readable summary of the configuration.
void	validate () const override
	Validate configuration parameters.
Public Member Functions inherited from Mila::Dnn::ComponentConfig
virtual	~ComponentConfig ()=default
	Virtual destructor for polymorphic base.

Member Function Documentation

fromMetadata()

void Mila::Dnn::MixtureOfExpertsConfig::fromMetadata ( const SerializationMetadata & meta )

inlineoverridevirtual

Populate configuration from provided metadata.

Implementations should read available keys and leave missing keys at their current/default values to preserve forward/backward compatibility.

Parameters

meta	Metadata to read configuration values from.

Implements Mila::Dnn::ComponentConfig.

toMetadata()

SerializationMetadata Mila::Dnn::MixtureOfExpertsConfig::toMetadata ( ) const

inlineoverridevirtual

Convert configuration into a SerializationMetadata object.

Implementations should include any fields required to fully reconstruct the configuration via fromMetadata.

Returns

SerializationMetadata Metadata representation of the config.

Implements Mila::Dnn::ComponentConfig.

toString()

std::string Mila::Dnn::MixtureOfExpertsConfig::toString ( ) const

inlineoverridevirtual

Produce a short, human-readable summary of the configuration.

Implementations should return a compact, single-line description suitable for logging and debugging.

Returns

std::string Human-readable summary of the configuration.

Implements Mila::Dnn::ComponentConfig.

validate()

void Mila::Dnn::MixtureOfExpertsConfig::validate ( ) const

inlineoverridevirtual

Validate configuration parameters.

Called by callers to ensure the configuration represents a valid, constructible component. Implementations must throw std::invalid_argument (or a derived exception) when validation fails.

Exceptions

std::invalid_argument

If the configuration is invalid.

Implements Mila::Dnn::ComponentConfig.

---

The documentation for this class was generated from the following file:

• Mila/Src/Dnn/Components/MixtureOfExperts/MixtureOfExperts.Config.ixx