AttentionOutputGate.Config.ixx File Reference

Configuration for the attention output-gate component. More...

#include <string>
#include <sstream>
import Serialization.Metadata;
import Dnn.ComponentConfig;

Classes
class	Mila::Dnn::AttentionOutputGateConfig

Namespaces
namespace	Mila
	Mila main API namespace.

Detailed Description

Configuration for the attention output-gate component.

The gate has no structurally required parameters: its width comes from the input shape at build time and its activation is a compile-time template parameter, the same shape Swiglu carries for its gate function. The default constructor is correct.