NormType.ixx File Reference

Normalization layer type enumeration used by Transformer components. More...

#include <string>
#include <stdexcept>

Namespaces
namespace	Mila
	Mila main API namespace.

Enumerations
enum class	Mila::Dnn::NormType { LayerNorm , RMSNorm }
	Normalization type selection. More...

Functions
std::string	Mila::Dnn::normTypeToString (NormType n)
	Convert NormType to string.
NormType	Mila::Dnn::stringToNormType (const std::string &v)
	Parse string to NormType.

Detailed Description

Normalization layer type enumeration used by Transformer components.

Enumeration Type Documentation

NormType

enum class Mila::Dnn::NormType

exportstrong

Normalization type selection.

Enumerator
LayerNorm	Standard LayerNorm (mean + variance).
RMSNorm	Root Mean Square Norm (variance-only).

Function Documentation

stringToNormType()

NormType Mila::Dnn::stringToNormType ( const std::string & v )

inlineexport

Parse string to NormType.

Exceptions

std::invalid_argument

on unknown value.