EncodingType.ixx File Reference

Positional encoding strategy selection used by Transformer components. More...

#include <string>
#include <stdexcept>

Namespaces
namespace	Mila
	Mila main API namespace.

Enumerations
enum class	Mila::Dnn::EncodingType { Learned , RoPE , ALiBi }
	Positional encoding strategies. More...

Functions
std::string	Mila::Dnn::encodingTypeToString (EncodingType p)
	Convert EncodingType to string.
EncodingType	Mila::Dnn::stringToEncodingType (const std::string &v)
	Parse string to PositionalEncodingType.

Detailed Description

Positional encoding strategy selection used by Transformer components.

Enumeration Type Documentation

EncodingType

enum class Mila::Dnn::EncodingType

exportstrong

Positional encoding strategies.

Enumerator
Learned	Learned absolute position embeddings (GPT-2 style).
RoPE	Rotary Position Embeddings (LLaMA style).
ALiBi	Attention with Linear Biases (MPT / BLOOM style).

Function Documentation

stringToEncodingType()

EncodingType Mila::Dnn::stringToEncodingType ( const std::string & v )

inlineexport

Parse string to PositionalEncodingType.

Exceptions

std::invalid_argument

on unknown value.