Dnn.LanguageModelConfig Module Reference

Classes
struct	Mila::Dnn::LanguageModelConfig< TDerived >
	CRTP base configuration for all deployable Mila language models. More...

Enumerations
enum class	Mila::Dnn::KvCacheCompression { None , FP8 }
	KV cache storage and compression strategy for GroupedQueryAttention. More...
enum class	Mila::Dnn::WeightQuantization { None , FP8 , FP4 , Plan }
	Weight storage and matmul strategy for Linear components. More...

Functions
bool	Mila::Dnn::isDerivableFromReferenceWeights (WeightQuantization quantization)
	True when a load can derive this format from reference weights.
void	Mila::Dnn::requireStoredQuantizationMatches (std::string_view caller, std::string_view weights_path, std::string_view stored_quantization, WeightQuantization requested_quantization, int fp4_group_size=128)
	Refuse a load whose stored weights were packed for a different policy.
std::string	Mila::Dnn::weightQuantizationName (WeightQuantization quantization, int fp4_group_size=128)
	The scheme name recorded in a model's weights and in its manifest.

Files
file	Mila/Src/Dnn/Core/LanguageModelConfig.ixx
	CRTP base configuration for all deployable Mila language models.