SamplingConfig.ixx File Reference

Construction-time configuration for the token sampler. More...

#include <cstdint>
#include <stdexcept>
#include <utility>

Classes
class	Mila::Dnn::SamplingConfig
	Model-fixed configuration for TokenSampler. More...

Namespaces
namespace	Mila
	Mila main API namespace.

Detailed Description

Construction-time configuration for the token sampler.

Holds the model-fixed sampling inputs (vocabulary size, final logit softcap). Per-call knobs (temperature / top_k / top_p / seed) are GenerateParams, not here.