Per-call sampling parameters – the "sampling shape". More...

Classes
struct	Mila::Dnn::SamplingParams
	Per-call sampling knobs consumed by the TokenSampler. More...

Namespaces
namespace	Mila
	Mila main API namespace.

Detailed Description

Per-call sampling parameters – the "sampling shape".

The knobs that turn a logits row into a token: temperature, top-k, top-p. Carried on GenerateParams::sampling and forwarded to the TokenSampler; the sampler never sees generation-loop control. Model-fixed sampler setup (vocabulary size, final-logit softcap) lives in SamplingConfig, not here.

Classes

Namespaces

Detailed Description