Mila
Deep Neural Network Library
Loading...
Searching...
No Matches
GenerateParams.ixx File Reference

Per-call generation request: loop control plus the sampling shape. More...

#include <optional>
#include <vector>
import Dnn.SamplingParams;
import Data.Tokenizer;

Classes

struct  Mila::Dnn::GenerateParams
 Per-call inputs to LanguageModel::generate. More...

Namespaces

namespace  Mila
 Mila main API namespace.

Typedefs

using Mila::Dnn::TokenId = Data::TokenId

Detailed Description

Per-call generation request: loop control plus the sampling shape.