Mila
Deep Neural Network Library
Loading...
Searching...
No Matches
Mila::Dnn::Quant::Weight::PerGroupCodebook3< kGroupSize > Struct Template Referenceexport

Static Public Attributes

static constexpr int kCodeBits = 3
static constexpr int kCodebookEntries = 8
static constexpr bool kHasHighBitPlane = true
static constexpr bool kIsCodebook = true
static constexpr bool kIsFp4E2M1 = false
static constexpr bool kIsQuantized = true
static constexpr bool kPerChannel = false
static constexpr int kQuantizationGroupSize = kGroupSize
static constexpr TensorDataType kScaleDtype = TensorDataType::FP16
static constexpr int kStorageBitsPerElement = 2
static constexpr TensorDataType kStorageDtype = TensorDataType::UINT8

The documentation for this struct was generated from the following file:
  • Mila/Src/Dnn/Quantization/Weight/Policies.ixx