Mila::Dnn::Compute::IPositionalDecode Struct Reference

Capability interface for position-dependent unary operations. More...

Public Member Functions
virtual void	decode (const ITensor &input, ITensor &output, dim_t position)=0
	Process a single token at an explicit sequence position.

Detailed Description

Capability interface for position-dependent unary operations.

Implemented by operations whose mathematical output changes based on the token's absolute position in the sequence – e.g. positional embedding lookups (Lpe) and attention operations that index into a KV cache (GQA, MHA).

Operations that are position-agnostic (Linear, RmsNorm, SwiGLU, Residual) do not implement this interface – they use forward() for all modes.

Member Function Documentation

decode()

virtual void Mila::Dnn::Compute::IPositionalDecode::decode ( const ITensor & input, ITensor & output, dim_t position )

pure virtual

Process a single token at an explicit sequence position.

Parameters

input	Single-token input [B, 1, ...].
output	Single-token output [B, 1, ...].
position	Zero-based absolute sequence position.

---

The documentation for this struct was generated from the following file:

• Mila/Src/Dnn/Compute/Operations/IPositionalDecode.ixx