IPackedKvInference.ixx File Reference

KV-cache inference interface for GPT-style packed-QKV MHA backends. More...

import Dnn.TensorTypes;
import Compute.IKvCacheLifecycle;
import Dnn.ITensor;

Classes
struct	Mila::Dnn::Compute::IPackedKvInference
	KV-cache inference interface for packed-QKV MHA backends. More...

Namespaces
namespace	Mila
	Mila main API namespace.

Detailed Description

KV-cache inference interface for GPT-style packed-QKV MHA backends.