IKVCacheLifecycle.ixx File Reference

Interface for operations that own and manage a KV cache. More...

import Dnn.TensorTypes;

Classes
struct	Mila::Dnn::Compute::IKvCacheLifecycle
	Capability interface for KV-cache state management. More...

Namespaces
namespace	Mila
	Mila main API namespace.

Detailed Description

Interface for operations that own and manage a KV cache.