Mojo module
mha_operand
Structs
-
KVCacheMHAOperand
: An implementation formo.opaque
KVCacheT arguments to MHA kernels. -
NDBufferMHAOperand
: An implementation for NDBuffer arguments to MHA kernels. -
RaggedMHAOperand
: An implementation for ragged NDBuffer arguments to MHA kernels.
Traits
-
MHAOperand
: This serves as the trait to support arguments to our MHA kernel.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!