Mojo function
generic_kv_cache_radd_dispatch
generic_kv_cache_radd_dispatch[dtype: DType, collection_t: KVCollectionT, //, target: StringSlice[StaticConstantOrigin]](a: NDBuffer[dtype, 2, origin, shape], cache: collection_t, input_row_offsets: NDBuffer[DType.uint32, 1, origin, shape], batch_offset: UInt32, layer_idx: UInt32, ctx: Optional[DeviceContext])
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!