Skip to main content
Log in

Mojo function

get_mha_decoding_num_partitions

get_mha_decoding_num_partitions[num_heads: Int, group: Int](batch_size: Int, num_keys: Int, ctx: DeviceContext) -> Int