Mojo module

mha_tile_scheduler

Structs

• ​MHASchedule:
• ​MHASchedulerSynchronization:
• ​MHATileState:
• ​MHATileSummary:
• ​QueuedTileScheduler: If decoding == False, then num_heads is q_num_heads. If decoding == True, then num_heads is kv_num_heads.
• ​SeqInfo:
• ​TileScheduler:
• ​TransientScheduler:
• ​WorkInfo:

Traits

• ​MHATileScheduler:

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit