Mojo module
sampling
Functions
-
apply_penalties_to_logits: Apply penalties to the logits based on the frequency of the tokens in the batch. -
update_frequency_data: Update the frequency data for the given new tokens. -
update_frequency_data_kernel: GPU kernel to update token frequency data in CSR format.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!