Mojo function
rope_k_cache
rope_k_cache[type: DType, cache_t: KVCacheT, width: Int, //, *, interleaved: Bool](k_cache: cache_t, b_idx: Int, h_idx: Int, s_idx: Int, d_idx: Int, freq_val: SIMD[type, width], head_size: Int)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!