Mojo struct
block_Q4_K
struct block_Q4_K
Fields
- base_scale (
SIMD[float16, 1]): - base_min (
SIMD[float16, 1]): - q_scales_and_mins (
InlineArray[SIMD[uint8, 1], 12]): - q_bits (
InlineArray[SIMD[uint8, 1], 128]):
Implemented traits
AnyType,
UnknownDestructibility
Aliases
group_count
alias group_count = 8
group_size
alias group_size = 32
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!