Mojo module
per_channel_grouped_4bit
Structs
-
block_Q4_K
: -
block_Q6_K
: -
block_QK_K
: -
Q4sym
: Q4sym: compresses values of typefloat_dtype
to 4bit unsigned integers which have been dynamically symmetrically quantized with the given scale factor.
Functions
-
calculate_symmetric_vector
: Symmetrically quantizes the given SIMD vectordata
with input typeinput_dtype
andsimd_width
elements, assuming we want the results to fit in an unsigned integer of sizeoutput_bits
. -
q4_k_dequantize_impl
: -
q6_k_dequantize_impl
: -
scale_min_k4
:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!