Scalar Quantization (SQ) & Product Quantization (PQ) #2
Description
Uses full f32 . Memory usage is high (4 bytes per dimension).
Fix: Compress vectors to u8 or i8 (Quantization) to reduce memory usage by 4x and speed up distance commputations.
{{ message }}