Tagged “quantization”
-
Quantization: trading memory for recall
Scalar, product and binary quantization compress vectors by discarding precision. What each one throws away, and why reranking recovers most of it.
-
Composite indexes: coarse filter, exact rescore
Nearly every large-scale index is the same two-stage pattern with different parts. What each stage must guarantee, and how the pattern nests inside itself.
-
Why product quantization wants a rotation first
Splitting a vector into slices assumes information is spread evenly across them. It isn't. What a learned rotation fixes, and why it's free per query.
-
Residual quantization: compressing what the centroid missed
Quantizing a vector's offset from its cluster centroid, rather than the vector, shrinks the error for free. Why it works, and what it couples together.