What is TurboQuant

A compression algorithm that stores embeddings and the KV cache in 3 to 4 bits instead of 32, with no training. It works in two stages:

32-bit
(r, theta)
~4-bit

Stage 1 - PolarQuant
Stage 2 - QJ + 1 bit