According to @_avichawla on X, Flash KMeans achieves 33x over cuML and 200x over FAISS by removing GPU IO bottlenecks and enabling millisecond iterations.

According to @_avichawla, KMeans inference costs O(kd) per sample as you compare to k centroids in d dimensions, assuming precomputed centroids.