K-Means on 3rd layerhttps://3rdlayer.uk/tags/k-means/Recent content in K-Means on 3rd layerHugo -- 0.154.5en-USSat, 06 Jun 2026 00:00:00 +0000Shrinking Models by Sharing Weights — K-Means-based Quantizationhttps://3rdlayer.uk/posts/kmeans-weight-quantization/Sat, 06 Jun 2026 00:00:00 +0000https://3rdlayer.uk/posts/kmeans-weight-quantization/Group a neural network’s weights into a few representative values with K-Means, and you can shrink the model several-fold with almost no accuracy loss. We explore it with an interactive widget where you watch the clusters converge and the storage shrink in real time. (Deep Compression, Han et al. 2016)K-means, GMM, EM: Three Nested Russian Dolls of Clusteringhttps://3rdlayer.uk/posts/em-kmeans-gmm/Sun, 10 Dec 2023 00:00:00 +0000https://3rdlayer.uk/posts/em-kmeans-gmm/K-means is actually an extreme case of GMM, and GMM is the canonical application of the EM algorithm. How these three connect within a single framework, and how information geometry explains the relationship.