MacKay's Information Theory: The Free Book and the Lectures
David MacKay’s classic ties information theory, inference, and machine learning into one story, and both the book and the lecture videos are free. Where to get them, to open this series.
Machine-Learning
K-means, GMM, EM: Three Nested Russian Dolls of Clustering
K-means is actually an extreme case of GMM, and GMM is the canonical application of the EM algorithm. How these three connect within a single framework, and how information geometry explains the relationship.
Information Geometry: How AI Learns Most Efficiently
Just as Newton’s F=ma describes the physical world, information geometry describes how AI learns. An intuitive guide for beginners.