Mathematics

A network with ReLU activations secretly carves input space into polytope pieces and, on each piece, collapses into exactly one affine map. This post builds that view up from a single neuron to interactive demos.

Just as Newton’s F=ma describes the physical world, information geometry describes how AI learns. An intuitive guide for beginners.