A ReLU Network Is One Giant Piecewise-Affine Function

A network with ReLU activations secretly carves input space into polytope pieces and, on each piece, collapses into exactly one affine map. This post builds that view up from a single neuron to interactive demos.

July 3, 2026 · rick