AI Research

A network with ReLU activations secretly carves input space into polytope pieces and, on each piece, collapses into exactly one affine map. This post builds that view up from a single neuron to interactive demos.

Leveraging what the LLM already knows. An experiment extracting document relevance signals from Attention Maps to rerank sentences, along with a survey of related papers.