https://3rdlayer.uk/categories/ai-research/Recent content in AI Research on 3rd layerHugo -- 0.154.5en-USSun, 28 Jun 2026 00:00:00 +0000https://3rdlayer.uk/posts/relu-piecewise-affine/Sun, 28 Jun 2026 00:00:00 +0000https://3rdlayer.uk/posts/relu-piecewise-affine/A network with ReLU activations secretly carves input space into polytope pieces and, on each piece, collapses into exactly one affine map. This post builds that view up from a single neuron to interactive demos.https://3rdlayer.uk/posts/attention-reranking/Sun, 07 Sep 2025 00:00:00 +0000https://3rdlayer.uk/posts/attention-reranking/Leveraging what the LLM already knows. An experiment extracting document relevance signals from Attention Maps to rerank sentences, along with a survey of related papers.