http://dylanler.github.io/tags/latent-space/Recent content in Latent-Space on Dylan LerHugo -- 0.133.0en-usWed, 25 Feb 2026 14:00:00 -0800http://dylanler.github.io/posts/latent-pager-memory-what-if-llms-remembered-in-vectors/Wed, 25 Feb 2026 14:00:00 -0800http://dylanler.github.io/posts/latent-pager-memory-what-if-llms-remembered-in-vectors/What happens when you give a language model a 60,000 token document and ask it a question about paragraph 47? It forgets. Or worse, it makes something up. This is the long context problem and it is one of the most important open challenges in language modeling today. Context windows keep growing (Gemini has 1M tokens, Claude has 200K) but models still struggle with information buried deep in the middle of long inputs.