When Memory Becomes a Place
What if a model did not reread its past in words? That question led to the largest completed experiment in this repository: compress long documents into latent vectors, project those vectors into soft tokens, and compare the result with a text summary buffer. The experiment began with an attractive hypothesis: Latent Pager Memory can preserve useful information with less generation cost than a text buffer. The data supported that hypothesis and exposed a dangerous price....