Titans: Learning to Memorize at Test Time (Paper Analysis)
Titans introduces a neural memory module that updates itself via gradient descent at inference time, breaking the context-length ceiling of Transformers while staying near-linear in complexity.