Memory-Augmented LLM Agents for Long-Term Personalized Decision Making

Authors

  • Remo Zobel School of Information Technology, University of Cincinnati, Cincinnati, OH, USA. Author

Keywords:

memory-augmented agents, long-term personalization, decision support, socio-technical systems, governance, robustness, fairness, sustainability

Abstract

Large language model agents are increasingly proposed as intermediaries for complex, longitudinal decision support, yet their default reliance on finite context windows and stateless inference limits their capacity to maintain coherent personal histories. This paper examines memory-augmented LLM agents as socio-technical infrastructures for long-term personalized decision making. It argues that memory is not a peripheral feature but a foundational layer that shapes privacy, accountability, robustness, fairness, and institutional legitimacy. The analysis distinguishes episodic, semantic, procedural, and affective memory functions and considers how retrieval, summarization, consolidation, and forgetting mechanisms interact with model inference, tool use, and human oversight. Structural trade-offs are analyzed across latency, cost, explainability, consent, data minimization, and failure containment. The paper further discusses nonstationarity and personal drift, showing that long-term personalization requires mechanisms for revision, contestation, and temporal validity rather than simple accumulation. Governance challenges include auditability, liability allocation, cross-border data flows, and the risk that opaque memory stores become unaccountable shadow records. Deployment models are compared across cloud, edge, and hybrid architectures, with attention to healthcare, finance, education, and public services. The paper concludes that sustainable memory-augmented agents require layered architectures, explicit memory contracts, continuous evaluation, and policy frameworks that treat personalization as a governed relationship rather than an engineering optimization. Such systems can support better decisions only if they remain contestable, resource-aware, and aligned with the long-term interests of the people they serve.

References

1. Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529-533. https://doi.org/10.1038/nature14236

2. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998-6008.

3. Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., ... & Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877-1901.

4. Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610-623. https://doi.org/10.1145/3442188.3445922

5. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., ... & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33, 9459-9474.

6. Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023). Generative agents: Interactive simulacra of human behavior. Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 1-22. https://doi.org/10.1145/3586183.3606763

7. Shinn, N., Cassano, F., Gopinath, A., Narasimhan, K., & Yao, S. (2023). Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Information Processing Systems, 36, 8634-8652.

8. Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., ... & Wen, J. R. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6), 186345. https://doi.org/10.1007/s11704-024-40231-1

9. Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2023). ReAct: Synergizing reasoning and acting in language models. International Conference on Learning Representations.

10. Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., ... & Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. Advances in Neural Information Processing Systems, 36, 68539-68551.

11. Packer, C., Wooders, S., Lin, K., Fang, V., Patil, S. G., Stoica, I., & Gonzalez, J. E. (2023). MemGPT: Towards LLMs as operating systems. arXiv preprint arXiv:2310.08560.

12. Zhang, Z., Bo, X., Ma, C., Li, R., Chen, X., Dai, Q., ... & Wen, J. R. (2024). A survey on the memory mechanism of large language model based agents. arXiv preprint arXiv:2404.13501.

13. Dafoe, A., Hughes, E., Bachrach, Y., Collins, T., McKee, K. R., Leibo, J. Z., ... & Graepel, T. (2020). Open problems in cooperative AI. arXiv preprint arXiv:2012.08630.

14. Jiang, H., Xin, G., Huang, Y., Zhu, G., Zhang, J., Lin, X., ... & Cao, Z. (2026). AgentOmnia: Scaling Agentic Models for Full-Scenario Applications. arXiv preprint arXiv:2607.23124.

15. Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., ... & Liang, P. (2021). On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258.

16. Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P. S., ... & Gabriel, I. (2021). Ethical and social risks of harm from language models. arXiv preprint arXiv:2112.04359.

17. Floridi, L., & Chiriatti, M. (2020). GPT-3: Its nature, scope, limits, and consequences. Minds and Machines, 30(4), 681-694. https://doi.org/10.1007/s11023-020-09548-1

18. Russell, S. (2019). Human compatible: Artificial intelligence and the problem of control. Viking.

19. Topol, E. J. (2019). Deep medicine: How artificial intelligence can make healthcare human again. Basic Books.

20. National Academies of Sciences, Engineering, and Medicine. (2022). Fostering responsible computing research: Foundations and practices. The National Academies Press. https://doi.org/10.17226/26353

Downloads

Published

2026-08-01