Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Nemori: Self-Organizing Agent Memory Inspired by Cognitive Science

Created by
  • Haebom

Author

Jiayan Nan, Wenquan Ma, Wenlong Wu, Yize Chen

Outline

This paper presents Nemori, a novel self-organizing memory architecture based on human cognitive principles, to address the lack of persistent long-term memory retention, which limits the effectiveness of large-scale language models (LLMs) as autonomous agents in long-term interactions. Nemori addresses the granularity problem of memory units by autonomously organizing conversational flows into semantically coherent episodes through the Two-Step Alignment Principle, inspired by event segmentation theory. Furthermore, the Predict-Calibrate Principle, inspired by free energy principles, enables adaptive knowledge evolution beyond predefined heuristics based on prediction differences. Extensive experiments on the LoCoMo and LongMemEval benchmarks demonstrate that Nemori significantly outperforms existing state-of-the-art systems, particularly in long-term contexts.

Takeaways, Limitations

Takeaways:
A new approach to solving the long-term memory problem of LLM is presented by Nemori, a new self-organizing memory structure based on human cognitive principles.
Effectively solve the problem of granularity of memory units and the problem of adaptive knowledge development through the Two-Step Alignment Principle and the Predict-Calibrate Principle.
Nemori's superiority is demonstrated by outperforming existing state-of-the-art systems on the LoCoMo and LongMemEval benchmarks.
Presenting a feasible path for long-term, dynamic autonomous agent workflow processing.
Limitations:
Beyond the fact that Nemori's performance gains are particularly notable in long contexts, further research is needed to determine its generalizability to other types of interactions or tasks.
Further analysis is needed on the specific parameter settings and optimization of the Two-Step Alignment Principle and Predict-Calibrate Principle.
Further research is needed to evaluate Nemori's performance and robustness in complex real-world situations.
👍