Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Nemori: Self-Organizing Agent Memory Inspired by Cognitive Science

Created by
  • Haebom

Author

Jiayan Nan, Wenquan Ma, Wenlong Wu, Yize Chen

Outline

This paper presents Nemori, a novel self-organizing memory architecture based on human cognitive principles, to address the inherent limitations of large-scale language models (LLMs) as autonomous agents in long-term interactions, which limit their effectiveness. Nemori addresses the memory size issue by autonomously organizing conversational flows into semantically coherent episodes through the Two-Step Alignment Principle, inspired by event segmentation theory. Furthermore, the Predict-Calibrate Principle, inspired by free energy principles, enables adaptive knowledge generation beyond predefined heuristics based on prediction differences. Extensive experiments on the LoCoMo and LongMemEval benchmarks demonstrate that Nemori significantly outperforms existing state-of-the-art systems, particularly in long-term contexts.

Takeaways, Limitations

Takeaways:
We present Nemori, a novel self-organizing memory architecture based on human cognitive principles.
Semantically consistent episodic-based memory organization and management via the Two-Step Alignment Principle.
Adaptive knowledge evolution and prediction error-based learning via the Predict-Calibrate Principle.
Performance improvements over existing state-of-the-art systems on LoCoMo and LongMemEval benchmarks, particularly in long-term memory tasks.
Presenting a feasible method for long-term, dynamic workflow processing by autonomous agents.
Limitations:
Nemori's performance improvements may be limited to specific benchmarks.
Verification of generalization performance for complex and diverse real-world situations is necessary.
Further research is needed on the generalizability and scalability of the Two-Step Alignment Principle and the Predict-Calibrate Principle.
Analysis and optimization of computational cost and memory consumption are required.
👍