Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Scaling Up without Fading Out: Goal-Aware Sparse GNN for RL-based Generalized Planning

Created by
  • Haebom

Author

Sangwoo Jeon, Juchul Shin, Gyeong-Tae Kim, YeonJe Cho, Seongwoo Kim

Outline

This paper addresses the limitations of existing fully connected graph representations in generalized planning, combining reinforcement learning (RL) and graph neural networks (GNNs), in various symbolic planning domains described by PDDL. Existing methods represent planning states as fully connected graphs, which can lead to combinatorial explosion and sparsity problems as the problem size increases, especially in large grid-based environments. These dense representations dilute node-level information and exponentially increase memory requirements, making learning on large-scale problems impossible. In this paper, we propose a sparse, goal-aware GNN representation that selectively encodes relevant local relationships and explicitly incorporates objective-related spatial features. We validate the proposed method by designing novel PDDL-based drone mission scenarios within a grid world. Experimental results demonstrate that the proposed method effectively scales to larger grid sizes, which is not possible with existing dense graph representations, and significantly improves policy generalization and success rates.

Takeaways, Limitations

Takeaways:
We present a solution to generalized planning problems in large-scale grid-based environments using sparse, goal-aware GNN representations.
It effectively solves the problems of increased memory requirements and inability to learn, which were limitations of existing methods.
We demonstrate its applicability to realistic, large-scale, generalized planning problems such as drone mission scenarios.
Significantly improves policy generalization and success rates.
Limitations:
Further research is needed to determine whether the proposed method is effective for all types of PDDL problems.
Performance evaluation in more complex and diverse environments is required.
Further research may be needed on the optimal design and parameter settings of the proposed sparse graph representation.
👍