Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Scene Graph-Guided Proactive Replanning for Failure-Resilient Embodied Agent

Created by
  • Haebom

Author

Che Rin Yu, Daewon Chae, Dabin Seo, Sangwon Lee, Hyeongwoo Im, Jinkyu Kim

Outline

This paper addresses the problem that, unlike humans, who naturally adjust their actions to environmental changes during routine tasks, many autonomous robots often overlook subtle but significant scene changes, leading to failures in their planned actions. We highlight the limitations of existing replanning methods, which only react after failure, making recovery inefficient or impossible, and emphasize the importance of proactive replanning. This study presents a proactive replanning framework that detects and corrects failures at subtask boundaries by comparing the current scene graph generated from RGB-D observations with a reference graph extracted from successful demonstrations. If the current scene does not match the reference trajectory, a lightweight inference module diagnoses the mismatch and adjusts the plan. Experiments on the AI2-THOR simulator demonstrate that the proposed method significantly improves task success rates and robustness by detecting semantic and spatial mismatches before execution failures occur.

Takeaways, Limitations

Takeaways:
We improve the robustness of autonomous robots by enabling proactive replanning through scene graph comparison using RGB-D information.
Perform efficient failure diagnosis and plan adjustments through a lightweight inference module.
The effectiveness of the proposed method was verified through experimental results.
Limitations:
The experiments were conducted only in the AI2-THOR simulator environment, so generalization performance in real environments has not been verified.
Applicability to complex and unpredictable environments may be limited.
There is a need to improve the performance of lightweight inference modules and expand their applicability to various types of failures.
👍