Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction

Created by
  • Haebom

Author

Lujie Yang, Xiaoyu Huang, Zhen Wu, Angjoo Kanazawa, Pieter Abbeel, Carmelo Sferrazza, C. Karen Liu, Rocky Duan, Guanya Shi

OmniRetarget: Interaction-Preserving Retargeting for Humanoid Robot Skills

Outline

This paper addresses the challenges of existing approaches to training reinforcement learning (RL) policies by reparameterizing human motion to teach complex skills. Specifically, we address the challenges posed by physical differences between humans and robots and the neglect of human-object and human-environment interactions, which are essential for expressive locomotion and loco-manipulation. OmniRetarget is a data generation engine based on interaction meshes that explicitly models and preserves spatial and contact relationships between agents, terrain, and manipulated objects. By minimizing Laplacian deformations and enforcing kinematic constraints, OmniRetarget generates kinematically feasible trajectories. Furthermore, by preserving task-related interactions, it enables efficient data expansion across diverse robot body, terrain, and object configurations from a single demonstration. By reparameterizing motions from OMOMO, LAFAN1, and our own motion capture datasets, we generate over 8 hours of trajectories, achieving better kinematic constraint satisfaction and contact preservation than widely used baselines. With this high-quality data, our proprioceptive RL policy successfully performs long-term parkour and loco-manipulation tasks for up to 30 seconds on a Unitree G1 humanoid, with only five reward terms and a simple domain randomization shared across all tasks.

Takeaways, Limitations

Takeaways:
Overcoming physical differences between humans and robots: Solving physically infeasible artifacts such as foot-skating and penetration.
Interaction Preservation: Explicitly model and preserve human-object and human-environment interactions to support the learning of expressive actions and loco-manipulation skills.
Efficient data expansion: Generate data for a variety of environments and robot configurations from a single demo.
Performance Improvement: Achieves improved kinematic constraint satisfaction and contact preservation compared to existing methodologies.
Practicality: Successful performance of parkour and loco-manipulation skills on the Unitree G1 humanoid robot.
Limitations:
There is no Limitations mentioned in the paper. (There is no direct mention of Limitations in the Abstract.)
👍