Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulation

Created by
  • Haebom

Author

Hao-Shu Fang, Branden Romero, Yichen Xie, Arthur Hu, Bo-Ruei Huang, Juan Alvarez, Matthew Kim, Gabriel Margolis, Kavya Anbarasu, Masayoshi Tomizuka, Edward Adelson, Pulkit Agrawal

Outline

This paper presents "perioperation," a novel paradigm for robotic data collection. Perioperation is a method for detecting and recording human manipulation while maximizing data transferability to actual robots. To achieve this, we developed DEXOP, a passive hand exoskeleton designed to collect rich sensory (visual and tactile) data for a variety of skilled manipulation tasks. DEXOP mechanically connects human and robotic fingers, providing direct contact feedback (via proprioception) to the user and mirroring the human hand's posture to the passive robotic hand, maximizing the transfer of demonstrated skills to the robot. Force feedback and posture reflection enable more natural task demonstrations for humans compared to teleoperation, improving both speed and accuracy. We evaluated DEXOP on tasks involving a variety of skilled contacts, demonstrating its ability to collect high-quality demonstration data at scale. Policies learned from DEXOP data significantly improve task performance per unit of data collection time compared to teleoperation, demonstrating its potential as a powerful tool for improving robot proficiency.

Takeaways, Limitations

Takeaways:
Presenting perioperation, a new paradigm that increases the efficiency of robot data collection.
DEXOP enables the collection of high-quality, skilled operator data at scale.
Obtaining robot learning data faster and more accurately than remote operation.
Improved performance per unit of data collection time.
Presenting new technologies that contribute to improving robot proficiency.
Limitations:
Lack of specific description of DEXOP's practical robotic applications.
Lack of generalization performance assessment across diverse work environments and objects.
Lack of consideration for human fatigue during long-term use.
Lack of information on the cost and complexity of the DEXOP system.
👍