[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper

Created by
  • Haebom

Author

Xinyue Zhu, Binghao Huang, Yunzhu Li

Outline

In this paper, we present a portable, lightweight gripper with integrated tactile sensors to address the __T1465_____ of portable grippers, which are widely used for collecting human demonstration data due to their portability and versatility. Using this gripper, we simultaneously collect visual and tactile data from various real-world environments, and propose a cross-modal representation learning framework that integrates visual and tactile signals while preserving the unique characteristics of each signal. This learning process generates interpretable representations that consistently focus on the contact region involved in physical interactions. The proposed representations are applied to detailed manipulation tasks such as test tube insertion and pipette-based fluid transfer, enabling robotic manipulation with improved accuracy and robustness under external disturbances.

Takeaways, Limitations

Takeaways:
Integrating tactile sensing into a portable gripper enables the collection of visual and tactile data for a variety of manipulation tasks in real-world environments.
A cross-modal representation learning framework that integrates visual and tactile information enables representation learning that focuses on interpretable and physical interaction-related information.
Efficient and effective policy learning for precise robot manipulation is possible using the presented representation.
Demonstrated improved accuracy and robustness against external disturbances in precision tasks such as test tube insertion and pipette-based fluid transfer.
Limitations:
Further research is needed on the generalization performance of the proposed gripper and framework.
Need to evaluate and improve applicability to various objects and tasks.
Additional validation of the sensor's durability and long-term stability is needed.
👍