Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

ContactDexNet: Multi-fingered Robotic Hand Grasping in Cluttered Environments through Hand-object Contact Semantic Mapping

Created by
  • Haebom

Author

Lei Zhang, Kaixin Bai, Guowen Huang, Zhenshan Bing, Zhaopeng Chen, Alois Knoll, Jianwei Zhang

Outline

This paper presents a method to improve multi-finger grasping techniques in difficult-to-grasp environments. The grasping technique using contact information in complex environments is still an unexplored area. In this paper, we develop a method to generate multi-finger grasping samples in complex environments using a contact semantic map. We introduce a contact semantic conditional variational autoencoder network (CoSe-CVAE) to generate a comprehensive contact semantic map from object point clouds, and estimate hand grasping poses from the contact semantic map using a grasp detection method. Finally, we design an integrated grasp evaluation model, PointNetGPD++, to significantly improve the reliability of identifying optimal grasps in complex environments. We achieve an average grasping success rate of 81.0%, which is at least 4.65% better than the state-of-the-art methods in real single-object environments, and a grasping success rate of 75.3% in complex environments. We also present a method to generate a multi-modal multi-finger grasping dataset, which is superior to existing datasets in terms of scene diversity and mode diversity. The dataset, code, and supplementary materials can be found in https://sites.google.com/view/contact-dexnet .

Takeaways, Limitations

Takeaways:
Significantly improved multi-finger grasping performance in complex environments (at least 4.65% improvement)
We present a novel phage generation method using contact semantic maps.
We present a multimodal multi-finger grasping dataset with enhanced diversity.
PointNetGPD++ can effectively evaluate the quality and collision probability of phages.
Limitations:
The experimental environment is limited to a single-object environment and a complex environment. Further research is needed on generalization performance in diverse environments.
Further improvements may be needed in the size and diversity of the dataset.
Experimental results on real robotic systems are limited. Compatibility and performance evaluation with various robotic systems are required.
👍