This is a page that curates AI-related papers published worldwide. All content here is summarized using Google Gemini and operated on a non-profit basis. Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.
This paper presents a method to improve multi-finger grasping techniques in difficult-to-grasp environments. The grasping technique using contact information in complex environments is still an unexplored area. In this paper, we develop a method to generate multi-finger grasping samples in complex environments using a contact semantic map. We introduce a contact semantic conditional variational autoencoder network (CoSe-CVAE) to generate a comprehensive contact semantic map from object point clouds, and estimate hand grasping poses from the contact semantic map using a grasp detection method. Finally, we design an integrated grasp evaluation model, PointNetGPD++, to significantly improve the reliability of identifying optimal grasps in complex environments. We achieve an average grasping success rate of 81.0%, which is at least 4.65% better than the state-of-the-art methods in real single-object environments, and a grasping success rate of 75.3% in complex environments. We also present a method to generate a multi-modal multi-finger grasping dataset, which is superior to existing datasets in terms of scene diversity and mode diversity. The dataset, code, and supplementary materials can be found in https://sites.google.com/view/contact-dexnet .
Significantly improved multi-finger grasping performance in complex environments (at least 4.65% improvement)
◦
We present a novel phage generation method using contact semantic maps.
◦
We present a multimodal multi-finger grasping dataset with enhanced diversity.
◦
PointNetGPD++ can effectively evaluate the quality and collision probability of phages.
•
Limitations:
◦
The experimental environment is limited to a single-object environment and a complex environment. Further research is needed on generalization performance in diverse environments.
◦
Further improvements may be needed in the size and diversity of the dataset.
◦
Experimental results on real robotic systems are limited. Compatibility and performance evaluation with various robotic systems are required.