Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Continual Learning for Multimodal Data Fusion of a Soft Gripper

Created by
  • Haebom

Author

Nilay Kushawaha, Egidio Falotico

Outline

This paper proposes a Continual Learning (CL) algorithm capable of continuously and incrementally acquiring new knowledge from the environment while maintaining previously learned information. Specifically, it is designed to incrementally learn from various data modalities (e.g., tactile and visual data) and leverages both class incremental learning and domain incremental learning scenarios in artificial environments with insufficient labels but abundant Independent and Identical Distribution (NIID) unlabeled data. The algorithm enhances efficiency by storing only prototypes for each class. We evaluate its performance using a custom multimodal dataset consisting of tactile data from a soft pneumatic gripper and visual data of objects extracted from still images, as well as the Core50 dataset. Furthermore, we validate the robustness of the algorithm through real-time object classification experiments using the ROS framework.

Takeaways, Limitations

Takeaways:
We present a novel CL algorithm that efficiently learns data of various modalities in a limited label data environment.
Improved applicability to real-world environments by considering both class and domain incremental learning scenarios.
Increased memory efficiency with prototype-based learning.
Validation of the practicality of the algorithm through integration with real robotic systems.
Limitations:
The performance of the proposed algorithm may depend on the dataset used.
Further research is needed on generalization performance across different types of modalities and environments.
Algorithm optimization is needed to improve real-time performance.
Further review is needed regarding the generalizability and representativeness of the custom dataset used.
👍