Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Behave Your Motion: Habit-preserved Cross-category Animal Motion Transfer

Created by
  • Haebom

Author

Zhimin Zhang, Bi'an Du, Caoyuan Ma, Zheng Wang, Wei Hu

Outline

In this paper, we propose a novel framework for transferring motions that reflect species-specific behavioral habits of animals to other species. Existing motion transfer methods mainly focus on human motions, focusing on skeletal alignment or style consistency, but overlook the preservation of unique behavioral habits of animals. To address this, we introduce a habit preservation module that includes species-specific habit encoders, and present a generative framework that learns motion priors that capture unique habitual features. In addition, we integrate a large-scale language model (LLM) to facilitate motion transfer to previously unseen species. We introduce a novel quadruped animal skeleton dataset, DeformingThings4D-skl, and verify the superiority of the proposed model through extensive experiments and quantitative analyses.

Takeaways, Limitations

Takeaways:
A novel framework for interspecies animal motion transfer is presented.
Maintaining an animal's unique behavioral habits through the habit preservation module.
Motion transfer for unobserved species possible using LLM.
A new quadruped animal skeleton dataset, DeformingThings4D-skl, is released.
Limitations:
Further review is needed regarding the size and diversity of the DeformingThings4D-skl dataset.
Further analysis is needed on the dependence of LLM performance on model performance and the impact of LLM limitations on model performance.
Verification of generalization performance for various types of animals and complex movements is required.
👍