[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Align Your Rhythm: Generating Highly Aligned Dance Poses with Gating-Enhanced Rhythm-Aware Feature Representation

Created by
  • Haebom

Author

Congyi Fan, Jian Guan, Xuanjia Zhao, Dongli Xu, Youtian Lin, Tong Ye, Pengming Feng, Haiwei Pan

Outline

In this paper, we propose Danceba, a novel framework for automatically generating natural, diverse, and rhythmic human dance movements to music. To address the limitations of existing methods, such as lack of beat alignment and unnatural movement dynamics, Danceba improves the representation of rhythm recognition features by utilizing a gating mechanism. Specifically, we propose Phase-Based Rhythm Extraction (PRE), which accurately extracts rhythm information from the phase data of music, and Temporal-Gated Causal Attention (TGCA), which focuses on global rhythm features to ensure that dance movements follow the music rhythm accurately. In addition, we enhance the naturalness and diversity of the generated dance movements through the Parallel Mamba Motion Modeling (PMMM) architecture, which separately models upper and lower body motions along with musical features. Experimental results show that Danceba significantly outperforms existing state-of-the-art methods in terms of rhythm alignment and movement diversity.

Takeaways, Limitations

Takeaways:
A new framework is presented that overcomes the limitations of existing methods in the field of generating dance movements to music.
Innovative technology proposals such as Phase-Based Rhythm Extraction (PRE), Temporal-Gated Causal Attention (TGCA), and Parallel Mamba Motion Modeling (PMMM)
Create more natural and realistic dance movements through improved rhythm alignment and movement variety.
Suggests potential applications in various fields such as virtual reality and the film industry
Limitations:
Further research is needed on the generalization performance of the proposed method.
Need to verify scalability to various music genres and dance styles
Need for enhanced quantitative comparative analysis with actual human dance movements
Need for analysis of computational cost and time efficiency
👍