Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Intentional Gesture: Deliver Your Intentions with Gestures for Speech

Created by
  • Haebom

Author

Pinxin Liu, Haiyang Liu, Luchuan Song, Jason J. Corso, Chenliang Xu

Outline

This paper introduces Intentional-Gesture, a novel framework for understanding and leveraging human communication intent to generate meaningful gestures. To address the reliance of existing methods on shallow linguistic cues, we treat gesture generation as an intent inference task based on high-level communication features. By building the InG dataset, adding gesture-intention annotations, and developing an Intentional Gesture Motion Tokenizer to enable intent-aware gesture synthesis, we achieve unprecedented performance on the BEAT-2 benchmark.

Takeaways, Limitations

Takeaways:
We present an intent-based gesture generation framework based on high-level communication functions.
Building the InG dataset by adding gesture-intention annotations to the BEAT-2 dataset.
Development of a novel motion tokenizer for intent recognition.
Achieving cutting-edge performance on the BEAT-2 benchmark.
Contributing to the creation of expressive gestures for digital humans and embodied AI.
Limitations:
There is no specific mention of Limitations within the paper.
👍