Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models

Created by
  • Haebom

Author

Andela Ilic, Jiaxi Jiang, Paul Streli, Xintong Liu, Christian Holz

Outline

In this paper, we present Garment Inertial Poser (GaIP), a novel method for estimating full-body pose from a small number of inertial measurement units (IMUs) loosely attached to clothing. Existing IMU-based motion capture methods assume that the IMUs are firmly attached to the body, but this assumption is not always true in real-world situations. GaIP simulates IMU measurements using existing clothing-based human motion datasets and estimates human pose from loosely attached IMU data using a transformer-based diffusion model. Specifically, by incorporating clothing-related parameters into the learning process, the proposed method effectively captures variations in clothing looseness or tightness, maintaining expressiveness. Experimental results demonstrate quantitative and qualitative superiority over existing state-of-the-art methods, opening up new possibilities for motion capture research in realistic sensor deployment environments.

Takeaways, Limitations

Takeaways:
A practical motion capture method using a small number of loosely attached IMUs is presented.
Accurate whole-body pose estimation from loose IMU data using a transformer-based diffusion model.
Improving motion capture performance under various clothing conditions by considering clothing-related parameters.
Quantitative and qualitative performance improvements compared to existing state-of-the-art methods.
Limitations:
Currently, simulated IMU data is used, but performance verification on actual data is required.
Further analysis is needed to determine how performance varies depending on clothing type and wearing style.
Generalization performance evaluation is needed for various body types and movements.
👍