[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Generative AI-Driven High-Fidelity Human Motion Simulation

Created by
  • Haebom

Author

Hari Iyer, Neel Macwan, Atharva Jitendra Hude, Heejin Jeong, Shenghan Guo

Outline

In this paper, we present Generative-AI-Enabled HMS (G-AI-HMS) aimed at improving the quality of human motion simulation (HMS) for cost-effective assessment of worker behavior, safety, and productivity in industrial work environments. G-AI-HMS improves the simulation quality of physical tasks by integrating text-to-text and text-to-motion models. The main challenges are (1) converting task descriptions into gesture recognition language using a large-scale language model aligned with the vocabulary of MotionGPT, and (2) validating AI-enhanced motions with real human movements using computer vision. We apply a pose estimation algorithm to real-time videos to extract joint landmarks, and compare them with AI-enhanced sequences using a motion similarity metric. In a case study of eight tasks, we show that AI-enhanced motions outperform human-generated descriptions in most scenarios, and outperform human-generated descriptions in six tasks based on spatial accuracy, in four tasks based on alignment after pose normalization, and in seven tasks based on overall temporal similarity. Statistical analysis showed that AI-enhanced prompts significantly (p < 0.0001) reduced joint errors and temporal alignment errors while maintaining comparable pose accuracy.

Takeaways, Limitations

Takeaways:
G-AI-HMS can solve the low motion fidelity problem of existing HMS, thereby improving the accuracy and efficiency of industrial task simulation.
We demonstrate that large-scale language models and computer vision techniques can be used to generate AI-based behaviors that resemble real human behaviors.
We found that AI-based prompts improved the accuracy of motion simulations at a statistically significant level.
Limitations:
This study is based on a limited case study of eight tasks. Further research is needed on more diverse and complex tasks.
There is a dependency on the vocabulary of MotionGPT used. Extensibility to other models or vocabulary systems needs to be considered.
It may not fully reflect the complexity of real work environments. Further research is needed that takes into account more realistic environmental settings.
👍