Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Thou Shalt Not Prompt: Zero-Shot Human Activity Recognition in Smart Homes via Language Modeling of Sensor Data & Activities

Created by
  • Haebom

Author

Sourish Gunesh Dhekane, Thomas Ploetz

Outline

This paper highlights the importance of developing a zero-shot human activity recognition (HAR) method to build a human activity recognition (HAR) system that operates across various sensor modes, layouts, and activities of interest in smart home environments. Existing zero-shot HAR methods describe sensor data in natural language and input them into an LLM for classification. However, these methods pose risks such as privacy violations, dependence on external services, and prediction inconsistencies due to version changes. In this paper, we propose a novel method that models sensor data and activities using natural language and performs zero-shot classification using these embeddings as an alternative to performing zero-shot HAR without LLM prompting. Through detailed case studies on six datasets, we demonstrate how natural language modeling enhances HAR systems for zero-shot recognition.

Takeaways, Limitations

Takeaways:
A novel method for performing zero-shot HAR without LLM prompting is presented.
Effectively express sensor data and activities using natural language modeling.
Validation of the method's effectiveness through experimental results using six datasets.
Contributing to resolving privacy breach and external service dependency issues
Limitations:
Further research is needed on the generalization performance of the proposed method.
Applicability to various types of sensor data and activities needs to be verified.
Comparative analysis with other zero-shot HAR methods is needed.
👍