Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Perspective-Aware AI in Extended Reality

Created by
  • Haebom

Author

Daniel Platnick, Matti Gruener, Marjan Alirezaie, Kent Larson, Dava J. Newman, Hossein Rahnama

Outline

This paper points out that current AI-based extended reality (XR) systems are limited by the lack of user modeling and limited cognitive context, and proposes the Perspective-Aware AI in Extended Reality (PAiR) framework as a solution. PAiR is a basic framework that integrates Perspective-Aware AI (PAi) with XR to enable interpretable and context-aware experiences based on the user’s identity. PAi is built on Chronicles, an inferable identity model learned from multimodal digital footprints that capture the cognitive and experiential evolution of the user. PAiR uses these models in a closed-loop system that connects dynamic user states with immersive environments. In this paper, we describe the architecture, modules, and system flow of PAiR in detail, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based OpenDome engine. PAiR presents a new direction for human-AI interaction by integrating perspective-based identity models into immersive systems.

Takeaways, Limitations

Takeaways:
Presenting the possibility of delivering user-centric, interpretable, and context-aware XR experiences
Presenting the possibility of implementing personalized XR experiences through user identity modeling based on multi-modal digital footprints
Presenting the possibility of real-time interaction with dynamic user states and immersive environments through closed-loop systems
Presenting a new framework for integrating Perspective-Aware AI (PAi) and XR
Limitations:
Only two proof-of-concept scenarios are currently presented, requiring further validation of practical applicability.
Further research is needed on generalizability and versatility across different user groups.
Consideration Needed for Learning Data Quality and Bias Issues in Chronicles Models
Consideration needs to be given to privacy and data security issues
👍