# Perspective-Aware AI in Extended Reality

arXiv: https://arxiv.org/abs/2507.11479 · HTML: https://mlsanity.com/paper/2507.11479/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 3 of its 25 references that are in the map.
- First posted on arXiv 5 May 2025.

## Builds on (most cited first, 3 of 3)

- [Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer](https://mlsanity.com/paper/1910.10683/) (2019)
- [Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacy](https://mlsanity.com/paper/2402.03907/) (2024)
- [A Recipe for Generating 3D Worlds From a Single Image](https://mlsanity.com/paper/2503.16611/) (2025)

## Built on by (most cited first, 3 of 3)

- [ID-RAG: Identity Retrieval-Augmented Generation for Long-Horizon Persona Coherence in Generative Agents](https://mlsanity.com/paper/2509.25299/) (2025)
- [Situation Graph Prediction for User Perspective Modeling](https://mlsanity.com/paper/2602.13319/) (2026)
- [Share No More Than the Request Requires: Federated Disclosure for Perspective-Aware AI](https://mlsanity.com/paper/2607.22953/) (2026)

## Abstract (arXiv)

AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences-yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a foundational framework for integrating Perspective-Aware AI (PAi) with XR to enable interpretable, context-aware experiences grounded in user identity. PAi is built on Chronicles: reasoning-ready identity models learned from multimodal digital footprints that capture users' cognitive and experiential evolution. PAiR employs these models in a closed-loop system linking dynamic user states with immersive environments. We present PAiR's architecture, detailing its modules and system flow, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based OpenDome engine. PAiR opens a new direction for human-AI interaction by embedding perspective-based identity models into immersive systems.