# Everyday AR through AI-in-the-Loop

arXiv: https://arxiv.org/abs/2412.12681 · HTML: https://mlsanity.com/paper/2412.12681/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 27 references that are in the map.
- First posted on arXiv 17 Dec 2024.

## Builds on (most cited first, 9 of 9)

- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [LLMR: Real-time Prompting of Interactive Worlds using Large Language Models](https://mlsanity.com/paper/2309.12276/) (2023)
- [GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality](https://mlsanity.com/paper/2404.08213/) (2024)
- [ARGUS: Visualization of AI-Assisted Task Guidance in AR](https://mlsanity.com/paper/2308.06246/) (2023)
- [PrISM-Observer: Intervention Agent to Help Users Perform Everyday Procedures Sensed using a Smartwatch](https://mlsanity.com/paper/2407.16785/) (2024)
- [Augmented Math: Authoring AR-Based Explorable Explanations by Augmenting Static Math Textbooks](https://mlsanity.com/paper/2307.16112/) (2023)
- [How People Prompt to Create Interactive VR Scenes](https://mlsanity.com/paper/2402.10525/) (2024)
- [Immersive Augmented Reality Training for Complex Manufacturing Scenarios](https://mlsanity.com/paper/1602.01944/) (2016)
- [Exploratory Design of a Hands-free Video Game Controller for a Quadriplegic Individual](https://mlsanity.com/paper/2109.01186/) (2021)

## Built on by (most cited first, 2 of 2)

- [AIvaluateXR: An Evaluation Framework for on-Device AI in XR with Benchmarking Results](https://mlsanity.com/paper/2502.15761/) (2025)
- [Do We Need Responsible XR? Drawing on Responsible AI to Inform Ethical Research and Practice into XRAI / the Metaverse](https://mlsanity.com/paper/2504.04440/) (2025)

## Abstract (arXiv)

This workshop brings together experts and practitioners from augmented reality (AR) and artificial intelligence (AI) to shape the future of AI-in-the-loop everyday AR experiences. With recent advancements in both AR hardware and AI capabilities, we envision that everyday AR -- always-available and seamlessly integrated into users' daily environments -- is becoming increasingly feasible. This workshop will explore how AI can drive such everyday AR experiences. We discuss a range of topics, including adaptive and context-aware AR, generative AR content creation, always-on AI assistants, AI-driven accessible design, and real-world-oriented AI agents. Our goal is to identify the opportunities and challenges in AI-enabled AR, focusing on creating novel AR experiences that seamlessly blend the digital and physical worlds. Through the workshop, we aim to foster collaboration, inspire future research, and build a community to advance the research field of AI-enhanced AR.