ImaginateAR: AI-Assisted In-Situ Authoring in Augmented Reality
Not on the map. Why?
Abstract (arXiv)
While augmented reality (AR) enables new ways to play, tell stories, and explore ideas rooted in the physical world, authoring personalized AR content remains difficult for non-experts, often requiring professional tools and time. Prior systems have explored AI-driven XR design but typically rely on manually defined VR environments and fixed asset libraries, limiting creative flexibility and real-world relevance. We introduce ImaginateAR, the first mobile tool for AI-assisted AR authoring to combine offline scene understanding, fast 3D asset generation, and LLMs -- enabling users to create outdoor scenes through natural language interaction. For example, saying "a dragon enjoying a campfire" (P7) prompts the system to generate and arrange relevant assets, which can then be refined manually. Our technical evaluation shows that our custom pipelines produce more accurate outdoor scene graphs and generate 3D meshes faster than prior methods. A three-part user study (N=20) revealed preferred roles for AI, how users create in freeform use, and design implications for future AR authoring tools. ImaginateAR takes a step toward empowering anyone to create AR experiences anywhere -- simply by speaking their imagination.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Apr 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequencescited by 3
- 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applicationscited by 1
- 2026From Speech-to-Spatial: Grounding Utterances on A Live Shared View with Augmented Realitycited by 1
- 2026DeWorldSG: Depth-Aware 3D Semantic Scene Graph Generation via World-Model Priorscited by 1
- 2026DepthART: Scaling Foundation Monocular Depth to Tiny Modelscited by 1
- 2025Words into World: A Task-Adaptive Agent for Language-Guided Spatial Retrieval in ARcited by 0
- 2026SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objectscited by 0
- 2026SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenescited by 0
- 2026SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes17 Sep 2026
- 2026SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objects19 Aug 2026
- 2026DepthART: Scaling Foundation Monocular Depth to Tiny Models19 Jul 2026
- 2026DeWorldSG: Depth-Aware 3D Semantic Scene Graph Generation via World-Model Priors1 Jul 2026
- 2026From Speech-to-Spatial: Grounding Utterances on A Live Shared View with Augmented Reality3 Feb 2026
- 2026SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences3 Feb 2026
- 2025Words into World: A Task-Adaptive Agent for Language-Guided Spatial Retrieval in AR29 Nov 2025
- 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applications20 Nov 2025