Mobile Augmented Reality: User Interfaces, Frameworks, and Intelligence
Not on the map. Why?
Abstract (arXiv)
Mobile Augmented Reality (MAR) integrates computer-generated virtual objects with physical environments for mobile devices. MAR systems enable users to interact with MAR devices, such as smartphones and head-worn wearables, and performs seamless transitions from the physical world to a mixed world with digital entities. These MAR systems support user experiences by using MAR devices to provide universal accessibility to digital contents. Over the past 20 years, a number of MAR systems have been developed, however, the studies and design of MAR frameworks have not yet been systematically reviewed from the perspective of user-centric design. This article presents the first effort of surveying existing MAR frameworks (count: 37) and further discusses the latest studies on MAR through a top-down approach: 1) MAR applications; 2) MAR visualisation techniques adaptive to user mobility and contexts; 3) systematic evaluation of MAR frameworks including supported platforms and corresponding features such as tracking, feature extraction plus sensing capabilities; and 4) underlying machine learning approaches supporting intelligent operations within MAR systems. Finally, we summarise the development of emerging research fields, current state-of-the-art, and discuss the important open challenges and possible theoretical and technical directions. This survey aims to benefit both researchers and MAR system developers alike.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 29 of its 301 references that are in the map. First posted on arXiv 16 Jun 2021.
Builds on
29 of 301 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Mask R-CNNcited by 7,259
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2019Tracking without bells and whistlescited by 382
17 more
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
- 2019MOTS: Multi-Object Tracking and Segmentationcited by 222
- 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
- 2016An Analysis of Deep Neural Network Models for Practical Applicationscited by 114
- 2016Learning to Track at 100 FPS with Deep Regression Networkscited by 89
- 2018VITAL: VIsual Tracking via Adversarial Learningcited by 65
- 2019Automatic Scene Inference for 3D Object Compositingcited by 36
- 2016Spatially Supervised Recurrent Convolutional Neural Networks for Visual Object Trackingcited by 13
- 2017Contextual Sequence Modeling for Recommendation with Recurrent Neural Networkscited by 11
- 2017Interaction Methods for Smart Glassescited by 9
- 2019GrabAR: Occlusion-aware Grabbing Virtual Objects in ARcited by 4
- 2020Object Detection in the Context of Mobile Augmented Realitycited by 4
- 2020Instant 3D Object Tracking with Applications in Augmented Realitycited by 3
- 2017Light Source Estimation with Analytical Path-tracingcited by 1
- 2019Semantic-Aware Label Placement for Augmented Reality in Street Viewcited by 1
Built on by
Citing papers per year: 2023: 3; 2024: 0; 2025: 6; 2026: 1.
10 papers.
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstructioncited by 19
- 2025MoEdit: On Learning Quantity Perception for Multi-object Image Editingcited by 7
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
- 2023Virtual Occlusions Through Implicit Depthcited by 5
- 2025NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairmentcited by 2
- 2025PILAR: Personalizing Augmented Reality Interactions with LLM-based Human-Centric and Trustworthy Explanations for Daily Use Casescited by 1
- 2025iTrace: Click-Based Gaze Visualization on the Apple Vision Procited by 0
- 2025Augmented Assembly: Object Recognition and Hand Tracking for Adaptive Assembly Instructions in Augmented Realitycited by 0
- 2026Systematic Literature Review of Machine Learning Models and Applications for Text Recognitioncited by 0
- 2026Systematic Literature Review of Machine Learning Models and Applications for Text Recognition27 Aug 2026
- 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstruction29 Dec 2025
- 2025PILAR: Personalizing Augmented Reality Interactions with LLM-based Human-Centric and Trustworthy Explanations for Daily Use Cases19 Dec 2025
- 2025Augmented Assembly: Object Recognition and Hand Tracking for Adaptive Assembly Instructions in Augmented Reality22 Nov 2025
- 2025NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairment23 Sep 2025
- 2025iTrace: Click-Based Gaze Visualization on the Apple Vision Pro17 Aug 2025
- 2025MoEdit: On Learning Quantity Perception for Multi-object Image Editing13 Mar 2025
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Framework5 Aug 2023
- 2023Virtual Occlusions Through Implicit Depth11 May 2023
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr 2023