Scene Text Detection and Recognition "in light of" Challenging Environmental Conditions using Aria Glasses Egocentric Vision Cameras
Not on the map. Why?
Abstract (arXiv)
In an era where wearable technology is reshaping applications, Scene Text Detection and Recognition (STDR) becomes a straightforward choice through the lens of egocentric vision. Leveraging Meta's Project Aria smart glasses, this paper investigates how environmental variables, such as lighting, distance, and resolution, affect the performance of state-of-the-art STDR algorithms in real-world scenarios. We introduce a novel, custom-built dataset captured under controlled conditions and evaluate two OCR pipelines: EAST with CRNN, and EAST with PyTesseract. Our findings reveal that resolution and distance significantly influence recognition accuracy, while lighting plays a less predictable role. Notably, image upscaling emerged as a key pre-processing technique, reducing Character Error Rate (CER) from 0.65 to 0.48. We further demonstrate the potential of integrating eye-gaze tracking to optimise processing efficiency by focusing on user attention zones. This work not only benchmarks STDR performance under realistic conditions but also lays the groundwork for adaptive, user-aware AR systems. Our contributions aim to inspire future research in robust, context-sensitive text recognition for assistive and research-oriented applications, such as asset inspection and nutrition analysis. The code is available at https://github.com/josepDe/Project_Aria_STR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 9 references that are in the map. First posted on arXiv 22 Jul 2025.
Builds on
5 of 9 references.
References · 5
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2025EgoZero: Robot Learning from Smart Glassescited by 33
- 2024TEXT2TASTE: A Versatile Egocentric Vision System for Intelligent Reading Assistance Using Large Language Modelcited by 6
Built on by
Not cited yet.