mlsanityData to 14 Oct 2026

Context Aware AI Assistant and AR Interface for Lunar Extravehicular Activity (EVA) Procedural Guidance

arXiv 2608.13589 ↗First posted 13 Jul 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As human space exploration returns to the Moon, astronauts need rapid access to procedural information during extravehicular activities (EVAs), where attention is divided across navigation, repair tasks, tool handling, and environmental risk. The challenge is not the absence of information, but surfacing the right information at the right moment. We present GAIN-AI (Guided Assistant for Intelligent Navigation), a context-aware AI assistant and minimal heads-up interface for procedural guidance in simulated lunar EVA. The system operates in two layers. The first grounds a large language model with structured context: EVA procedure documents, live telemetry data, and error-handling protocols encoded as JSON. The second restructures that output into three compact units for AR display: Goal, Task, and Verification. Evaluated on 111 synthetic EVA scenarios, the system scores 10.0/10 on nominal conditions and 8.15/10 on single-fault scenarios, with performance degrading on multi-fault and boundary-threshold cases.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 11 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

3 of 11 references.

References · 3

  1. 2025Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision Modelscited by 7
  2. 2025Insights Informed Generative AI for Design: Incorporating Real-world Data for Text-to-Image Outputcited by 2
  3. 2025Text to Robotic Assembly of Multi Component Objects using 3D Generative AI and Vision Language Modelscited by 2

Built on by

Not cited yet.