mlsanityData to 14 Oct 2026

Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection

arXiv 2509.17877 ↗First posted 22 Sep 2025cs.RO cs.CVcited by 1

On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control

Abstract (arXiv)

Autonomous inspection is a central problem in robotics, with applications ranging from industrial monitoring to search-and-rescue. Traditionally, inspection has often been reduced to navigation tasks, where the objective is to reach a predefined location while avoiding obstacles. However, this formulation captures only part of the real inspection problem. In real-world environments, the inspection targets may become visible well before their exact coordinates are reached, making further movement both redundant and inefficient. What matters more for inspection is not simply arriving at the target's position, but positioning the robot at a viewpoint from which the target becomes observable. In this work, we revisit inspection from a perception-aware perspective. We propose an end-to-end reinforcement learning framework that explicitly incorporates target visibility as the primary objective, enabling the robot to find the shortest trajectory that guarantees visual contact with the target without relying on a map. The learned policy leverages both perceptual and proprioceptive sensing and is trained entirely in simulation, before being deployed to a real-world robot. We further develop an algorithm to compute ground-truth shortest inspection paths, which provides a reference for evaluation. Through extensive experiments, we show that our method outperforms existing classical and learning-based navigation approaches, yielding more efficient inspection trajectories in both simulated and real-world settings. The project is avialable at https://sight-over-site.github.io/

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 32 of its 45 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

32 of 45 references.

References · 32

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  3. 2018On Evaluation of Embodied Navigation Agentscited by 547
  4. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  5. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  6. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  7. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
  8. 2023ViNT: A Foundation Model for Visual Navigationcited by 222
  9. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
  10. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  11. 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
  12. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
20 more
  1. 2022Navigating to Objects in the Real Worldcited by 106
  2. 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
  3. 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 54
  4. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 49
  5. 2023ViPlanner: Visual Semantic Imperative Learning for Local Navigationcited by 46
  6. 2019An Efficient Sampling-based Method for Online Informative Path Planning in Unknown Environmentscited by 40
  7. 2023iPlanner: Imperative Path Planningcited by 37
  8. 2022Is Mapping Necessary for Realistic PointGoal Navigation?cited by 35
  9. 2020Fast Frontier-based Information-driven Autonomous Exploration with an MAVcited by 24
  10. 2023Autonomous Power Line Inspection with Drones via Perception-Aware MPCcited by 17
  11. 2025FrontierNet: Learning Visual Cues to Explorecited by 12
  12. 2021FAR Planner: Fast, Attemptable Route Planner using Dynamic Visibility Updatecited by 11
  13. 2022SEER: Safe Efficient Exploration for Aerial Robots using Learning to Predict Information Gaincited by 11
  14. 2024Language-Conditioned Offline RL for Multi-Robot Navigationcited by 9
  15. 2025ForesightNav: Learning Scene Imagination for Efficient Explorationcited by 9
  16. 2024Semantic Belief Behavior Graph: Enabling Autonomous Robot Inspection in Unknown Environmentscited by 7
  17. 2023A 3D Mixed Reality Interface for Human-Robot Teamingcited by 6
  18. 2025Safe Multi-Agent Navigation guided by Goal-Conditioned Safe Reinforcement Learningcited by 6
  19. 2023Semantics-aware Exploration and Inspection Path Planningcited by 4
  20. 2022RoBoa: Construction and Evaluation of a Steerable Vine Robot for Search and Rescue Applicationscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Semantically-driven Deep Reinforcement Learning for Inspection Path Planning
  2. 2024SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks
  3. 2026Reinforcement Learning for Active Perception in Autonomous Navigation
  4. 2023Learning to View: Decision Transformers for Active Object Detection
  5. 2025Dynamic Object Masks as Goal Representations for Visual Goal-Conditioned Reinforcement Learning
  6. 2021Maintaining a Reliable World Model using Action-aware Perceptual Anchoring
  7. 2024Transformers for Image-Goal Navigation
  8. 2026120 Minutes and a Laptop: Minimalist Image-goal Navigation via Unsupervised Exploration and Offline RL