Fast Human Attention Prediction for Fixation-guided Active Perception in Autonomous Navigation
Not on the map. Why?
Abstract (arXiv)
Human visual attention relies on structured scanpaths to efficiently process scenes, yet instilling this behavior into robot autonomy is in its infancy and hindered by the high,computational costs of existing predictive models. To address this, we introduce GazeLNN, a computationally lightweight,scanpath prediction model that leverages Liquid Neural Networks as its recurrent engine and employs MobileNetV3 for feature extraction. Operating auto-regressively, the architecture predicts sequential fixation heatmaps conditioned on the current visual stimulus and fixation history. Despite requiring only 0.61 GFLOPs, GazeLNN achieves state-of-the-art performance on the MIT Low Resolution dataset achieving 0.47 ScanMatch score. It outperforms existing recurrent baselines across diverse evaluation metrics, while reducing computational costs by 99.40% and accelerating inference by up to six times. To investigate the role of human attention modeling in robot autonomy and demonstrate the practical utility of this highly efficient architecture, we integrate GazeLNN into an active camera-robot control policy trained via Reinforcement Learning. This integration enables human-fixation-guided perception during autonomous navigation, validated through successful real-world deployments on an aerial robot.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 43 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
23 of 43 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019Searching for MobileNetV3cited by 1,994
- 2025DINOv3cited by 1,414
- 2018IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architecturescited by 883
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
- 2020Liquid Time-constant Networkscited by 161
- 2016Revisiting Active Perceptioncited by 94
- 2020Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learningcited by 93
- 2021Closed-form Continuous-time Neural Modelscited by 65
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 56
- 2023Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attentioncited by 38
11 more
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformerscited by 22
- 2025Aerial Gym Simulator: A Framework for Highly Parallelized Simulation of Aerial Robotscited by 15
- 2024ViSaRL: Visual Reinforcement Learning Guided by Human Saliencycited by 12
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modelingcited by 12
- 2018Attention-based Active Visual Search for Mobile Robotscited by 8
- 2022Visual Attention Prediction Improves Performance of Autonomous Drone Racing Agentscited by 7
- 2023Task-driven Compression for Collision Encoding based on Depth Imagescited by 7
- 2025Semantically-driven Deep Reinforcement Learning for Inspection Path Planningcited by 6
- 2026Reinforcement Learning for Active Perception in Autonomous Navigationcited by 4
- 2017Integrating Three Mechanisms of Visual Attention for Active Visual Searchcited by 1
- 2025Unified Attention Modeling for Efficient Free-Viewing and Visual Search via Shared Representationscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction
- 2026Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception
- 2023Enhancing Robot Learning through Learned Human-Attention Feature Maps
- 2026EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Cameras
- 2018AGIL: Learning Attention from Human for Visuomotor Tasks
- 2026Artificial Foveated Perception for Mitigating Shortcut Learning in Robotic Foundation Models