Active Object Localization with Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We present an active detection model for localizing objects in scenes. The model is class-specific and allows an agent to focus attention on candidate regions for identifying the correct location of a target object. This agent learns to deform a bounding box using simple transformation actions, with the goal of determining the most specific location of target objects following top-down reasoning. The proposed localization agent is trained using deep reinforcement learning, and evaluated on the Pascal VOC 2007 dataset. We show that agents guided by the proposed model are able to localize a single instance of an object after analyzing only between 11 and 25 regions in an image, and obtain the best detection results among systems that do not use object proposals for object localization.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 11; 2023: 4; 2024: 5; 2025: 2; 2026: 4.
42 papers.
Sort:
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2021Reinforced Attention for Few-Shot Learning and Beyondcited by 18
- 2021Sequential Voting with Relational Box Fields for Active Object Detectioncited by 13
- 2021Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classificationcited by 12
- 2021AdaZoom: Adaptive Zoom Network for Multi-Scale Object Detection in Large Scenescited by 11
- 2021Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasoundcited by 10
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenescited by 9
- 2022Estimating Visual Information From Audio Through Manifold Learningcited by 7
- 2024AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scalecited by 7
- 2022Video Violence Recognition and Localization Using a Semi-Supervised Hard Attention Modelcited by 5
- 2022Aerial View Localization with Reinforcement Learning: Towards Emulating Search-and-Rescuecited by 4
30 more
- 2023RL-LOGO: Deep Reinforcement Learning Localization for Logo Recognitioncited by 4
- 2021Stochastic Actor-Executor-Critic for Image-to-Image Translationcited by 3
- 2024Towards Two-Stream Foveation-based Active Vision Learningcited by 3
- 2025Emergence of Fixational and Saccadic Movements in a Multi-Level Recurrent Attention Model for Visioncited by 3
- 2025MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentationcited by 3
- 2021Visual Attention in Imaginative Agentscited by 2
- 2021Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D Imagescited by 2
- 2021Do Neural Network Weights account for Classes Centers?cited by 2
- 2021Dynamic Multi-Scale Loss Optimization for Object Detectioncited by 2
- 2022Object Detection with Deep Reinforcement Learningcited by 2
- 2021Adaptive Remote Sensing Image Attribute Learning for Active Object Detectioncited by 1
- 2021Where to Look: A Unified Attention Model for Visual Recognition with Reinforcement Learningcited by 1
- 2022Multi-Agent Active Search using Detection and Location Uncertaintycited by 1
- 2024Integrating Saliency Ranking and Reinforcement Learning for Enhanced Object Detectioncited by 1
- 2021Autonomous Curiosity for Real-Time Training Onboard Robotic Agentscited by 0
- 2021Reinforcement Explanation Learningcited by 0
- 2022Weakly Supervised Scene Text Detection using Deep Reinforcement Learningcited by 0
- 2022Learning Transferable Reward for Query Object Localization with Policy Adaptationcited by 0
- 2022Saccade Mechanisms for Image Classification, Object Detection and Trackingcited by 0
- 2022A Dynamic Data Driven Approach for Explainable Scene Understandingcited by 0
- 2022An Adaptive Threshold for the Canny Edge Detection with Actor-Critic Algorithmcited by 0
- 2023RL-I2IT: Image-to-Image Translation with Deep Reinforcement Learningcited by 0
- 2023Benchmarking Feature Extractors for Reinforcement Learning-Based Semiconductor Defect Localizationcited by 0
- 2023A Target Detection Algorithm in Traffic Scenes Based on Deep Reinforcement Learningcited by 0
- 2024Counting Objects in a Robotic Handcited by 0
- 2024How to Augment for Atmospheric Turbulence Effects on Thermal Adapted Object Detection Models?cited by 0
- 2026GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrievalcited by 0
- 2026Motion-Aware Reinforcement Learning For Object Localizationcited by 0
- 2026GoStop: Reinforcement Learning for Adaptive Temporal Aggregation in Event-Based Feature Trackingcited by 0
- 2026Falcon Perception-HD: High Density Perception via Reinforcement Learningcited by 0
- 2026Falcon Perception-HD: High Density Perception via Reinforcement Learning19 Aug 2026
- 2026GoStop: Reinforcement Learning for Adaptive Temporal Aggregation in Event-Based Feature Tracking17 Jul 2026
- 2026Motion-Aware Reinforcement Learning For Object Localization19 Jun 2026
- 2026GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrieval30 May 2026
- 2025MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentation23 Jun 2025
- 2025Emergence of Fixational and Saccadic Movements in a Multi-Level Recurrent Attention Model for Vision19 May 2025
- 2024Integrating Saliency Ranking and Reinforcement Learning for Enhanced Object Detection13 Aug 2024
- 2024How to Augment for Atmospheric Turbulence Effects on Thermal Adapted Object Detection Models?10 May 2024
- 2024Counting Objects in a Robotic Hand9 Apr 2024
- 2024AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scale4 Apr 2024
- 2024Towards Two-Stream Foveation-based Active Vision Learning24 Mar 2024
- 2023RL-LOGO: Deep Reinforcement Learning Localization for Logo Recognition28 Dec 2023
30 more
- 2023A Target Detection Algorithm in Traffic Scenes Based on Deep Reinforcement Learning25 Dec 2023
- 2023Benchmarking Feature Extractors for Reinforcement Learning-Based Semiconductor Defect Localization18 Nov 2023
- 2023RL-I2IT: Image-to-Image Translation with Deep Reinforcement Learning24 Sep 2023
- 2022An Adaptive Threshold for the Canny Edge Detection with Actor-Critic Algorithm19 Sep 2022
- 2022Aerial View Localization with Reinforcement Learning: Towards Emulating Search-and-Rescue8 Sep 2022
- 2022Object Detection with Deep Reinforcement Learning9 Aug 2022
- 2022Estimating Visual Information From Audio Through Manifold Learning3 Aug 2022
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learning25 Jul 2022
- 2022A Dynamic Data Driven Approach for Explainable Scene Understanding18 Jun 2022
- 2022Saccade Mechanisms for Image Classification, Object Detection and Tracking10 Jun 2022
- 2022Multi-Agent Active Search using Detection and Location Uncertainty9 Mar 2022
- 2022Learning Transferable Reward for Query Object Localization with Policy Adaptation24 Feb 2022
- 2022Video Violence Recognition and Localization Using a Semi-Supervised Hard Attention Model4 Feb 2022
- 2022Weakly Supervised Scene Text Detection using Deep Reinforcement Learning13 Jan 2022
- 2021Stochastic Actor-Executor-Critic for Image-to-Image Translation14 Dec 2021
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenes10 Dec 2021
- 2021Reinforcement Explanation Learning26 Nov 2021
- 2021Where to Look: A Unified Attention Model for Visual Recognition with Reinforcement Learning13 Nov 2021
- 2021Sequential Voting with Relational Box Fields for Active Object Detection21 Oct 2021
- 2021Autonomous Curiosity for Real-Time Training Onboard Robotic Agents29 Aug 2021
- 2021Dynamic Multi-Scale Loss Optimization for Object Detection9 Aug 2021
- 2021AdaZoom: Adaptive Zoom Network for Multi-Scale Object Detection in Large Scenes19 Jun 2021
- 2021Weakly Supervised Object Localization and Detection: A Survey16 Apr 2021
- 2021Do Neural Network Weights account for Classes Centers?14 Apr 2021
- 2021Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D Images14 Apr 2021
- 2021Reinforced Attention for Few-Shot Learning and Beyond9 Apr 2021
- 2021Visual Attention in Imaginative Agents1 Apr 2021
- 2021Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound26 Mar 2021
- 2021Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classification15 Mar 2021
- 2021Adaptive Remote Sensing Image Attribute Learning for Active Object Detection16 Jan 2021
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2021Reinforced Attention for Few-Shot Learning and Beyondcited by 18
- 2021Sequential Voting with Relational Box Fields for Active Object Detectioncited by 13
- 2021Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classificationcited by 12
- 2021AdaZoom: Adaptive Zoom Network for Multi-Scale Object Detection in Large Scenescited by 11
- 2021Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasoundcited by 10
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenescited by 9
- 2022Estimating Visual Information From Audio Through Manifold Learningcited by 7
- 2024AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scalecited by 7
- 2022Video Violence Recognition and Localization Using a Semi-Supervised Hard Attention Modelcited by 5
- 2022Aerial View Localization with Reinforcement Learning: Towards Emulating Search-and-Rescuecited by 4
12 most cited of 42 All 42 (JSON)
- 2026Falcon Perception-HD: High Density Perception via Reinforcement Learning19 Aug 2026
- 2026GoStop: Reinforcement Learning for Adaptive Temporal Aggregation in Event-Based Feature Tracking17 Jul 2026
- 2026Motion-Aware Reinforcement Learning For Object Localization19 Jun 2026
- 2026GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrieval30 May 2026
- 2025MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentation23 Jun 2025
- 2025Emergence of Fixational and Saccadic Movements in a Multi-Level Recurrent Attention Model for Vision19 May 2025
- 2024Integrating Saliency Ranking and Reinforcement Learning for Enhanced Object Detection13 Aug 2024
- 2024How to Augment for Atmospheric Turbulence Effects on Thermal Adapted Object Detection Models?10 May 2024
- 2024Counting Objects in a Robotic Hand9 Apr 2024
- 2024AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scale4 Apr 2024
- 2024Towards Two-Stream Foveation-based Active Vision Learning24 Mar 2024
- 2023RL-LOGO: Deep Reinforcement Learning Localization for Logo Recognition28 Dec 2023
12 newest of 42 All 42 (JSON)