Dynamic Computational Time for Visual Attention
Not on the map. Why?
Abstract (arXiv)
We propose a dynamic computational time model to accelerate the average processing time for recurrent visual attention (RAM). Rather than attention with a fixed number of steps for each input image, the model learns to decide when to stop on the fly. To achieve this, we add an additional continue/stop action per time step to RAM and use reinforcement learning to learn both the optimal attention policy and stopping policy. The modification is simple but could dramatically save the average computational time while keeping the same recognition performance as RAM. Experimental results on CUB-200-2011 and Stanford Cars dataset demonstrate the dynamic computational model can work effectively for fine-grained image recognition.The source code of this paper can be obtained from https://github.com/baidu-research/DT-RAM
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 6; 2024: 0; 2025: 3; 2026: 1.
23 papers.
Sort:
By area:
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2021Differentiable Patch Selection for Image Recognitioncited by 68
- 2023Variational Information Pursuit for Interpretable Predictionscited by 25
- 2021Human Attention in Fine-grained Classificationcited by 21
- 2023Internally Rewarded Reinforcement Learningcited by 14
- 2023Computation-efficient Deep Learning for Computer Vision: A Surveycited by 14
- 2021A Probabilistic Hard Attention Model For Sequentially Observed Scenescited by 12
- 2022SALISA: Saliency-based Input Sampling for Efficient Video Object Detectioncited by 12
- 2023BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mappingcited by 12
- 2021Re-rank Coarse Classification with Local Region Enhanced Features for Fine-Grained Image Recognitioncited by 11
- 2022Fine-Grained Visual Classification using Self Assessment Classifiercited by 8
11 more
- 2022Boosted Dynamic Neural Networkscited by 8
- 2023Foveation in the Era of Deep Learningcited by 8
- 2021Learning Canonical 3D Object Representation for Fine-Grained Recognitioncited by 7
- 2021Progressive Co-Attention Network for Fine-grained Visual Classificationcited by 5
- 2025Locality-aware Concept Bottleneck Modelcited by 4
- 2023SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformerscited by 3
- 2025Emergence of Fixational and Saccadic Movements in a Multi-Level Recurrent Attention Model for Visioncited by 3
- 2021Sparsely ensembled convolutional neural network classifiers via reinforcement learningcited by 2
- 2022E^2TAD: An Energy-Efficient Tracking-based Action Detectorcited by 1
- 2025EnGraf-Net: Multiple Granularity Branch Network with Fine-Coarse Graft Grained for Classification Taskcited by 0
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocationcited by 0
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation27 Jul 2026
- 2025EnGraf-Net: Multiple Granularity Branch Network with Fine-Coarse Graft Grained for Classification Task25 Sep 2025
- 2025Locality-aware Concept Bottleneck Model20 Aug 2025
- 2025Emergence of Fixational and Saccadic Movements in a Multi-Level Recurrent Attention Model for Vision19 May 2025
- 2023Foveation in the Era of Deep Learning3 Dec 2023
- 2023BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping29 Oct 2023
- 2023SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers4 Oct 2023
- 2023Computation-efficient Deep Learning for Computer Vision: A Survey27 Aug 2023
- 2023Variational Information Pursuit for Interpretable Predictions6 Feb 2023
- 2023Internally Rewarded Reinforcement Learning1 Feb 2023
- 2022Boosted Dynamic Neural Networks30 Nov 2022
- 2022Fine-Grained Visual Classification using Self Assessment Classifier21 May 2022
11 more
- 2022E^2TAD: An Energy-Efficient Tracking-based Action Detector9 Apr 2022
- 2022SALISA: Saliency-based Input Sampling for Efficient Video Object Detection5 Apr 2022
- 2021A Probabilistic Hard Attention Model For Sequentially Observed Scenes15 Nov 2021
- 2021Human Attention in Fine-grained Classification2 Nov 2021
- 2021Learning Canonical 3D Object Representation for Fine-Grained Recognition10 Aug 2021
- 2021MOOD: Multi-level Out-of-distribution Detection30 Apr 2021
- 2021Differentiable Patch Selection for Image Recognition7 Apr 2021
- 2021Re-rank Coarse Classification with Local Region Enhanced Features for Fine-Grained Image Recognition19 Feb 2021
- 2021Dynamic Neural Networks: A Survey9 Feb 2021
- 2021Sparsely ensembled convolutional neural network classifiers via reinforcement learning7 Feb 2021
- 2021Progressive Co-Attention Network for Fine-grained Visual Classification21 Jan 2021
- 2023Internally Rewarded Reinforcement Learningcited by 14
- 2023Internally Rewarded Reinforcement Learning1 Feb 2023
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2021Differentiable Patch Selection for Image Recognitioncited by 68
- 2023Variational Information Pursuit for Interpretable Predictionscited by 25
- 2021Human Attention in Fine-grained Classificationcited by 21
- 2023Computation-efficient Deep Learning for Computer Vision: A Surveycited by 14
- 2021A Probabilistic Hard Attention Model For Sequentially Observed Scenescited by 12
- 2022SALISA: Saliency-based Input Sampling for Efficient Video Object Detectioncited by 12
- 2023BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mappingcited by 12
- 2021Re-rank Coarse Classification with Local Region Enhanced Features for Fine-Grained Image Recognitioncited by 11
- 2022Fine-Grained Visual Classification using Self Assessment Classifiercited by 8
- 2022Boosted Dynamic Neural Networkscited by 8
12 most cited of 22 All 22 (JSON)
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation27 Jul 2026
- 2025EnGraf-Net: Multiple Granularity Branch Network with Fine-Coarse Graft Grained for Classification Task25 Sep 2025
- 2025Locality-aware Concept Bottleneck Model20 Aug 2025
- 2025Emergence of Fixational and Saccadic Movements in a Multi-Level Recurrent Attention Model for Vision19 May 2025
- 2023Foveation in the Era of Deep Learning3 Dec 2023
- 2023BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping29 Oct 2023
- 2023SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers4 Oct 2023
- 2023Computation-efficient Deep Learning for Computer Vision: A Survey27 Aug 2023
- 2023Variational Information Pursuit for Interpretable Predictions6 Feb 2023
- 2022Boosted Dynamic Neural Networks30 Nov 2022
- 2022Fine-Grained Visual Classification using Self Assessment Classifier21 May 2022
- 2022E^2TAD: An Energy-Efficient Tracking-based Action Detector9 Apr 2022
12 newest of 22 All 22 (JSON)