Spatially Adaptive Computation Time for Residual Networks
Not on the map. Why?
Abstract (arXiv)
This paper proposes a deep learning architecture based on Residual Network that dynamically adjusts the number of executed layers for the regions of the image. This architecture is end-to-end trainable, deterministic and problem-agnostic. It is therefore applicable without any modifications to a wide range of computer vision problems such as image classification, object detection and image segmentation. We present experimental results showing that this model improves the computational efficiency of Residual Networks on the challenging ImageNet classification and COCO object detection datasets. Additionally, we evaluate the computation time maps on the visual saliency dataset cat2000 and find that they correlate surprisingly well with human eye fixation positions.
Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 17; 2023: 28; 2024: 12; 2025: 14; 2026: 8.
118 papers.
Sort:
By area:
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 360
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2021AdaViT: Adaptive Vision Transformers for Efficient Image Recognitioncited by 228
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2021Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognitioncited by 143
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2021SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Eventscited by 84
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2021Adaptive Focus for Efficient Video Recognitioncited by 76
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
38 more
- 2021FrameExit: Conditional Early Exiting for Efficient Video Recognitioncited by 59
- 2021PnP-DETR: Towards Efficient Visual Analysis with Transformerscited by 52
- 2021A Survey on Green Deep Learningcited by 52
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2023Revisiting Token Pruning for Object Detection and Instance Segmentationcited by 50
- 2021AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognitioncited by 48
- 2022NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Modelscited by 47
- 2024AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruningcited by 43
- 2022Glance and Focus Networks for Dynamic Visual Recognitioncited by 41
- 2023Adaptive Sparse Convolutional Networks with Global Context Enhancement for Faster Object Detection on Drone Imagescited by 41
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networkscited by 39
- 2024MaskGaussian: Adaptive 3D Gaussian Representation from Probabilistic Maskscited by 39
- 2021AdaFocus V2: End-to-End Training of Spatial Dynamic Networks for Video Recognitioncited by 37
- 2021AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognitioncited by 36
- 2021Dynamic Network Quantization for Efficient Video Inferencecited by 36
- 2022Path Independent Equilibrium Models Can Better Exploit Test-Time Computationcited by 33
- 2023Dynamic Perceiver for Efficient Visual Recognitioncited by 33
- 2021Skip-Convolutions for Efficient Video Processingcited by 32
- 2021Dual-side Sparse Tensor Corecited by 27
- 2021Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Rate Controlcited by 26
- 2023Latency-aware Unified Dynamic Networks for Efficient Image Recognitioncited by 26
- 2022Latency-aware Spatial-wise Dynamic Networkscited by 25
- 2021Variable-rate discrete representation learningcited by 24
- 2022Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inferencecited by 24
- 2021RomeBERT: Robust Training of Multi-Exit BERTcited by 19
- 2025HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challengescited by 19
- 2021Hard-Attention for Scalable Image Classificationcited by 18
- 2021PFA: Privacy-preserving Federated Adaptation for Effective Model Personalizationcited by 18
- 2021Anytime Dense Prediction with Confidence Adaptivitycited by 18
- 2021Multi-Exit Semantic Segmentation Networkscited by 18
- 2022Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routingcited by 18
- 2022AdaFocusV3: On Unified Spatial-temporal Dynamic Video Recognitioncited by 18
- 2024Accelerating Inference in Large Language Models with a Unified Layer Skipping Strategycited by 17
- 2022LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Modelscited by 16
- 2021VA-RED2: Video Adaptive Redundancy Reductioncited by 15
- 2023DynamicDet: A Unified Dynamic Architecture for Object Detectioncited by 15
- 2021Automated Deep Learning: Neural Architecture Search Is Not the Endcited by 13
- 2023Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformerscited by 13
50 most cited of 118 All 118 (JSON)
- 2026A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization5 Aug 2026
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation27 Jul 2026
- 2026Adaptive Compute in Latent World Models: When Depth Helps, Hurts, or Doesn't Matter11 Jul 2026
- 2026AIR: Amortized Image Reconstruction Framework for Self-Supervised Feed-Forward 2D Gaussian Splatting20 May 2026
- 2026iPhoneBlur: A Difficulty-Stratified Benchmark for Consumer Device Motion Deblurring7 May 2026
- 2026Do Not Imitate, Reinforce: Iterative Classification via Belief Refinement23 Apr 2026
- 2026AdaDINO: Context-Adaptive DINO-Distilled Vision Foundation Models for Efficient Open-Vocabulary Edge Inference17 Apr 2026
- 2026Efficient On-Board Processing of Oblique UAV Video for Rapid Flood Extent Mapping16 Jan 2026
- 2025ExpertSim: Fast Particle Detector Simulation Using Mixture-of-Generative-Experts28 Aug 2025
- 2025STAS: Spatio-Temporal Adaptive Computation Time for Spiking Transformers19 Aug 2025
- 2025Harnessing Input-Adaptive Inference for Efficient VLN12 Aug 2025
- 2025Change of Thought: Adaptive Test-Time Computation17 Jul 2025
38 more
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception26 Jun 2025
- 2025Exploiting Lightweight Hierarchical ViT and Dynamic Framework for Efficient Visual Tracking25 Jun 2025
- 2025HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challenges18 Jun 2025
- 2025Efficiency Robustness of Dynamic Deep Learning Systems12 Jun 2025
- 2025Energy-Aware Deep Learning on Resource-Constrained Hardware18 May 2025
- 2025Optimization of Layer Skipping and Frequency Scaling for Convolutional Neural Networks under Latency Constraint31 Mar 2025
- 2025Learning to Inference Adaptively for Multimodal Large Language Models13 Mar 2025
- 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learning6 Mar 2025
- 2025A Survey on Dynamic Neural Networks: from Computer Vision to Multi-modal Sensor Fusion13 Jan 2025
- 2025PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization5 Jan 2025
- 2024MaskGaussian: Adaptive 3D Gaussian Representation from Probabilistic Masks29 Dec 2024
- 2024Uni-AdaFocus: Spatial-temporal Dynamic Computation for Video Recognition15 Dec 2024
- 2024AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning4 Dec 2024
- 2024Puppet-CNN: Continuous Parameter Dynamics for Input-Adaptive Convolutional Networks19 Nov 2024
- 2024Early-exit Convolutional Neural Networks9 Sep 2024
- 2024AT-SNN: Adaptive Tokens for Vision Transformer on Spiking Neural Network22 Aug 2024
- 2024Dyn-Adapter: Towards Disentangled Representation for Efficient Visual Recognition19 Jul 2024
- 2024Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules9 Jul 2024
- 2024Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design3 Jul 2024
- 2024Accelerating Inference in Large Language Models with a Unified Layer Skipping Strategy10 Apr 2024
- 2024EERO: Early Exit with Reject Option for Efficient Classification with limited budget6 Feb 2024
- 2024TPC-ViT: Token Propagation Controller for Efficient Vision Transformer3 Jan 2024
- 2023Adaptive Depth Networks with Skippable Sub-Paths27 Dec 2023
- 2023Progressive Painterly Image Harmonization from Low-level Styles to High-level Styles15 Dec 2023
- 2023Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference15 Dec 2023
- 2023No-Skim: Towards Efficiency Robustness Evaluation on Skimming-based Language Models15 Dec 2023
- 2023PAUMER: Patch Pausing Transformer for Semantic Segmentation1 Nov 2023
- 2023USDC: Unified Static and Dynamic Compression for Visual Transformer17 Oct 2023
- 2023An automated approach for improving the inference latency and energy efficiency of pretrained CNNs by removing irrelevant pixels with focused convolutions11 Oct 2023
- 2023SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers4 Oct 2023
- 2023Efficient Single Object Detection on Image Patches with Early Exit Enhanced High-Precision CNNs7 Sep 2023
- 2023Latency-aware Unified Dynamic Networks for Efficient Image Recognition30 Aug 2023
- 2023Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformers25 Aug 2023
- 2023Dynamic Neural Network is All You Need: Understanding the Robustness of Dynamic Mechanisms in Neural Networks17 Aug 2023
- 2023A distributed neural network architecture for dynamic sensor selection with application to bandwidth-constrained body-sensor networks16 Aug 2023
- 2023AdaBrowse: Adaptive Video Browser for Efficient Continuous Sign Language Recognition16 Aug 2023
- 2023Redundancy-aware Transformer for Video Question Answering7 Aug 2023
- 2023Ada3D : Exploiting the Spatial Redundancy with Adaptive Inference for Efficient 3D Object Detection17 Jul 2023
50 newest of 118 All 118 (JSON)
- 2023Revisiting Token Pruning for Object Detection and Instance Segmentationcited by 50
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networkscited by 39
- 2022Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inferencecited by 24
- 2025PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimizationcited by 2
- 2026A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimizationcited by 0
- 2026A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization5 Aug 2026
- 2025PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization5 Jan 2025
- 2023Revisiting Token Pruning for Object Detection and Instance Segmentation12 Jun 2023
- 2022Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inference9 Jun 2022
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networks9 Jun 2021
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2022Scalable Adaptive Computation for Iterative Generation22 Dec 2022
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 360
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2021AdaViT: Adaptive Vision Transformers for Efficient Image Recognitioncited by 228
- 2021Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognitioncited by 143
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2021SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Eventscited by 84
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2021Adaptive Focus for Efficient Video Recognitioncited by 76
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2021FrameExit: Conditional Early Exiting for Efficient Video Recognitioncited by 59
12 most cited of 109 All 109 (JSON)
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation27 Jul 2026
- 2026AIR: Amortized Image Reconstruction Framework for Self-Supervised Feed-Forward 2D Gaussian Splatting20 May 2026
- 2026iPhoneBlur: A Difficulty-Stratified Benchmark for Consumer Device Motion Deblurring7 May 2026
- 2026Do Not Imitate, Reinforce: Iterative Classification via Belief Refinement23 Apr 2026
- 2026AdaDINO: Context-Adaptive DINO-Distilled Vision Foundation Models for Efficient Open-Vocabulary Edge Inference17 Apr 2026
- 2026Efficient On-Board Processing of Oblique UAV Video for Rapid Flood Extent Mapping16 Jan 2026
- 2025ExpertSim: Fast Particle Detector Simulation Using Mixture-of-Generative-Experts28 Aug 2025
- 2025STAS: Spatio-Temporal Adaptive Computation Time for Spiking Transformers19 Aug 2025
- 2025Harnessing Input-Adaptive Inference for Efficient VLN12 Aug 2025
- 2025Change of Thought: Adaptive Test-Time Computation17 Jul 2025
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception26 Jun 2025
- 2025Exploiting Lightweight Hierarchical ViT and Dynamic Framework for Efficient Visual Tracking25 Jun 2025
12 newest of 109 All 109 (JSON)