Convolutional Neural Networks at Constrained Time Cost
Not on the map. Why?
Abstract (arXiv)
Though recent advanced convolutional neural networks (CNNs) have been improving the image recognition accuracy, the models are getting more complex and time-consuming. For real-world applications in industrial and commercial scenarios, engineers and developers are often faced with the requirement of constrained time budget. In this paper, we investigate the accuracy of CNNs under constrained time cost. Under this constraint, the designs of the network architectures should exhibit as trade-offs among the factors like depth, numbers of filters, filter sizes, etc. With a series of controlled comparisons, we progressively modify a baseline model while preserving its time complexity. This is also helpful for understanding the importance of the factors in network designs. We present an architecture that achieves very competitive accuracy in the ImageNet dataset (11.8% top-5 error, 10-view test), yet is 20% faster than "AlexNet" (16.0% top-5 error, 10-view test).
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 19; 2023: 13; 2024: 8; 2025: 9; 2026: 6.
81 papers.
Sort:
By area:
- 2024DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averagingcited by 48
- 2021A Voxel Graph CNN for Object Classification with Event Camerascited by 38
- 2022A Law of Data Separation in Deep Learningcited by 36
- 2021Augmenting Deep Classifiers with Polynomial Neural Networkscited by 21
- 2022Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advancescited by 21
- 2021A Systematic Survey of Deep Learning-based Single-Image Super-Resolutioncited by 19
- 2025Learning Optimal Multimodal Information Bottleneck Representationscited by 15
- 2022Automatic Change-Point Detection in Time Series via Deep Learningcited by 12
- 2021Design Smells in Deep Learning Programs: An Empirical Studycited by 10
- 2022ZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretizationcited by 10
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Surveycited by 10
- 2021Automatic Fault Detection for Deep Learning Programs Using Graph Transformationscited by 9
38 more
- 2022Resource Allocation of Federated Learning for the Metaverse with Mobile Augmented Realitycited by 9
- 2021Stride and Translation Invariance in CNNscited by 7
- 2021Deep Learning Approximation of Diffeomorphisms via Linear-Control Systemscited by 7
- 2021ResNEsts and DenseNEsts: Block-based DNN Models with Improved Representation Guaranteescited by 6
- 2022Structure-Enhanced DRL for Optimal Transmission Schedulingcited by 6
- 2021BA^2M: A Batch Aware Attention Module for Image Classificationcited by 5
- 2021Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence Learningcited by 5
- 2022Over-the-Air Design of GAN Training for mmWave MIMO Channel Estimationcited by 5
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learningcited by 5
- 2022Transfer Learning-based State of Health Estimation for Lithium-ion Battery with Cycle Synchronizationcited by 4
- 2022A Transferable Multi-stage Model with Cycling Discrepancy Learning for Lithium-ion Battery State of Health Estimationcited by 4
- 2021Distributed Reinforcement Learning for Flexible and Efficient UAV Swarm Controlcited by 3
- 2021Bio-Inspired Representation Learning for Visual Attention Predictioncited by 3
- 2021Analytically Tractable Inference in Deep Neural Networkscited by 3
- 2021Transformed ROIs for Capturing Visual Transformations in Videoscited by 3
- 2021Recurrent Inference Machines as inverse problem solvers for MR relaxometrycited by 3
- 2021Unifying Nonlocal Blocks for Neural Networkscited by 3
- 2021Adapting to Dynamic LEO-B5G Systems: Meta-Critic Learning Based Efficient Resource Schedulingcited by 3
- 2022A Survey on Automated Sarcasm Detection on Twittercited by 3
- 2023Interpolation for Robust Learning: Data Augmentation on Wasserstein Geodesicscited by 3
- 2023Deep Learning-based Estimation for Multitarget Radar Detectioncited by 3
- 2023From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networkscited by 3
- 2023Sky Imager-Based Forecast of Solar Irradiance Using Machine Learningcited by 3
- 2024FedSPU: Personalized Federated Learning for Resource-constrained Devices with Stochastic Parameter Updatecited by 3
- 2021Reconstructing Patchy Reionization with Deep Learningcited by 2
- 2021EmoDNN: Understanding emotions from short texts through a deep neural network ensemblecited by 2
- 2021Reconstructing Cosmic Polarization Rotation with ResUNet-CMBcited by 2
- 2021WHO-Hand Hygiene Gesture Classification Systemcited by 2
- 2021An Experimental Study of the Impact of Pre-training on the Pruning of a Convolutional Neural Networkcited by 2
- 2022On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithmscited by 2
- 2022TreeSketchNet: From Sketch To 3D Tree Parameters Generationcited by 2
- 2023Uncertainty-Aware Gradient Stabilization for Small Object Detectioncited by 2
- 2023Unknown Health States Recognition With Collective Decision Based Deep Learning Networks In Predictive Maintenance Applicationscited by 2
- 2023Straggler-resilient Federated Learning: Tackling Computation Heterogeneity with Layer-wise Partial Model Training in Mobile Edge Networkcited by 2
- 2023Evolution of Convolutional Neural Network (CNN): Compute vs Memory bandwidth for Edge AIcited by 2
- 2024Multi-modal Image and Radio Frequency Fusion for Optimizing Vehicle Positioningcited by 2
- 2024Multi-modal Data based Semi-Supervised Learning for Vehicle Positioningcited by 2
- 2024MEATRD: Multimodal Anomalous Tissue Region Detection Enhanced with Spatial Transcriptomicscited by 2
50 most cited of 81 All 81 (JSON)
- 2026Sequence Recognition in Bharatnatyam dance14 Sep 2026
- 2026Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning13 Jun 2026
- 2026Multi-Block Attention for Efficient Channel Estimation in IRS-Assisted mmWave MIMO14 May 2026
- 2026A Multi-Prototype-Guided Federated Knowledge Distillation Approach in AI-RAN Enabled Multi-Access Edge Computing System10 Mar 2026
- 2026Geometric Knowledge-Assisted Federated Dual Knowledge Distillation Approach Towards Remote Sensing Satellite Imagery8 Mar 2026
- 2026Noise-Robust Tiny Object Localization with Flows2 Jan 2026
- 2025Exploring Deep-to-Shallow Transformable Neural Networks for Intelligent Embedded Systems17 Dec 2025
- 2025Neural Beam Field for Spatial Beam RSRP Prediction9 Aug 2025
- 2025Learning Optimal Multimodal Information Bottleneck Representations26 May 2025
- 2025MicroNAS: An Automated Framework for Developing a Fall Detection System10 Apr 2025
- 2025Exploring energy consumption of AI frameworks on a 64-core RV64 Server CPU3 Apr 2025
- 2025Defending Against Gradient Inversion Attacks for Biomedical Images via Learnable Data Perturbation19 Mar 2025
38 more
- 2025Spiking Neural Network Feature Discrimination Boosts Modality Fusion5 Feb 2025
- 2025Achieving Hiding and Smart Anti-Jamming Communication: A Parallel DRL Approach against Moving Reactive Jammer4 Feb 2025
- 2025PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization5 Jan 2025
- 2024MEATRD: Multimodal Anomalous Tissue Region Detection Enhanced with Spatial Transcriptomics14 Dec 2024
- 2024Universal approximation property of ODENet and ResNet with a single activation function22 Oct 2024
- 2024Multi-modal Data based Semi-Supervised Learning for Vehicle Positioning15 Oct 2024
- 2024Multi-modal Image and Radio Frequency Fusion for Optimizing Vehicle Positioning15 Oct 2024
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey2 May 2024
- 2024FedSPU: Personalized Federated Learning for Resource-constrained Devices with Stochastic Parameter Update18 Mar 2024
- 2024Reconstruction-Based Anomaly Localization via Knowledge-Informed Self-Training22 Feb 2024
- 2024DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging4 Feb 2024
- 2023Spatial Deep Learning for Site-Specific Movement Optimization of Aerial Base Stations16 Dec 2023
- 2023Straggler-resilient Federated Learning: Tackling Computation Heterogeneity with Layer-wise Partial Model Training in Mobile Edge Network16 Nov 2023
- 2023Sky Imager-Based Forecast of Solar Irradiance Using Machine Learning26 Oct 2023
- 2023Unknown Health States Recognition With Collective Decision Based Deep Learning Networks In Predictive Maintenance Applications25 Oct 2023
- 2023A Benchmarking Protocol for SAR Colorization: From Regression to Deep Learning Approaches12 Oct 2023
- 2023Evolution of Convolutional Neural Network (CNN): Compute vs Memory bandwidth for Edge AI24 Sep 2023
- 2023Dual Adversarial Alignment for Realistic Support-Query Shift Few-shot Learning5 Sep 2023
- 2023AIoT-Based Drum Transcription Robot using Convolutional Neural Networks29 Aug 2023
- 2023From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networks5 Jul 2023
- 2023WavPool: A New Block for Deep Neural Networks14 Jun 2023
- 2023Deep Learning-based Estimation for Multitarget Radar Detection5 May 2023
- 2023Uncertainty-Aware Gradient Stabilization for Small Object Detection3 Mar 2023
- 2023Interpolation for Robust Learning: Data Augmentation on Wasserstein Geodesics4 Feb 2023
- 2022Energy Efficiency Maximization in IRS-Aided Cell-Free Massive MIMO System24 Dec 2022
- 2022Structure-Enhanced DRL for Optimal Transmission Scheduling24 Dec 2022
- 2022Resource Allocation of Federated Learning for the Metaverse with Mobile Augmented Reality16 Nov 2022
- 2022Automatic Change-Point Detection in Time Series via Deep Learning7 Nov 2022
- 2022A Law of Data Separation in Deep Learning31 Oct 2022
- 2022Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advances27 Sep 2022
- 2022Top-Tuning: a study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methods16 Sep 2022
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learning14 Sep 2022
- 2022FedAR+: A Federated Learning Approach to Appliance Recognition with Mislabeled Data in Residential Buildings3 Sep 2022
- 2022A Transferable Multi-stage Model with Cycling Discrepancy Learning for Lithium-ion Battery State of Health Estimation1 Sep 2022
- 2022Transfer Learning-based State of Health Estimation for Lithium-ion Battery with Cycle Synchronization23 Aug 2022
- 2022TreeSketchNet: From Sketch To 3D Tree Parameters Generation25 Jul 2022
- 2022Towards Personalized Healthcare in Cardiac Population: The Development of a Wearable ECG Monitoring System, an ECG Lossy Compression Schema, and a ResNet-Based AF Detector11 Jul 2022
- 2022On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms13 Jun 2022
50 newest of 81 All 81 (JSON)
- 2024DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averagingcited by 48
- 2021A Voxel Graph CNN for Object Classification with Event Camerascited by 38
- 2022A Law of Data Separation in Deep Learningcited by 36
- 2021Augmenting Deep Classifiers with Polynomial Neural Networkscited by 21
- 2022Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advancescited by 21
- 2021A Systematic Survey of Deep Learning-based Single-Image Super-Resolutioncited by 19
- 2025Learning Optimal Multimodal Information Bottleneck Representationscited by 15
- 2022Automatic Change-Point Detection in Time Series via Deep Learningcited by 12
- 2021Design Smells in Deep Learning Programs: An Empirical Studycited by 10
- 2022ZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretizationcited by 10
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Surveycited by 10
- 2021Automatic Fault Detection for Deep Learning Programs Using Graph Transformationscited by 9
12 most cited of 80 All 80 (JSON)
- 2026Sequence Recognition in Bharatnatyam dance14 Sep 2026
- 2026Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning13 Jun 2026
- 2026Multi-Block Attention for Efficient Channel Estimation in IRS-Assisted mmWave MIMO14 May 2026
- 2026A Multi-Prototype-Guided Federated Knowledge Distillation Approach in AI-RAN Enabled Multi-Access Edge Computing System10 Mar 2026
- 2026Geometric Knowledge-Assisted Federated Dual Knowledge Distillation Approach Towards Remote Sensing Satellite Imagery8 Mar 2026
- 2026Noise-Robust Tiny Object Localization with Flows2 Jan 2026
- 2025Exploring Deep-to-Shallow Transformable Neural Networks for Intelligent Embedded Systems17 Dec 2025
- 2025Neural Beam Field for Spatial Beam RSRP Prediction9 Aug 2025
- 2025Learning Optimal Multimodal Information Bottleneck Representations26 May 2025
- 2025MicroNAS: An Automated Framework for Developing a Fall Detection System10 Apr 2025
- 2025Exploring energy consumption of AI frameworks on a 64-core RV64 Server CPU3 Apr 2025
- 2025Defending Against Gradient Inversion Attacks for Biomedical Images via Learnable Data Perturbation19 Mar 2025
12 newest of 80 All 80 (JSON)