Efficient High-Resolution Deep Learning: A Survey
Not on the map. Why?
Abstract (arXiv)
Cameras in modern devices such as smartphones, satellites and medical equipment are capable of capturing very high resolution images and videos. Such high-resolution data often need to be processed by deep learning models for cancer detection, automated road navigation, weather prediction, surveillance, optimizing agricultural processes and many other applications. Using high-resolution images and videos as direct inputs for deep learning models creates many challenges due to their high number of parameters, computation cost, inference latency and GPU memory consumption. Simple approaches such as resizing the images to a lower resolution are common in the literature, however, they typically significantly decrease accuracy. Several works in the literature propose better alternatives in order to deal with the challenges of high-resolution data and improve accuracy and speed while complying with hardware limitations and time restrictions. This survey describes such efficient high-resolution deep learning methods, summarizes real-world applications of high-resolution deep learning, and provides comprehensive information about available high-resolution datasets.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 102 of its 199 references that are in the map. First posted on arXiv 26 Jul 2022.
Builds on
102 of 199 references.
References · 102
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Graph Attention Networkscited by 8,854
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
38 more
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2019Searching for MobileNetV3cited by 1,984
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2015Spatial Transformer Networkscited by 1,423
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
- 2020Efficient Transformers: A Surveycited by 784
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 479
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 387
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2016Adversarial Feature Learningcited by 350
- 2017Functional Map of the Worldcited by 338
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 328
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 276
- 2017ICNet for Real-Time Semantic Segmentation on High-Resolution Imagescited by 261
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2015YFCC100M: The New Data in Multimedia Researchcited by 234
- 2013OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networkscited by 224
- 2021Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encodingcited by 207
- 2020Learning in the Frequency Domaincited by 196
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 188
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2019Deep neural network models for computational histopathology: A surveycited by 165
- 2021PonderNet: Learning to Pondercited by 156
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
50 most cited of 102 All 102 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 3; 2026: 1.
9 papers.
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2025RetouchLLM: Training-free Code-based Image Retouching with Vision Language Modelscited by 4
- 2025HRScene: How Far Are VLMs from Effective High-Resolution Image Understanding?cited by 3
- 2024DDU-Net: A Domain Decomposition-Based CNN for High-Resolution Image Segmentation on Multiple GPUscited by 2
- 2024Continual Low-Rank Scaled Dot-product Attentioncited by 2
- 2023Accurate Gigapixel Crowd Counting by Iterative Zooming and Refinementcited by 0
- 2023Creating Realistic Anterior Segment Optical Coherence Tomography Images using Generative Adversarial Networkscited by 0
- 2025XeMap: Contextual Referring in Large-Scale Remote Sensing Environmentscited by 0
- 2026Can't Find Waldo: Evaluating VLMs' Sensitivity to Image Resolution and Detail Levelcited by 0
- 2026Can't Find Waldo: Evaluating VLMs' Sensitivity to Image Resolution and Detail Level20 Sep 2026
- 2025RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models9 Oct 2025
- 2025XeMap: Contextual Referring in Large-Scale Remote Sensing Environments30 Apr 2025
- 2025HRScene: How Far Are VLMs from Effective High-Resolution Image Understanding?25 Apr 2025
- 2024Continual Low-Rank Scaled Dot-product Attention4 Dec 2024
- 2024DDU-Net: A Domain Decomposition-Based CNN for High-Resolution Image Segmentation on Multiple GPUs31 Jul 2024
- 2023RepViT: Revisiting Mobile CNN From ViT Perspective18 Jul 2023
- 2023Creating Realistic Anterior Segment Optical Coherence Tomography Images using Generative Adversarial Networks24 Jun 2023
- 2023Accurate Gigapixel Crowd Counting by Iterative Zooming and Refinement16 May 2023