Generative Adversarial Super-Resolution at the Edge with Knowledge Distillation
Not on the map. Why?
Abstract (arXiv)
Single-Image Super-Resolution can support robotic tasks in environments where a reliable visual stream is required to monitor the mission, handle teleoperation or study relevant visual details. In this work, we propose an efficient Generative Adversarial Network model for real-time Super-Resolution, called EdgeSRGAN (code available at https://github.com/PIC4SeR/EdgeSRGAN). We adopt a tailored architecture of the original SRGAN and model quantization to boost the execution on CPU and Edge TPU devices, achieving up to 200 fps inference. We further optimize our model by distilling its knowledge to a smaller version of the network and obtain remarkable improvements compared to the standard training approach. Our experiments show that our fast and lightweight model preserves considerably satisfying image quality compared to heavier state-of-the-art models. Finally, we conduct experiments on image transmission with bandwidth degradation to highlight the advantages of the proposed system for mobile robotic applications.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 43 of its 75 references that are in the map. First posted on arXiv 7 Sep 2022.
Builds on
43 of 75 references.
References · 43
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Generative Adversarial Networkscited by 5,603
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
31 more
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2020Pre-Trained Image Processing Transformercited by 891
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
- 2019A Comprehensive Overhaul of Feature Distillationcited by 341
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2018Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neuronscited by 235
- 2016EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesiscited by 177
- 2020Residual Feature Distillation Network for Lightweight Image Super-Resolutioncited by 122
- 2021Video Super-Resolution Transformercited by 120
- 2021Real-World Single Image Super-Resolution: A Brief Reviewcited by 65
- 2020Simultaneous Enhancement and Super-Resolution of Underwater Imagery for Improved Visual Perceptioncited by 53
- 2020AutoGAN-Distiller: Searching to Compress Generative Adversarial Networkscited by 50
- 2020Motion Planning and Control for Mobile Robot Navigation Using Machine Learning: a Surveycited by 48
- 2022NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Resultscited by 40
- 2019Compressing GANs using Knowledge Distillationcited by 31
- 2020Bringing AI To Edge: From Deep Learning's Perspectivecited by 24
- 2020On Deep Learning Techniques to Boost Monocular Depth Estimation for Autonomous Navigationcited by 17
- 2020Robust Ultra-wideband Range Error Mitigation with Deep Learning at the Edgecited by 12
- 2022Position-Agnostic Autonomous Navigation in Vineyards with Deep Reinforcement Learningcited by 11
- 2019A VR System for Immersive Teleoperation and Live Exploration with a Mobile Robotcited by 10
- 2021Deep Semantic Segmentation at the Edge for Autonomous Navigation in Vineyard Rowscited by 9
- 2021edge-SR: Super-Resolution For The Massescited by 9
- 2020Real-time Surgical Environment Enhancement for Robot-Assisted Minimally Invasive Surgery Based on Super-Resolutioncited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 2.
9 papers.
- 2024A Survey on Generative AI and LLM for Video Generation, Understanding, and Streamingcited by 37
- 2023Visual Tuningcited by 34
- 2024Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Surveycited by 9
- 2024Applications of Knowledge Distillation in Remote Sensing: A Surveycited by 8
- 2023Exploration of TPUs for AI Applicationscited by 0
- 2024Topological Persistence Guided Knowledge Distillation for Wearable Sensor Datacited by 0
- 2024Sebica: Lightweight Spatial and Efficient Bidirectional Channel Attention Super Resolution Networkcited by 0
- 2025ESSR: An 8K@30FPS Super-Resolution Accelerator With Edge Selective Networkcited by 0
- 2025ATMS-KD: Adaptive Temperature and Mixed Sample Knowledge Distillation for a Lightweight Residual CNN in Agricultural Embedded Systemscited by 0
- 2025ATMS-KD: Adaptive Temperature and Mixed Sample Knowledge Distillation for a Lightweight Residual CNN in Agricultural Embedded Systems27 Aug 2025
- 2025ESSR: An 8K@30FPS Super-Resolution Accelerator With Edge Selective Network26 Mar 2025
- 2024Sebica: Lightweight Spatial and Efficient Bidirectional Channel Attention Super Resolution Network27 Oct 2024
- 2024Applications of Knowledge Distillation in Remote Sensing: A Survey18 Sep 2024
- 2024Topological Persistence Guided Knowledge Distillation for Wearable Sensor Data7 Jul 2024
- 2024Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Survey30 May 2024
- 2024A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming30 Jan 2024
- 2023Exploration of TPUs for AI Applications16 Sep 2023
- 2023Visual Tuning10 May 2023