mlsanityData to 14 Oct 2026

Task-driven real-world super-resolution of document scans

arXiv 2506.06953 ↗First posted 8 Jun 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Single-image super-resolution refers to the reconstruction of a high-resolution image from a single low-resolution observation. Although recent deep learning-based methods have demonstrated notable success on simulated datasets -- with low-resolution images obtained by degrading and downsampling high-resolution ones -- they frequently fail to generalize to real-world settings, such as document scans, which are affected by complex degradations and semantic variability. In this study, we introduce a task-driven, multi-task learning framework for training a super-resolution network specifically optimized for optical character recognition tasks. We propose to incorporate auxiliary loss functions derived from high-level vision tasks, including text detection using the connectionist text proposal network, text recognition via a convolutional recurrent neural network, keypoints localization using Key.Net, and hue consistency. To balance these diverse objectives, we employ dynamic weight averaging mechanism, which adaptively adjusts the relative importance of each loss term based on its convergence behavior. We validate our approach upon the SRResNet architecture, which is a well-established technique for single-image super-resolution. Experimental evaluations on both simulated and real-world scanned document datasets demonstrate that the proposed approach improves text detection, measured with intersection over union, while preserving overall image fidelity. These findings underscore the value of multi-objective optimization in super-resolution models for bridging the gap between simulated training regimes and practical deployment in real-world scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 8 Jun 2025.

Builds on

26 of 51 references.

References · 26

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  3. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  4. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  5. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
  6. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  7. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  8. 2018End-to-End Multi-Task Learning with Attentioncited by 534
  9. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  10. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  11. 2019Deep Learning for Image Super-resolution: A Surveycited by 369
  12. 2021Transformer for Single Image Super-Resolutioncited by 150
14 more
  1. 2019Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filterscited by 118
  2. 2021Real-World Single Image Super-Resolution: A Brief Reviewcited by 65
  3. 2018Task-Driven Super Resolution: Object Detection in Low-resolution Imagescited by 53
  4. 2021Extremely Lightweight Quantization Robust Real-Time Single-Image Super Resolution for Mobile Devicescited by 30
  5. 2019TextSR: Content-Aware Text Super-Resolution Guided by Recognitioncited by 26
  6. 2023Swift Parameter-free Attention Network for Efficient Super-Resolutioncited by 24
  7. 2015Boosting Optical Character Recognition: A Super-Resolution Approachcited by 19
  8. 2021Permutation invariance and uncertainty in multitemporal image super-resolutioncited by 18
  9. 2024Large Kernel Distillation Network for Efficient Single Image Super-Resolutioncited by 9
  10. 2019Facial Expression Restoration Based on Improved Graph Convolutional Networkscited by 6
  11. 2019Benefiting from Multitask Learning to Improve Single Image Super-Resolutioncited by 5
  12. 2022Semantically Accurate Super-Resolution Generative Adversarial Networkscited by 5
  13. 2023One-stage Low-resolution Text Recognition with High-resolution Knowledge Transfercited by 3
  14. 2024Task-driven single-image super-resolution reconstruction of document scanscited by 1

Built on by

Not cited yet.