mlsanityData to 14 Oct 2026

Hybrid CNN-ViT Framework for Motion-Blurred Scene Text Restoration

arXiv 2511.06087 ↗First posted 8 Nov 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Motion blur in scene text images severely impairs readability and hinders the reliability of computer vision tasks, including autonomous driving, document digitization, and visual information retrieval. Conventional deblurring approaches are often inadequate in handling spatially varying blur and typically fall short in modeling the long-range dependencies necessary for restoring textual clarity. To overcome these limitations, we introduce a hybrid deep learning framework that combines convolutional neural networks (CNNs) with vision transformers (ViTs), thereby leveraging both local feature extraction and global contextual reasoning. The architecture employs a CNN-based encoder-decoder to preserve structural details, while a transformer module enhances global awareness through self-attention. Training is conducted on a curated dataset derived from TextOCR, where sharp scene-text samples are paired with synthetically blurred versions generated using realistic motion-blur kernels of multiple sizes and orientations. Model optimization is guided by a composite loss that incorporates mean absolute error (MAE), squared error (MSE), perceptual similarity, and structural similarity (SSIM). Quantitative evaluations show that the proposed method attains 32.20 dB in PSNR and 0.934 in SSIM, while remaining lightweight with 2.83 million parameters and an average inference time of 61 ms. These results highlight the effectiveness and computational efficiency of the CNN-ViT hybrid design, establishing its practicality for real-world motion-blurred scene-text restoration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 8 Nov 2025.

Builds on

20 of 36 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  5. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  6. 2020Pre-Trained Image Processing Transformercited by 893
  7. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  8. 2021Multi-Stage Progressive Image Restorationcited by 816
  9. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  10. 2022Simple Baselines for Image Restorationcited by 708
  11. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
  12. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
8 more
  1. 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
  2. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
  3. 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
  4. 2016Robust Scene Text Recognition with Automatic Rectificationcited by 121
  5. 2019Neural Blind Deconvolution Using Deep Priorscited by 113
  6. 2018Deep Semantic Face Deblurringcited by 80
  7. 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
  8. 2018Learning Dual Convolutional Neural Networks for Low-Level Visioncited by 35

Built on by

Not cited yet.