DocEnTr: An End-to-End Document Image Enhancement Transformer
Not on the map. Why?
Abstract (arXiv)
Document images can be affected by many degradation scenarios, which cause recognition and processing difficulties. In this age of digitization, it is important to denoise them for proper usage. To address this challenge, we present a new encoder-decoder architecture based on vision transformers to enhance both machine-printed and handwritten document images, in an end-to-end fashion. The encoder operates directly on the pixel patches with their positional information without the use of any convolutional layers, while the decoder reconstructs a clean image from the encoded patches. Conducted experiments show a superiority of the proposed model compared to the state-of the-art methods on several DIBCO benchmarks. Code and models will be publicly available at: urlhttps://github.com/dali92002/DocEnTR.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 20 of its 44 references that are in the map. First posted on arXiv 25 Jan 2022.
Builds on
20 of 44 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Layer Normalizationcited by 5,579
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
- 2015LLNet: A Deep Autoencoder Approach to Natural Low-light Image Enhancementcited by 224
- 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
- 2021LaTr: Layout-Aware Transformer for Scene-Text VQAcited by 72
8 more
- 2020DE-GAN: A Conditional Generative Adversarial Network for Document Enhancementcited by 44
- 2021DocTr: Document Image Transformer for Geometric Unwarping and Illumination Correctioncited by 38
- 2017Document Image Binarization with Fully Convolutional Neural Networkscited by 25
- 2017A selectional auto-encoder approach for document image binarizationcited by 22
- 2021Transformer-Based Approach for Joint Handwriting and Named Entity Recognition in Historical documentscited by 17
- 2018Improving Document Binarization via Adversarial Noise-Texture Augmentationcited by 9
- 2021Enhance to Read Better: A Multi-Task Adversarial Network for Handwritten Document Image Enhancementcited by 7
- 2019Patch redundancy in images: a statistical testing framework and some applicationscited by 1
Built on by
Citing papers per year: 2022: 6; 2023: 8; 2024: 5; 2025: 3; 2026: 6.
28 papers.
Sort:
By area:
- 2023DocDiff: Document Enhancement via Residual Diffusion Modelscited by 37
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2022Text-DIAE: A Self-Supervised Degradation Invariant Autoencoders for Text Recognition and Document Enhancementcited by 16
- 2024High-Fidelity Document Stain Removal via A Large-Scale Real-World Dataset and A Memory-Augmented Transformercited by 12
- 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancementcited by 9
- 2022Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networkscited by 5
- 2023DocBinFormer: A Two-Level Transformer Network for Effective Document Image Binarizationcited by 4
- 2023ST-KeyS: Self-Supervised Transformer for Keyword Spotting in Historical Handwritten Documentscited by 3
- 2023DocStormer: Revitalizing Multi-Degraded Colored Document Images to Pristine PDFcited by 3
- 2024Binarizing Documents by Leveraging both Space and Frequencycited by 3
- 2023A Layer-Wise Tokens-to-Token Transformer Network for Improved Historical Document Image Enhancementcited by 2
- 2024Unveiling Advanced Frequency Disentanglement Paradigm for Low-Light Image Enhancementcited by 2
16 more
- 2025TextDoctor: Unified Document Image Inpainting via Patch Pyramid Diffusion Modelscited by 2
- 2025MFE-GAN: Efficient GAN-based Framework for Document Image Enhancement and Binarization with Multi-scale Feature Extractioncited by 2
- 2022Digitizing Historical Balance Sheet Data: A Practitioner's Guidecited by 1
- 2022Mutual Guidance and Residual Integration for Image Enhancementcited by 1
- 2023arXiVeri: Automatic table verification with GPTcited by 1
- 2023Semantic Segmentation Using Super Resolution Technique as Pre-Processingcited by 1
- 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Modelscited by 1
- 2024LayeredDoc: Domain Adaptive Document Restoration with a Layer Separation Approachcited by 1
- 2026Unveiling Text in Challenging Stone Inscriptions: A Character-Context-Aware Patching Strategy for Binarizationcited by 1
- 2026DeepMine-Mamba: Mitigating Information Dilution in Mamba-Based State Space Models for Document Image Binarizationcited by 1
- 2022Variational Augmentation for Enhancing Historical Document Image Binarizationcited by 0
- 2025MatteViT: High-Frequency-Aware Document Shadow Removal with Shadow Matte Guidancecited by 0
- 2026DocRevive: A Unified Pipeline for Document Text Restorationcited by 0
- 2026DR-Mamba: Automatic Inference-Time Domain Adaptation for Document Image Binarization via Sample-Conditioned Detail-Background Suppressioncited by 0
- 2026SpiS-GAN: Spiral-Modulated Handwriting Synthesis with Star Operationcited by 0
- 2026ENet-GP: Unified Document Image Restorationcited by 0
- 2026ENet-GP: Unified Document Image Restoration27 Sep 2026
- 2026SpiS-GAN: Spiral-Modulated Handwriting Synthesis with Star Operation8 Jul 2026
- 2026DR-Mamba: Automatic Inference-Time Domain Adaptation for Document Image Binarization via Sample-Conditioned Detail-Background Suppression21 Jun 2026
- 2026DeepMine-Mamba: Mitigating Information Dilution in Mamba-Based State Space Models for Document Image Binarization7 Jun 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026Unveiling Text in Challenging Stone Inscriptions: A Character-Context-Aware Patching Strategy for Binarization7 Jan 2026
- 2025MFE-GAN: Efficient GAN-based Framework for Document Image Enhancement and Binarization with Multi-scale Feature Extraction16 Dec 2025
- 2025MatteViT: High-Frequency-Aware Document Shadow Removal with Shadow Matte Guidance9 Dec 2025
- 2025TextDoctor: Unified Document Image Inpainting via Patch Pyramid Diffusion Models6 Mar 2025
- 2024High-Fidelity Document Stain Removal via A Large-Scale Real-World Dataset and A Memory-Augmented Transformer30 Oct 2024
- 2024Unveiling Advanced Frequency Disentanglement Paradigm for Low-Light Image Enhancement3 Sep 2024
- 2024LayeredDoc: Domain Adaptive Document Restoration with a Layer Separation Approach12 Jun 2024
16 more
- 2024Binarizing Documents by Leveraging both Space and Frequency26 Apr 2024
- 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancement8 Apr 2024
- 2023A Layer-Wise Tokens-to-Token Transformer Network for Improved Historical Document Image Enhancement6 Dec 2023
- 2023DocBinFormer: A Two-Level Transformer Network for Effective Document Image Binarization6 Dec 2023
- 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Models16 Nov 2023
- 2023DocStormer: Revitalizing Multi-Degraded Colored Document Images to Pristine PDF27 Oct 2023
- 2023Semantic Segmentation Using Super Resolution Technique as Pre-Processing27 Jun 2023
- 2023arXiVeri: Automatic table verification with GPT13 Jun 2023
- 2023DocDiff: Document Enhancement via Residual Diffusion Models6 May 2023
- 2023ST-KeyS: Self-Supervised Transformer for Keyword Spotting in Historical Handwritten Documents6 Mar 2023
- 2022Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks29 Nov 2022
- 2022Mutual Guidance and Residual Integration for Image Enhancement25 Nov 2022
- 2022Variational Augmentation for Enhancing Historical Document Image Binarization12 Nov 2022
- 2022Digitizing Historical Balance Sheet Data: A Practitioner's Guide31 Mar 2022
- 2022Text-DIAE: A Self-Supervised Degradation Invariant Autoencoders for Text Recognition and Document Enhancement9 Mar 2022
- 2022OCR-IDL: OCR Annotations for Industry Document Library Dataset25 Feb 2022
- 2023DocDiff: Document Enhancement via Residual Diffusion Modelscited by 37
- 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancementcited by 9
- 2025TextDoctor: Unified Document Image Inpainting via Patch Pyramid Diffusion Modelscited by 2
- 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Modelscited by 1
- 2025TextDoctor: Unified Document Image Inpainting via Patch Pyramid Diffusion Models6 Mar 2025
- 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancement8 Apr 2024
- 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Models16 Nov 2023
- 2023DocDiff: Document Enhancement via Residual Diffusion Models6 May 2023
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2022Text-DIAE: A Self-Supervised Degradation Invariant Autoencoders for Text Recognition and Document Enhancementcited by 16
- 2024High-Fidelity Document Stain Removal via A Large-Scale Real-World Dataset and A Memory-Augmented Transformercited by 12
- 2022Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networkscited by 5
- 2023DocBinFormer: A Two-Level Transformer Network for Effective Document Image Binarizationcited by 4
- 2023ST-KeyS: Self-Supervised Transformer for Keyword Spotting in Historical Handwritten Documentscited by 3
- 2023DocStormer: Revitalizing Multi-Degraded Colored Document Images to Pristine PDFcited by 3
- 2024Binarizing Documents by Leveraging both Space and Frequencycited by 3
- 2023A Layer-Wise Tokens-to-Token Transformer Network for Improved Historical Document Image Enhancementcited by 2
- 2024Unveiling Advanced Frequency Disentanglement Paradigm for Low-Light Image Enhancementcited by 2
- 2025MFE-GAN: Efficient GAN-based Framework for Document Image Enhancement and Binarization with Multi-scale Feature Extractioncited by 2
- 2022Digitizing Historical Balance Sheet Data: A Practitioner's Guidecited by 1
12 most cited of 22 All 22 (JSON)
- 2026ENet-GP: Unified Document Image Restoration27 Sep 2026
- 2026SpiS-GAN: Spiral-Modulated Handwriting Synthesis with Star Operation8 Jul 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026Unveiling Text in Challenging Stone Inscriptions: A Character-Context-Aware Patching Strategy for Binarization7 Jan 2026
- 2025MFE-GAN: Efficient GAN-based Framework for Document Image Enhancement and Binarization with Multi-scale Feature Extraction16 Dec 2025
- 2025MatteViT: High-Frequency-Aware Document Shadow Removal with Shadow Matte Guidance9 Dec 2025
- 2024High-Fidelity Document Stain Removal via A Large-Scale Real-World Dataset and A Memory-Augmented Transformer30 Oct 2024
- 2024Unveiling Advanced Frequency Disentanglement Paradigm for Low-Light Image Enhancement3 Sep 2024
- 2024LayeredDoc: Domain Adaptive Document Restoration with a Layer Separation Approach12 Jun 2024
- 2024Binarizing Documents by Leveraging both Space and Frequency26 Apr 2024
- 2023A Layer-Wise Tokens-to-Token Transformer Network for Improved Historical Document Image Enhancement6 Dec 2023
- 2023DocBinFormer: A Two-Level Transformer Network for Effective Document Image Binarization6 Dec 2023
12 newest of 22 All 22 (JSON)