Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End
Not on the map. Why?
Abstract (arXiv)
Text-centric Visual Question Answering (VQA) requires reading and reasoning over text embedded in images, a task made substantially harder when images suffer from real-world degradation such as motion blur, low resolution, or compression artifacts. While modular OCR-based pipelines and end-to-end vision-language models are both widely used for this task, their comparative robustness under degraded conditions remains underexplored. We present an empirical study comparing two modular pipelines with SA-DBNet, a custom detector architecture combining ResNet-18 with self-attention spatial modeling and deformable convolutions against an end-to-end vision-language baseline, evaluated on 4013 degraded images with 7000 question-answer pairs. Fine-tuned modular pipelines achieve up to 57.50% exact-match accuracy versus 38.00% for the end-to-end baseline, with domain-specific fine-tuning yielding a gain of up to 29.50 percentage points. Critically, we find that conventional OCR error metrics like Character Error Rate and Word Error Rate are unreliable predictors of downstream VQA performance, as semantic reasoning can compensate for recognition failures when contextual cues are present. These findings highlight the importance of task-aware evaluation for text-centric VQA systems under realistic visual conditions. Codes are available here
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 17 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
16 of 17 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2019Towards VQA Models That Can Readcited by 1,718
- 2017Deformable Convolutional Networkscited by 1,488
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2019Scene Text Visual Question Answeringcited by 331
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2019Character Region Awareness for Text Detectioncited by 278
- 2019Real-time Scene Text Detection with Differentiable Binarizationcited by 214
- 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2020Scene Text Image Super-Resolution in the Wildcited by 63
4 more
- 2026RePAIR: Interactive Machine Unlearning through Prompt-Aware Model Repaircited by 3
- 2026BID-LoRA: A Parameter-Efficient Framework for Continual Learning and Unlearningcited by 2
- 2026BackFlush: Knowledge-Free Backdoor Detection and Elimination with Watermark Preservation in Large Language Modelscited by 1
- 2026SeDT: Sentence-Transformer Decision-Transformer Conditioning for Multi-Turn Conversation Reliabilitycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Text-VQA Aug: Pipelined Harnessing of Large Multimodal Models for Automated Synthesis
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities
- 2025Visual question answering: from early developments to recent advances -- a survey
- 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithms
- 2025Exploring Advanced Techniques for Visual Question Answering: A Comprehensive Comparison
- 2024Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retail
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey
- 2025The Quest for Visual Understanding: A Journey Through the Evolution of Visual Question Answering