Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes
Not on the map. Why?
Abstract (arXiv)
When used in a real-world noisy environment, the capacity to generalize to multiple domains is essential for any autonomous scene text spotting system. However, existing state-of-the-art methods employ pretraining and fine-tuning strategies on natural scene datasets, which do not exploit the feature interaction across other complex domains. In this work, we explore and investigate the problem of domain-agnostic scene text spotting, i.e., training a model on multi-domain source data such that it can directly generalize to target domains rather than being specialized for a specific domain or scenario. In this regard, we present the community a text spotting validation benchmark called Under-Water Text (UWT) for noisy underwater scenes to establish an important case study. Moreover, we also design an efficient super-resolution based end-to-end transformer baseline called DA-TextSpotter which achieves comparable or superior performance over existing text spotting architectures for both regular and arbitrary-shaped scene text spotting benchmarks in terms of both accuracy and model efficiency. The dataset, code and pre-trained models will be released upon acceptance.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 1 Oct 2023.
Builds on
45 of 61 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017Mask R-CNNcited by 7,259
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2016Learning without Forgettingcited by 2,465
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
33 more
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2017Learning multiple visual domains with residual adapterscited by 553
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
- 2018The relativistic discriminator: a key element missing from standard GANcited by 234
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
- 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
- 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
- 2017Incremental Learning Through Deep Adaptationcited by 108
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022Text Spotting Transformerscited by 70
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2019Towards Unconstrained End-to-End Text Spottingcited by 57
- 2017Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networkscited by 56
- 2020Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spottingcited by 51
- 2020MANGO: A Mask Attention Guided One-Stage Scene Text Spottercited by 51
- 2018An end-to-end TextSpotter with Explicit Alignment and Attentioncited by 50
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2018Effects of Degradations on Deep Neural Network Architecturescited by 47
- 2019Arbitrary Shape Scene Text Detection with Adaptive Text Region Representationcited by 45
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2020RoadText-1K: Text Detection & Recognition Dataset for Driving Videoscited by 25
- 2023SyreaNet: A Physically Guided Underwater Image Enhancement Framework Integrating Synthetic and Real Imagescited by 23
- 2022Evaluating Out-of-Distribution Performance on Document Image Classifierscited by 16
- 2023Beyond Document Page Classification: Design, Datasets, and Challengescited by 10
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
- 2021I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognitioncited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.