mlsanityData to 7 Oct 2026

Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes

arXiv 2310.00558 ↗First posted 1 Oct 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

When used in a real-world noisy environment, the capacity to generalize to multiple domains is essential for any autonomous scene text spotting system. However, existing state-of-the-art methods employ pretraining and fine-tuning strategies on natural scene datasets, which do not exploit the feature interaction across other complex domains. In this work, we explore and investigate the problem of domain-agnostic scene text spotting, i.e., training a model on multi-domain source data such that it can directly generalize to target domains rather than being specialized for a specific domain or scenario. In this regard, we present the community a text spotting validation benchmark called Under-Water Text (UWT) for noisy underwater scenes to establish an important case study. Moreover, we also design an efficient super-resolution based end-to-end transformer baseline called DA-TextSpotter which achieves comparable or superior performance over existing text spotting architectures for both regular and arbitrary-shaped scene text spotting benchmarks in terms of both accuracy and model efficiency. The dataset, code and pre-trained models will be released upon acceptance.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 1 Oct 2023.

Builds on

45 of 61 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2017Mask R-CNNcited by 7,259
  7. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  8. 2016Learning without Forgettingcited by 2,465
  9. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  10. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  11. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  12. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
33 more
  1. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
  2. 2013Domain Generalization via Invariant Feature Representationcited by 622
  3. 2017Learning multiple visual domains with residual adapterscited by 553
  4. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
  5. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
  6. 2018The relativistic discriminator: a key element missing from standard GANcited by 234
  7. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  8. 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
  9. 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
  10. 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
  11. 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
  12. 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
  13. 2017Incremental Learning Through Deep Adaptationcited by 108
  14. 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
  15. 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
  16. 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
  17. 2022Text Spotting Transformerscited by 70
  18. 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
  19. 2019Towards Unconstrained End-to-End Text Spottingcited by 57
  20. 2017Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networkscited by 56
  21. 2020Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spottingcited by 51
  22. 2020MANGO: A Mask Attention Guided One-Stage Scene Text Spottercited by 51
  23. 2018An end-to-end TextSpotter with Explicit Alignment and Attentioncited by 50
  24. 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
  25. 2018Effects of Degradations on Deep Neural Network Architecturescited by 47
  26. 2019Arbitrary Shape Scene Text Detection with Adaptive Text Region Representationcited by 45
  27. 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
  28. 2020RoadText-1K: Text Detection & Recognition Dataset for Driving Videoscited by 25
  29. 2023SyreaNet: A Physically Guided Underwater Image Enhancement Framework Integrating Synthetic and Real Imagescited by 23
  30. 2022Evaluating Out-of-Distribution Performance on Document Image Classifierscited by 16
  31. 2023Beyond Document Page Classification: Design, Datasets, and Challengescited by 10
  32. 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
  33. 2021I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognitioncited by 5

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.