Text Detection & Recognition in the Wild for Robot Localization
Not on the map. Why?
Abstract (arXiv)
Signage is everywhere and a robot should be able to take advantage of signs to help it localize (including Visual Place Recognition (VPR)) and map. Robust text detection & recognition in the wild is challenging due to such factors as pose, irregular text, illumination, and occlusion. We propose an end-to-end scene text spotting model that simultaneously outputs the text string and bounding boxes. This model is more suitable for VPR. Our central contribution is introducing utilizing an end-to-end scene text spotting framework to adequately capture the irregular and occluded text regions in different challenging places. To evaluate our proposed architecture's performance for VPR, we conducted several experiments on the challenging Self-Collected Text Place (SCTP) benchmark dataset. The initial experimental results show that the proposed method outperforms the SOTA methods in terms of precision and recall when tested on this benchmark.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 42 of its 73 references that are in the map. First posted on arXiv 17 May 2022.
Builds on
42 of 73 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Mask R-CNNcited by 7,259
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2020Rethinking Attention with Performerscited by 1,584
- 2021Transformers in Vision: A Surveycited by 1,009
30 more
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2020Efficient Transformers: A Surveycited by 784
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2019Character Region Awareness for Text Detectioncited by 273
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2019What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysiscited by 191
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2017Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognitioncited by 161
- 2021Benchmarking Detection Transfer Learning with Vision Transformerscited by 130
- 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 121
- 2018TextBoxes++: A Single-Shot Oriented Scene Text Detectorcited by 119
- 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
- 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2017Detecting Curve Text in the Wild: New Dataset and New Solutioncited by 82
- 2021Where is your place, Visual Place Recognition?cited by 82
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2022Text Spotting Transformerscited by 70
- 2020Imputer: Sequence Modelling via Imputation and Dynamic Programmingcited by 65
- 2019On Recognizing Texts of Arbitrary Shapes with 2D Self-Attentioncited by 59
- 2018Night-to-Day Image Translation for Retrieval-based Localizationcited by 57
- 2019Towards Unconstrained End-to-End Text Spottingcited by 57
- 2017Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networkscited by 56
- 2020Character Region Attention For Text Spottingcited by 42
- 2022Towards Weakly-Supervised Text Spotting using a Multi-Task Transformercited by 41
- 2019Pyramid Mask Text Detectorcited by 9
- 2020Text Detection and Recognition in the Wild: A Reviewcited by 7
- 2022Arbitrary Shape Text Detection using Transformerscited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.