# Hyper-Local Deformable Transformers for Text Spotting on Historical Maps arXiv: https://arxiv.org/abs/2506.15010 ยท HTML: https://mlsanity.com/paper/2506.15010/ ## Key facts - Cited by 7 papers in the map (data through 14 Oct 2026). - Builds on 26 of its 56 references that are in the map. - First posted on arXiv 17 Jun 2025. ## Builds on (most cited first, 26 of 26) - [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015) - [End-to-End Object Detection with Transformers](https://mlsanity.com/paper/2005.12872/) (2020) - [Mask R-CNN](https://mlsanity.com/paper/1703.06870/) (2017) - [An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition](https://mlsanity.com/paper/1507.05717/) (2015) - [Synthetic Data for Text Localisation in Natural Images](https://mlsanity.com/paper/1604.06646/) (2016) - [TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models](https://mlsanity.com/paper/2109.10282/) (2021) - [ICDAR2019 Competition on Scanned Receipt OCR and Information Extraction](https://mlsanity.com/paper/2103.10213/) (2021) - [Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition](https://mlsanity.com/paper/1406.2227/) (2014) - [ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Network](https://mlsanity.com/paper/2002.10200/) (2020) - [Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spotting](https://mlsanity.com/paper/2007.09482/) (2020) - [FOTS: Fast Oriented Text Spotting with a Unified Network](https://mlsanity.com/paper/1801.01671/) (2018) - [ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spotting](https://mlsanity.com/paper/2105.03620/) (2021) - [DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spotting](https://mlsanity.com/paper/2211.10772/) (2022) - [SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition](https://mlsanity.com/paper/2203.10209/) (2022) - [All You Need Is Boundary: Toward Arbitrary-Shaped Text Spotting](https://mlsanity.com/paper/1911.09550/) (2019) - [Convolutional Character Networks](https://mlsanity.com/paper/1910.07954/) (2019) - [Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spotting](https://mlsanity.com/paper/2002.06820/) (2020) - [PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Network](https://mlsanity.com/paper/2104.05458/) (2021) - [Towards Weakly-Supervised Text Spotting using a Multi-Task Transformer](https://mlsanity.com/paper/2202.05508/) (2022) - [GLASS: Global to Local Attention for Scene-Text Spotting](https://mlsanity.com/paper/2208.03364/) (2022) - [ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformer](https://mlsanity.com/paper/2308.10147/) (2023) - [Towards Unified Scene Text Spotting based on Sequence Generation](https://mlsanity.com/paper/2304.03435/) (2023) - [Synthetic Map Generation to Provide Unlimited Training Data for Historical Map Text Detection](https://mlsanity.com/paper/2112.06104/) (2021) - [The mapKurator System: A Complete Pipeline for Extracting and Linking Text from Historical Maps](https://mlsanity.com/paper/2306.17059/) (2023) - [DEER: Detection-agnostic End-to-End Recognizer for Scene Text Spotting](https://mlsanity.com/paper/2203.05122/) (2022) - [An Automatic Approach for Generating Rich, Linked Geo-Metadata from Historical Map Images](https://mlsanity.com/paper/2112.01671/) (2021) ## Built on by (most cited first, 7 of 7) - [Detecting Legend Items on Historical Maps Using GPT-4o with In-Context Learning](https://mlsanity.com/paper/2510.08385/) (2025) - [MapSAM2: Adapting SAM2 for Automatic Segmentation of Historical Map Images and Time Series](https://mlsanity.com/paper/2510.27547/) (2025) - [TiCLS : Tightly Coupled Language Text Spotter](https://mlsanity.com/paper/2602.04030/) (2026) - [LIGHT: Multi-Modal Text Linking on Historical Maps](https://mlsanity.com/paper/2506.22589/) (2025) - [Deep learning enables urban change profiling through alignment of historical maps](https://mlsanity.com/paper/2602.02154/) (2026) - [Text region detection in historical astronomical diagrams](https://mlsanity.com/paper/2606.15886/) (2026) - [UniLipi: A Unified Multi-Script OCR for Historical Indic Manuscripts](https://mlsanity.com/paper/2608.28195/) (2026) ## Abstract (arXiv) Text on historical maps contains valuable information providing georeferenced historical, political, and cultural contexts. However, text extraction from historical maps is challenging due to the lack of (1) effective methods and (2) training data. Previous approaches use ad-hoc steps tailored to only specific map styles. Recent machine learning-based text spotters (e.g., for scene images) have the potential to solve these challenges because of their flexibility in supporting various types of text instances. However, these methods remain challenges in extracting precise image features for predicting every sub-component (boundary points and characters) in a text instance. This is critical because map text can be lengthy and highly rotated with complex backgrounds, posing difficulties in detecting relevant image features from a rough text region. This paper proposes PALETTE, an end-to-end text spotter for scanned historical maps of a wide variety. PALETTE introduces a novel hyper-local sampling module to explicitly learn localized image features around the target boundary points and characters of a text instance for detection and recognition. PALETTE also enables hyper-local positional embeddings to learn spatial interactions between boundary points and characters within and across text instances. In addition, this paper presents a novel approach to automatically generate synthetic map images, SynthMap+, for training text spotters for historical maps. The experiment shows that PALETTE with SynthMap+ outperforms SOTA text spotters on two new benchmark datasets of historical maps, particularly for long and angled text. We have deployed PALETTE with SynthMap+ to process over 60,000 maps in the David Rumsey Historical Map collection and generated over 100 million text labels to support map searching. The project is released at https://github.com/kartta-foundation/mapkurator-palette-doc.