mlsanityData to 14 Oct 2026

Out-of-Length Scene Text Recognition: A Two-Axis Diagnosis and a Training-Free Fix

arXiv 2607.23194 ↗First posted 25 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Scene Text Recognition (STR) models are trained almost exclusively on word crops of at most 25 characters, yet real deployments (signage, product labels, dense captions) require reading much longer text. This paper diagnoses that failure and then closes it. The diagnosis separates out-of-length failure into two simultaneously extrapolating axes (the encoder's width axis and the decoder's time axis) and shows that encoder width, not decoder length, is the dominant failure mode. Representation-side fixes bring only partial relief: training-free rotary rescalings recover at most 2-4 points of character error rate (CER), and a weighted fine-tuning recipe recovers 6-8 points while improving standard-benchmark accuracy, yet word accuracy on the Long Text Benchmark (LTB) stays near zero, because the residual gap lies in the decoding mechanism rather than the representation. We then close that gap at inference time, on an unmodified word-level checkpoint: the long image is sliced into overlapping crops at the model's training width, each decoded independently and in-distribution, and the reads stitched by geometry-anchored edit-distance alignment. This procedure reaches 42.79-43.05% bucket-average word accuracy on LTB across two base checkpoints, matching the published state of the art (41.57%) and beating it by 11-12 points on the hardest bucket, at wall-clock parity with plain decoding; applied unchanged to the public PARSeq checkpoint it reaches 47.11%. Once chunking is applied fine-tuning no longer helps: the decoding-side fix alone matches purpose-built architectures. We release the diagnosis harness and implementation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 46 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

31 of 46 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  5. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  6. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  7. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  8. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  9. 2024Rotary Position Embedding for Vision Transformercited by 236
  10. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  11. 2019What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysiscited by 191
  12. 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 149
19 more
  1. 2014Reading Text in the Wild with Convolutional Neural Networkscited by 122
  2. 2024Round and Round We Go! What makes Rotary Positional Encodings useful?cited by 115
  3. 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
  4. 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
  5. 2018ESIR: End-to-end Scene Text Recognition via Iterative Image Rectificationcited by 79
  6. 2021Rethinking Text Line Recognition Modelscited by 45
  7. 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
  8. 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
  9. 2023Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encodingcited by 32
  10. 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 24
  11. 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
  12. 2023LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognitioncited by 13
  13. 2024Out of Length Text Recognition with Sub-String Matchingcited by 11
  14. 2024On the Generalization of Handwritten Text Recognition Modelscited by 10
  15. 2026Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Planecited by 7
  16. 2025Context-aware Rotary Position Embeddingcited by 4
  17. 2019Improving Long Handwritten Text Line Recognition with Convolutional Multi-way Associative Memorycited by 3
  18. 2025A 2D Semantic-Aware Position Encoding for Vision Transformerscited by 3
  19. 20262D Rotary Position Embedding for Scene Text Recognition with Transformerscited by 1

Built on by

Not cited yet.