Learning Moderately Input-Sensitive Functions: A Case Study in QR Code Decoding
Not on the map. Why?
Abstract (arXiv)
The hardness of learning a function that attains a target task relates to its input-sensitivity. For example, image classification tasks are input-insensitive as minor corruptions should not affect the classification results, whereas arithmetic and symbolic computation, which have been recently attracting interest, are highly input-sensitive as each input variable connects to the computation results. This study presents the first learning-based Quick Response (QR) code decoding and investigates learning functions of medium sensitivity. Our experiments reveal that Transformers can successfully decode QR codes, even beyond the theoretical error-correction limit, by learning the structure of embedded texts. They generalize from English-rich training data to other languages and even random strings. Moreover, we observe that the Transformer-based QR decoder focuses on data bits while ignoring error-correction bits, suggesting a decoding mechanism distinct from standard QR code readers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 25 Jun 2025.
Builds on
21 of 32 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 629
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 274
- 2019Deep Learning for Symbolic Mathematicscited by 270
- 2023What Algorithms can Transformers Learn? A Study in Length Generalizationcited by 199
- 2022Overcoming a Theoretical Limitation of Self-Attentioncited by 113
- 2017Failures of Gradient-Based Deep Learningcited by 80
- 2024Why are Sensitive Functions Hard for Transformers?cited by 74
- 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 63
9 more
- 2021Linear algebra with transformerscited by 63
- 2023Positional Description Matters for Transformers Arithmeticcited by 56
- 2024Transformers Provably Solve Parity Efficiently with Chain of Thoughtcited by 50
- 2023Learning the greatest common divisor: explaining transformer predictionscited by 33
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformerscited by 29
- 2022SALSA: Attacking Lattice Cryptography with Transformerscited by 28
- 2023SALSA PICANTE: a machine learning attack on LWE with binary secretscited by 11
- 2023SALSA VERDE: a machine learning attack on Learning With Errors with sparse small secretscited by 8
- 2025Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithmscited by 7
Built on by
Not cited yet.