mlsanityData to 14 Oct 2026

Adversarial Attacks on Deep OCR Systems

arXiv 2608.07636 ↗First posted 7 Aug 2026cs.CR cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep-OCR (DeepSeek-OCR) advances document recognition by treating the visual modality as an optical compression medium, enabling long-context OCR at low token cost. However, its increased complexity may introduce new security vulnerabilities. In this paper, we present, to the best of our knowledge, the first pure black-box adversarial attack against a generative OCR vision-language model, where only the decoded string can be queried and no gradients, logits, or model internals are available. We recast the attack as a zeroth-order optimization problem driven by a bounded scalar loss defined directly on the string output via sequence similarity, and estimate the gradient with a random-direction finite-difference scheme whose query cost is independent of the image dimension. An Adam update with ell_infinity projection yields imperceptible perturbations for both untargeted and targeted objectives. Pilot experiments on Deep-OCR validate the string-only attack and evaluation pipeline and expose severe qualitative decoder failures, including repetition, truncation, and prompt leakage. They also show that controlled targeted rewriting remains substantially harder than untargeted degradation; we avoid claiming targeted success until the pre-registered evaluation is complete.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

26 of 37 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  4. 2013Intriguing properties of neural networkscited by 5,155
  5. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  7. 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
  8. 2016Practical Black-Box Attacks against Machine Learningcited by 903
  9. 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
  10. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  11. 2017Countering Adversarial Images using Input Transformationscited by 520
  12. 2017Adversarial Patchcited by 517
14 more
  1. 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 501
  2. 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 462
  3. 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
  4. 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 284
  5. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
  6. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
  7. 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
  8. 2016A study of the effect of JPG compression on adversarial imagescited by 197
  9. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 180
  10. 2023Image Hijacks: Adversarial Images can Control Generative Models at Runtimecited by 172
  11. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 150
  12. 2018Fooling OCR Systems with Adversarial Text Imagescited by 12
  13. 2020Attacking Optical Character Recognition (OCR) Systems with Adversarial Watermarkscited by 7
  14. 2023DiffusionSTR: Diffusion Model for Scene Text Recognitioncited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Visual Merit or Linguistic Crutch? A Close Look at DeepSeek-OCR
  2. 2025Transferable Adversarial Attacks on Black-Box Vision-Language Models
  3. 2026ArmorOCR: Grounded Adversarial Visual Perception via Observation-Transferred Self-Distillation
  4. 2025DeepSeek-OCR: Contexts Optical Compression
  5. 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks
  6. 2023Invisible Threats: Backdoor Attack in OCR Systems
  7. 2026Breaking the weakest link to evade vision language models
  8. 2026Where Vision Becomes Text: Locating the OCR Routing Bottleneck in Vision-Language Models