mlsanityData to 14 Oct 2026

Vision Token Masking Alone Cannot Prevent PHI Leakage in Medical Document OCR: A Systematic Evaluation

arXiv 2511.18272 ↗First posted 23 Nov 2025cs.CV cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Large vision-language models (VLMs) are increasingly deployed for optical character recognition (OCR) in healthcare settings, raising critical concerns about protected health information (PHI) exposure during document processing. This work presents the first systematic evaluation of inference-time vision token masking as a privacy-preserving mechanism for medical document OCR using DeepSeek-OCR. We introduce seven masking strategies (V3-V9) targeting different architectural layers (SAM encoder blocks, compression layers, dual vision encoders, projector fusion) and evaluate PHI reduction across HIPAA-defined categories using 100 synthetic medical billing statements (drawn from a corpus of 38,517 annotated documents) with perfect ground-truth annotations. All masking strategies converge to 42.9% PHI reduction, successfully suppressing long-form spatially-distributed identifiers (patient names, dates of birth, physical addresses at 100% effectiveness) while failing to prevent short structured identifiers (medical record numbers, social security numbers, email addresses, account numbers at 0% effectiveness). Ablation studies varying mask expansion radius (r=1,2,3) demonstrate that increased spatial coverage does not improve reduction beyond this ceiling, indicating that language model contextual inference - not insufficient visual masking - drives structured identifier leakage. A simulated hybrid architecture combining vision masking with NLP post-processing achieves 88.6% total PHI reduction (assuming 80% NLP accuracy on remaining identifiers). This negative result establishes boundaries for vision-only privacy interventions in VLMs, provides guidance distinguishing PHI types amenable to vision-level versus language-level redaction, and redirects future research toward decoder-level fine-tuning and hybrid defense-in-depth architectures for HIPAA-compliant medical document processing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

11 of 20 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Segment Anythingcited by 8,234
  4. 2016Deep Learning with Differential Privacycited by 2,728
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  6. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  7. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
  8. 2024Break the Visual Perception: Adversarial Attacks Targeting Encoded Visual Tokens of Large Vision-Language Modelscited by 27
  9. 2024Mixture of Nested Experts: Adaptive Processing of Visual Tokenscited by 25
  10. 2024Inference Optimal VLMs Need Fewer Visual Tokens and More Parameterscited by 25
  11. 2024Treat Visual Tokens as Text? But Your MLLM Only Needs Fewer Efforts to Seecited by 23

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision Language Model Helps Private Information De-Identification in Vision Data
  2. 2025Towards Selection of Large Multimodal Models as Engines for Burned-in Protected Health Information Detection in Medical Images
  3. 2026ClinOCR-Bench: A Comprehensive Clinical Scanned Document Dataset for Optical Character Recognition Model Evaluation
  4. 2025Compact Multimodal Language Models as Robust OCR Alternatives for Noisy Textual Clinical Reports ↗
  5. 2025Enhancing the Safety of Medical Vision-Language Models by Synthetic Demonstrations
  6. 2026LeakageBench: Document-Level Leakage Risk for Redacting Personally Identifiable Information in Document Images
  7. 2025How to Train Private Clinical Language Models: A Comparative Study of Privacy-Preserving Pipelines for ICD-9 Coding
  8. 2026MeDocVL: A Visual Language Model for Medical Document Understanding and Parsing