mlsanityData to 7 Oct 2026

EasyLens: A Training-Free Plug-and-Play Subtle-Lesion Representation Amplifier for Medical Vision-Language Models

arXiv 2606.06379 ↗First posted 4 Jun 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Medical vision-language models (VLMs) have shown increasing potential for clinical image interpretation, including lesion detection and report generation. However, their practical utility remains limited by insufficient sensitivity to subtle lesions, whose visual evidence is often sparse, low-contrast, and embedded within complex anatomical context. As local visual tokens are aggregated, these weak lesion cues can become underrepresented in global image representations, making them difficult for medical VLMs to recognize. Existing efforts to improve lesion sensitivity mainly rely on medical-domain vision-encoder pre-training, clinical-term-guided alignment, or trainable pathological representation enhancement. Although effective, these approaches usually require additional training or model-specific adaptation and may overfit to particular disease morphologies, limiting their applicability to frozen medical VLMs. To address these limitations, we propose EasyLens, a training-free plug-and-play subtle-lesion representation amplifier for medical VLMs. EasyLens first constructs EasyBank, a pathology-anatomy prototype space that provides lesion-related prototypes and anatomy-aware normal references for comparing suspicious patches against both pathological and normal anatomical patterns. To avoid blindly amplifying normal tissues, EasyTag selects lesion-relevant patches through counterfactual prototype reasoning. To counteract the dilution of subtle lesion cues in global image representations, EasyAmplifier strengthens the selected lesion-relevant patch representations through morphology-guided residual enhancement, thereby increasing their contribution to the global image embedding. Experiments on multiple medical image datasets and frozen medical VLM backbones show that EasyLens improves subtle-lesion detection and outperforms existing encoder-enhancement baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 33 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

28 of 33 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026Seeing Through Experts Eyes A Foundational Vision Language Model Trained on Radiologists Gaze and Reasoning15 Apr
  2. 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation1 Apr
  3. 2026Seeing Like Radiologists: Context- and Gaze-Guided Vision-Language Pretraining for Chest X-rays27 Mar
  4. 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar
  5. 2025Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imaging23 Oct
  6. 2025MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal output11 Oct
  7. 2025Improving Medical Large Vision-Language Models with Abnormal-Aware Feedback2 Jan
  8. 2024MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimization9 Dec
  9. 2024VividMed: Vision Language Model with Versatile Visual Grounding for Medicine16 Oct
  10. 2024Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generation11 Jun
  11. 2024Anatomical Structure-Guided Medical Vision-Language Pre-training14 Mar
  12. 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review4 Mar
1 more
  1. 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models14 Feb

Other references · 15

  1. 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
  2. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  3. 2025MedGemma Technical Reportcited by 398
  4. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  5. 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
  6. 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
  7. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 68
  8. 2025ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verificationcited by 30
  9. 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 27
  10. 2023Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generationcited by 25
  11. 2025AOR: Anatomical Ontology-Guided Reasoning for Medical Large Multimodal Model in Chest X-Ray Interpretationcited by 8
  12. 2024MLIP: Medical Language-Image Pre-training with Masked Local Representation Learningcited by 7
3 more
  1. 2025RadZero: Similarity-Based Cross-Attention for Explainable Vision-Language Alignment in Chest X-ray with Zero-Shot Multi-Task Capabilitycited by 4
  2. 2026TotalFM: An Organ-Separated 3D-CT Foundation Model Leveraging Large-Scale Routine Clinical Radiology Datacited by 4
  3. 2025Improving Medical Visual Representation Learning with Pathological-level Cross-Modal Alignment and Correlation Explorationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs
  2. 2025Anatomy-VLM: A Fine-grained Vision-Language Model for Medical Interpretation
  3. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Review
  4. 2026MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence
  5. 2025VLEER: Vision and Language Embeddings for Explainable Whole Slide Image Representation
  6. 2025Effortless Vision-Language Model Specialization in Histopathology without Annotation
  7. 2024Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework
  8. 2025Investigating Zero-Shot Diagnostic Pathology in Vision-Language Models with Efficient Prompt Design