Medusa: Cross-Modal Transferable Adversarial Attacks on Multimodal Medical Retrieval-Augmented Generation
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
also in 1 more
Abstract (arXiv)
With the rapid advancement of retrieval-augmented vision-language models, multimodal medical retrieval-augmented generation (MMed-RAG) systems are increasingly adopted in clinical decision support. These systems enhance medical applications by performing cross-modal retrieval to integrate relevant visual and textual evidence for tasks, e.g., report generation and disease diagnosis. However, their complex architecture also introduces underexplored adversarial vulnerabilities, particularly via visual input perturbations. In this paper, we propose Medusa, a novel framework for crafting cross-modal transferable adversarial attacks on MMed-RAG systems under a black-box setting. Specifically, Medusa formulates the attack as a perturbation optimization problem, leveraging a multi-positive InfoNCE loss (MPIL) to align adversarial visual embeddings with medically plausible but malicious textual targets, thereby hijacking the retrieval process. To enhance transferability, we adopt a surrogate model ensemble and design a dual-loop optimization strategy augmented with invariant risk minimization (IRM). Extensive experiments on two real-world medical tasks, including medical report generation and disease diagnosis, demonstrate that Medusa achieves over 90% average attack success rate across various generation models and retrievers under appropriate parameter configuration, while remaining robust against four mainstream defenses, outperforming state-of-the-art baselines. Our results reveal critical vulnerabilities in the MMed-RAG systems and highlight the necessity of robustness benchmarking in safety-critical medical applications. The code and data are available at https://anonymous.4open.science/r/MMed-RAG-Attack-F05A.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 68 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
29 of 68 references.
Closest ancestors · 1
Same direction, newest first
Other references · 28
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 536
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2017Mitigating Adversarial Effects Through Randomizationcited by 383
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
- 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
- 2022Towards Adversarial Attack on Vision-Language Pre-training Modelscited by 144
16 more
- 2017On the Robustness of Semantic Segmentation Models to Adversarial Attackscited by 126
- 2023Set-level Guidance Attack: Boosting Adversarial Transferability of Vision-Language Pre-training Modelscited by 108
- 2018ComDefend: An Efficient Image Compression Model to Defend Adversarial Examplescited by 105
- 2021Stochastic Variance Reduced Ensemble Adversarial Attack for Boosting the Adversarial Transferabilitycited by 84
- 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
- 2021Joint Learning of Localized Representations from Medical Images and Reportscited by 81
- 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
- 2024Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Promptscited by 42
- 2023Transferable Decoding with Visual Entities for Zero-Shot Image Captioningcited by 34
- 2024Human-Imperceptible Retrieval Poisoning Attacks in LLM-Powered Applicationscited by 33
- 2025PR-Attack: Coordinated Prompt-RAG Attacks on Retrieval-Augmented Generation in Large Language Models via Bilevel Optimizationcited by 32
- 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generationcited by 28
- 2025MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attackscited by 24
- 2023Unified Adversarial Patch for Visible-Infrared Cross-modal Attacks in the Physical Worldcited by 21
- 2024FoRAG: Factuality-optimized Retrieval Augmented Generation for Web-enhanced Long-form Question Answeringcited by 18
- 2024RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoningcited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025How to make Medical AI Systems safer? Simulating Vulnerabilities, and Threats in Multimodal Medical RAG System
- 2026Knowledge Poisoning Attacks on Medical Multi-Modal Retrieval-Augmented Generation
- 2026When Background Matters: Breaking Medical Vision Language Models by Transferable Attack
- 2025HV-Attack: Hierarchical Visual Attack for Multimodal Retrieval Augmented Generation
- 2025Medical Multimodal Model Stealing Attacks via Adversarial Domain Alignment
- 2026DSPrompt: Dynamic Soft Prompt Defense Against M-RAG Corruption
- 2025Evaluating the Robustness of Retrieval-Augmented Generation to Adversarial Evidence in the Health Domain
- 2024Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models