SafeMol: Dual-Modality Safety Alignment for Molecular Multimodal Models
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Molecular multimodal models support diverse understanding and generation tasks but may introduce safety vulnerabilities when handling hazardous molecules. In this work, We reveal substantial jailbreak vulnerabilities under both text-only and graph-conditioned settings. Our analysis further shows that safety robustness must hold across input modalities while balancing safety, over-refusal, and utility. To address these challenges, we construct SafeMolBench, a molecular multimodal safety-alignment benchmark with 3702 samples covering 618 unique hazardous molecules and safe molecular tasks, organized into hazardous-harmful, hazardous-allowed, and utility-replay subsets to support unified training and evaluation of safety, over-refusal, and utility. Based on SafeMolBench, we propose SafeMol, a parameter-efficient safety alignment framework that jointly optimizes lightweight modules across text-only and graph-conditioned inputs, uses MMD for distribution-level representation alignment to reduce modality-induced discrepancies, and explicitly models molecular hazardousness and harmful operational intent. Experiments on SafeMolBench show that SafeMol reduces attack success by several tens of percentage points while largely maintaining low over-refusal and preserving molecular-task utility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 32 of its 38 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
32 of 38 references.
Closest ancestors · 7
Same direction, newest first
- 2025Adversary-Aware DPO: Enhancing Safety Alignment in Vision Language Models via Adversarial Training17 Feb
- 2025VLM-Guard: Safeguarding Vision-Language Models via Fulfilling Safety Alignment Gap14 Feb
- 2024Unraveling and Mitigating Safety Alignment Degradation of Vision-Language Models11 Oct
- 2024ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Time9 Oct
- 2024SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Model17 Jun
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Models31 May
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts9 Nov
Other references · 25
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Visual Instruction Tuningcited by 7,792
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 255
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
- 2023How Does Information Bottleneck Help Deep Learning?cited by 92
- 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
- 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 65
13 more
- 2023Prot2Text: Multimodal Protein's Function Generation with GNNs and Transformerscited by 32
- 2024LLaMo: Large Language Model-based Molecular Graph Assistantcited by 22
- 2024ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text Pretrainingcited by 19
- 2024Cross-Modal Safety Mechanism Transfer in Large Vision-Language Modelscited by 18
- 2025Mol-LLaMA: Towards General Understanding of Molecules in Large Molecular Language Modelcited by 16
- 2025Learning Optimal Multimodal Information Bottleneck Representationscited by 15
- 2023Dynamic Multimodal Information Bottleneck for Multimodality Classificationcited by 14
- 2024ChemSafetyBench: Benchmarking LLM Safety on Chemistry Domaincited by 14
- 2024How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?cited by 8
- 2024SMILES-Prompting: A Novel Approach to LLM Jailbreak Attacks in Chemical Synthesiscited by 7
- 2025Omni-Mol: Multitask Molecular Model for Any-to-any Modalitiescited by 3
- 2026SciRisk-Bench: A Risk-Dimension-Aware Benchmark for AI4Science Safetycited by 1
- 2026MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Moleculescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Tasks
- 2026ShieldCLIP: Selective Safety Alignment for Harmful Content Mitigation in Multimodal Foundation Models
- 2025SoSBench: Benchmarking Safety Alignment on Six Scientific Domains
- 2024Locking Down the Finetuned LLMs Safety
- 2025Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?
- 2026HARC: Coupling Harmfulness and Refusal Directions for Robust Safety Alignment
- 2026ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization