Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?
Not on the map. Why?
Abstract (arXiv)
Toxicity remains a leading cause of early-stage drug development failure. Despite advances in molecular design and property prediction, the task of molecular toxicity repair, generating structurally valid molecular alternatives with reduced toxicity, has not yet been systematically defined or benchmarked. To fill this gap, we introduce ToxiMol, the first benchmark task for general-purpose Multimodal Large Language Models (MLLMs) focused on molecular toxicity repair. We construct a standardized dataset covering 11 primary tasks and 660 representative toxic molecules spanning diverse mechanisms and granularities. We design a prompt annotation pipeline with mechanism-aware and task-adaptive capabilities, informed by expert toxicological knowledge. In parallel, we propose an automated evaluation framework, ToxiEval, which integrates toxicity endpoint prediction, synthetic accessibility, drug-likeness, and structural similarity into a high-throughput evaluation chain for repair success. We systematically assess 43 mainstream general-purpose MLLMs and conduct multiple ablation studies to analyze key issues, including evaluation metrics, candidate diversity, and failure attribution. Experimental results show that although current MLLMs still face significant challenges on this task, they begin to demonstrate promising capabilities in toxicity understanding, semantic constraint adherence, and structure-aware editing.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 67 of its 181 references that are in the map. First posted on arXiv 12 Jun 2025.
Builds on
67 of 181 references.
References · 67
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
38 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2025Kimi-VL Technical Reportcited by 388
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 275
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
- 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
- 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
- 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 194
- 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 182
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 155
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
- 2021A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Modelscited by 101
- 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 100
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
- 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
- 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Textcited by 82
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
- 2020Molecular graph generation with Graph Neural Networkscited by 80
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2021Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Modelscited by 75
- 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Areacited by 71
- 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 66
- 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 59
- 2025TxGemma: Efficient and Agentic LLMs for Therapeuticscited by 41
- 2023Improving Automatic VQA Evaluation Using Large Language Modelscited by 37
- 2024MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMscited by 32
- 2024Tx-LLM: A Large Language Model for Therapeuticscited by 25
- 2025LIDDIA: Language-based Intelligent Drug Discovery Agentcited by 24
- 2025InternVL-X: Advancing and Accelerating InternVL Series with Efficient Visual Token Compressioncited by 21
- 2023Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question Promptscited by 20
- 2024textttMiniMol: A Parameter-Efficient Foundation Model for Molecular Learningcited by 20
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathway
- 2025CoTox: Chain-of-Thought-Based Molecular Toxicity Reasoning and Prediction
- 2026SafeMol: Dual-Modality Safety Alignment for Molecular Multimodal Models
- 2026MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules
- 2026Evaluating the Progression of Large Language Model Capabilities for Small-Molecule Drug Design
- 2025Reasoning-Enhanced Large Language Models for Molecular Property Prediction
- 2025ChatMol: A Versatile Molecule Designer Based on the Numerically Enhanced Large Language Model
- 2026Bolek: A Multimodal Language Model for Molecular Reasoning