mlsanityData to 14 Oct 2026

Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?

arXiv 2506.10912 ↗First posted 12 Jun 2025cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Toxicity remains a leading cause of early-stage drug development failure. Despite advances in molecular design and property prediction, the task of molecular toxicity repair, generating structurally valid molecular alternatives with reduced toxicity, has not yet been systematically defined or benchmarked. To fill this gap, we introduce ToxiMol, the first benchmark task for general-purpose Multimodal Large Language Models (MLLMs) focused on molecular toxicity repair. We construct a standardized dataset covering 11 primary tasks and 660 representative toxic molecules spanning diverse mechanisms and granularities. We design a prompt annotation pipeline with mechanism-aware and task-adaptive capabilities, informed by expert toxicological knowledge. In parallel, we propose an automated evaluation framework, ToxiEval, which integrates toxicity endpoint prediction, synthetic accessibility, drug-likeness, and structural similarity into a high-throughput evaluation chain for repair success. We systematically assess 43 mainstream general-purpose MLLMs and conduct multiple ablation studies to analyze key issues, including evaluation metrics, candidate diversity, and failure attribution. Experimental results show that although current MLLMs still face significant challenges on this task, they begin to demonstrate promising capabilities in toxicity understanding, semantic constraint adherence, and structure-aware editing.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 67 of its 181 references that are in the map. First posted on arXiv 12 Jun 2025.

Builds on

67 of 181 references.

References · 67

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  10. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  12. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
38 more
  1. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  4. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  5. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  6. 2024Yi: Open Foundation Models by 01.AIcited by 719
  7. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  8. 2025Kimi-VL Technical Reportcited by 388
  9. 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
  10. 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 275
  11. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
  12. 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
  13. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
  14. 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 194
  15. 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 182
  16. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
  17. 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 155
  18. 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
  19. 2021A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Modelscited by 101
  20. 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 100
  21. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
  22. 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
  23. 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Textcited by 82
  24. 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
  25. 2020Molecular graph generation with Graph Neural Networkscited by 80
  26. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
  27. 2021Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Modelscited by 75
  28. 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Areacited by 71
  29. 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 66
  30. 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 59
  31. 2025TxGemma: Efficient and Agentic LLMs for Therapeuticscited by 41
  32. 2023Improving Automatic VQA Evaluation Using Large Language Modelscited by 37
  33. 2024MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMscited by 32
  34. 2024Tx-LLM: A Large Language Model for Therapeuticscited by 25
  35. 2025LIDDIA: Language-based Intelligent Drug Discovery Agentcited by 24
  36. 2025InternVL-X: Advancing and Accelerating InternVL Series with Efficient Visual Token Compressioncited by 21
  37. 2023Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question Promptscited by 20
  38. 2024textttMiniMol: A Parameter-Efficient Foundation Model for Molecular Learningcited by 20

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathway
  2. 2025CoTox: Chain-of-Thought-Based Molecular Toxicity Reasoning and Prediction
  3. 2026SafeMol: Dual-Modality Safety Alignment for Molecular Multimodal Models
  4. 2026MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules
  5. 2026Evaluating the Progression of Large Language Model Capabilities for Small-Molecule Drug Design
  6. 2025Reasoning-Enhanced Large Language Models for Molecular Property Prediction
  7. 2025ChatMol: A Versatile Molecule Designer Based on the Numerically Enhanced Large Language Model
  8. 2026Bolek: A Multimodal Language Model for Molecular Reasoning