SLIM: Sparse Latent Steering for Interpretable and Property-Directed LLM-Based Molecular Editing
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Large language models possess strong chemical reasoning capabilities, making them effective molecular editors. However, property-relevant information is implicitly entangled across their dense hidden states, providing no explicit handle for property control: a substantial fraction of edits fail to improve or even degrade target properties. To address these issues, we propose SLIM (Sparse Latent Interpretable Molecular editing), a plug-and-play framework that decomposes the editor's hidden states into sparse, property-aligned features via a Sparse Autoencoder with learnable importance gates. Steering in this sparse feature space precisely activates property-relevant dimensions, improving editing success rate without modifying model parameters. The same sparse basis further supports interpretable analysis of editing behavior. Experiments on the MolEditRL benchmark across four model architectures and eight molecular properties show consistent gains over baselines, with improvements of up to 42.4 points.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 14 of its 31 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
14 of 31 references.
References · 14
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Large Language Modelscited by 780
- 2024Improving Dictionary Learning with Gated Sparse Autoencoderscited by 179
- 2022Equivariant 3D-Conditional Diffusion Models for Molecular Linker Designcited by 122
- 2020Drug discovery with explainable artificial intelligencecited by 118
- 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 59
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024AgentDrug: Utilizing Large Language Models in An Agentic Workflow for Zero-Shot Molecular Editing
- 2025MolEditRL: Structure-Preserving Molecular Editing via Discrete Diffusion and Reinforcement Learning
- 2025MolAct: An Agentic RL Framework for Molecular Editing and Property Optimization
- 2026SCAN: Sparse Circuit Anchor Interpretable Neuron for Lifelong Knowledge Editing
- 2025SynCraft: Guiding Large Language Models to Predict Edit Sequences for Molecular Synthesizability Optimization
- 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference
- 2026MoleCode unlocks structural intelligence in large language models
- 2024InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders