mlsanityData to 14 Oct 2026

SLIM: Sparse Latent Steering for Interpretable and Property-Directed LLM-Based Molecular Editing

arXiv 2605.10831 ↗First posted 11 May 2026cs.LG cs.AI cs.CEcited by 1

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Large language models possess strong chemical reasoning capabilities, making them effective molecular editors. However, property-relevant information is implicitly entangled across their dense hidden states, providing no explicit handle for property control: a substantial fraction of edits fail to improve or even degrade target properties. To address these issues, we propose SLIM (Sparse Latent Interpretable Molecular editing), a plug-and-play framework that decomposes the editor's hidden states into sparse, property-aligned features via a Sparse Autoencoder with learnable importance gates. Steering in this sparse feature space precisely activates property-relevant dimensions, improving editing success rate without modifying model parameters. The same sparse basis further supports interpretable analysis of editing behavior. Experiments on the MolEditRL benchmark across four model architectures and eight molecular properties show consistent gains over baselines, with improvements of up to 42.4 points.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 14 of its 31 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

14 of 31 references.

References · 14

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  5. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  6. 2023Large Language Modelscited by 780
  7. 2024Improving Dictionary Learning with Gated Sparse Autoencoderscited by 179
  8. 2022Equivariant 3D-Conditional Diffusion Models for Molecular Linker Designcited by 122
  9. 2020Drug discovery with explainable artificial intelligencecited by 118
  10. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
  11. 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
  12. 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 59
2 more
  1. 2025GeLLMO: Generalizing Large Language Models for Multi-property Molecule Optimizationcited by 17
  2. 2025AtomDisc: An Atom-level Tokenizer that Boosts Molecular LLMs and Reveals Structure--Property Associationscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024AgentDrug: Utilizing Large Language Models in An Agentic Workflow for Zero-Shot Molecular Editing
  2. 2025MolEditRL: Structure-Preserving Molecular Editing via Discrete Diffusion and Reinforcement Learning
  3. 2025MolAct: An Agentic RL Framework for Molecular Editing and Property Optimization
  4. 2026SCAN: Sparse Circuit Anchor Interpretable Neuron for Lifelong Knowledge Editing
  5. 2025SynCraft: Guiding Large Language Models to Predict Edit Sequences for Molecular Synthesizability Optimization
  6. 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference
  7. 2026MoleCode unlocks structural intelligence in large language models
  8. 2024InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders