Autoregressive latent diffusion for 3D molecule generation
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Three-dimensional (3D) molecule generation has been dominated by diffusion models, which achieve strong generation quality but typically require molecular size to be specified (or predicted) separately before generation. This can be limiting for fragment-based molecule generation, central to drug discovery, where the size of the generated structure is itself part of the design problem. Autoregressive models determine size during generation and naturally support partial-structure conditioning, but balancing unconditional and fragment-conditioned generation remains challenging. We introduce KRONOS, a latent autoregressive diffusion framework that generates molecules in the latent space of a Unified AutoEncoder (UAE), jointly modeling molecular graph topology and geometry, while retaining the flexibility of autoregressive generation. We further introduce a mixed training strategy inspired by the Fill-in-the-Middle (FIM) paradigm, enabling a single left-to-right autoregressive model to support both unconditional and fragment-conditioned generation. Experiments on QM9 and GEOM-Drugs demonstrate strong unconditional generation performance and competitive fragment-conditioned generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 33 of its 43 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
33 of 43 references.
Closest ancestors · 10
Same direction, newest first
- 2025NEAT: Neighborhood-Guided, Efficient, Autoregressive Set Transformer for 3D Molecular Generation5 Dec
- 2025Graph Diffusion Transformers are In-Context Molecular Designers9 Oct
- 2025Scalable Autoregressive 3D Molecule Generation20 May
- 2025Towards Unified and Lossless Latent Space for 3D Molecular Latent Diffusion Modeling19 Mar
- 2025All-atom Diffusion Transformers: Unified generative modelling of molecules and materials5 Mar
- 2025FragFM: Hierarchical Framework for Efficient Molecule Generation via Fragment-Level Discrete Flow Matching19 Feb
- 2023Geometric Latent Diffusion Models for 3D Molecule Generation2 May
- 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation17 Feb
- 2022Equivariant 3D-Conditional Diffusion Models for Molecular Linker Design11 Oct
- 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2023The Impact of Positional Encoding on Length Generalization in Transformerscited by 319
- 2022Efficient Training of Language Models to Fill in the Middlecited by 248
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
11 more
- 2021Autoregressive Diffusion Modelscited by 208
- 2019Symmetry-adapted generation of 3d point sets for the targeted discovery of moleculescited by 171
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2022Transformer Language Models without Positional Encodings Still Learn Positional Informationcited by 148
- 2016Neural Autoregressive Distribution Estimationcited by 94
- 2022Relational Attention: Generalizing Transformers for Graph-Structured Taskscited by 41
- 2022Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrastcited by 37
- 2025Guiding Generative Models to Uncover Diverse and Novel Crystals via Reinforcement Learningcited by 19
- 2023Symphony: Symmetry-Equivariant Point-Centered Spherical Harmonics for 3D Molecule Generationcited by 17
- 2025InertialAR: Autoregressive 3D Molecule Generation with Inertial Framescited by 3
- 2023ProtFIM: Fill-in-Middle Protein Sequence Design via Protein Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022MDM: Molecular Diffusion Model for 3D Molecule Generation
- 2025NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation
- 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimization
- 2024LMDM:Latent Molecular Diffusion Model For 3D Molecule Generation
- 2025Equivariant Neural Diffusion for Molecule Generation
- 2026Equivariant Asynchronous Diffusion: An Adaptive Denoising Schedule for Accelerated Molecular Conformation Generation
- 2025Exploring Molecule Generation Using Latent Space Graph Diffusion
- 2022Diffusion-based Molecule Generation with Informative Prior Bridges