Zatom-1: Towards a Multimodal Foundation Model for 3D Molecules and Materials
Not on the map. Why?
Abstract (arXiv)
General-purpose 3D modeling in chemistry encompasses molecules and materials, requiring both generative and predictive capabilities. However, most existing AI approaches are optimized for a single domain (molecules or materials) and a single task (generation or prediction), which limits representation sharing and transfer. We introduce Zatom-1, a cross-domain, general-purpose model architecture that unifies generative and predictive learning of 3D molecules and materials. Zatom-1 is a deliberately simplified Transformer trained with a multimodal flow matching objective that jointly models discrete atom types and continuous 3D geometries. This approach supports scalable pretraining with predictable gains as model capacity increases, while enabling fast and stable sampling. We use cross-domain generative pretraining as a universal initialization for downstream multi-task prediction of properties, energies, and forces. Empirically, Zatom-1 outperforms or competes with specialized baselines on both multi-task generative and predictive benchmarks in data-controlled settings, while improving generative inference speed by more than an order of magnitude. Our experiments demonstrate positive predictive transfer between data domains from joint generative pretraining: modeling materials during generative pretraining improves molecular property prediction accuracy. Open-source code and model weights are freely available at https://github.com/Zatom-AI/zatom.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 82 of its 124 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
82 of 124 references.
References · 82
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2020GLU Variants Improve Transformercited by 1,724
- 2016Group Equivariant Convolutional Networkscited by 1,154
38 more
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2025Large Language Diffusion Modelscited by 872
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2019General E(2)-Equivariant Steerable CNNscited by 441
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 385
- 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
- 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
- 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 193
- 2023Geometric Latent Diffusion Models for 3D Molecule Generationcited by 185
- 2023Small-scale proxies for large-scale Transformer training instabilitiescited by 182
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
- 2021Spherical Message Passing for 3D Graph Networkscited by 166
- 2023Crystal Structure Prediction by Joint Equivariant Diffusioncited by 142
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 105
- 2025UMA: A Family of Universal Models for Atomscited by 99
- 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generationcited by 96
- 2018Roto-Translation Covariant Convolutional Networks for Medical Image Analysiscited by 91
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
- 2025All-atom Diffusion Transformers: Unified generative modelling of molecules and materialscited by 75
- 2024Space Group Constrained Crystal Generationcited by 71
- 2024Orb: A Fast, Scalable Neural Network Potentialcited by 63
- 2023Scalable Diffusion for Materials Generationcited by 52
- 2024FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributionscited by 52
- 2023Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generationcited by 50
50 most cited of 82 All 82 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MolSculpt: Sculpting 3D Molecular Geometries from Chemical Syntax
- 2025D3MES: Diffusion Transformer with multihead equivariant self-attention for 3D molecule generation
- 2026VecMol: Vector-Field Representations for 3D Molecule Generation
- 2026Towards Automated Discovery: A Review of Generative Models, Multimodal Learning and Closed-Loop Workflows in Inverse Materials Design
- 2025MODA: A Unified 3D Diffusion Framework for Multi-Task Target-Aware Molecular Generation
- 2025NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation
- 2026SinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems
- 2026Fixed-Dimensional Latent Flow for Generating Variable-Size 3D Molecules