mlsanityData to 7 Oct 2026

Zatom-1: Towards a Multimodal Foundation Model for 3D Molecules and Materials

arXiv 2602.22251 ↗First posted 24 Feb 2026cs.LG cond-mat.mtrl-sci cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

General-purpose 3D modeling in chemistry encompasses molecules and materials, requiring both generative and predictive capabilities. However, most existing AI approaches are optimized for a single domain (molecules or materials) and a single task (generation or prediction), which limits representation sharing and transfer. We introduce Zatom-1, a cross-domain, general-purpose model architecture that unifies generative and predictive learning of 3D molecules and materials. Zatom-1 is a deliberately simplified Transformer trained with a multimodal flow matching objective that jointly models discrete atom types and continuous 3D geometries. This approach supports scalable pretraining with predictable gains as model capacity increases, while enabling fast and stable sampling. We use cross-domain generative pretraining as a universal initialization for downstream multi-task prediction of properties, energies, and forces. Empirically, Zatom-1 outperforms or competes with specialized baselines on both multi-task generative and predictive benchmarks in data-controlled settings, while improving generative inference speed by more than an order of magnitude. Our experiments demonstrate positive predictive transfer between data domains from joint generative pretraining: modeling materials during generative pretraining improves molecular property prediction accuracy. Open-source code and model weights are freely available at https://github.com/Zatom-AI/zatom.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 82 of its 124 references that are in the map. First posted on arXiv 24 Feb 2026.

Builds on

82 of 124 references.

References · 82

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  10. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  11. 2020GLU Variants Improve Transformercited by 1,724
  12. 2016Group Equivariant Convolutional Networkscited by 1,154
38 more
  1. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  2. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  3. 2021E(n) Equivariant Graph Neural Networkscited by 951
  4. 2025Large Language Diffusion Modelscited by 872
  5. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  6. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
  7. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  8. 2019General E(2)-Equivariant Steerable CNNscited by 441
  9. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  10. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 385
  11. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
  12. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
  13. 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
  14. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
  15. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
  16. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  17. 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
  18. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
  19. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
  20. 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 193
  21. 2023Geometric Latent Diffusion Models for 3D Molecule Generationcited by 185
  22. 2023Small-scale proxies for large-scale Transformer training instabilitiescited by 182
  23. 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
  24. 2021Spherical Message Passing for 3D Graph Networkscited by 166
  25. 2023Crystal Structure Prediction by Joint Equivariant Diffusioncited by 142
  26. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
  27. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  28. 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 105
  29. 2025UMA: A Family of Universal Models for Atomscited by 99
  30. 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generationcited by 96
  31. 2018Roto-Translation Covariant Convolutional Networks for Medical Image Analysiscited by 91
  32. 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
  33. 2025All-atom Diffusion Transformers: Unified generative modelling of molecules and materialscited by 75
  34. 2024Space Group Constrained Crystal Generationcited by 71
  35. 2024Orb: A Fast, Scalable Neural Network Potentialcited by 63
  36. 2023Scalable Diffusion for Materials Generationcited by 52
  37. 2024FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributionscited by 52
  38. 2023Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generationcited by 50

50 most cited of 82 All 82 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MolSculpt: Sculpting 3D Molecular Geometries from Chemical Syntax
  2. 2025D3MES: Diffusion Transformer with multihead equivariant self-attention for 3D molecule generation
  3. 2026VecMol: Vector-Field Representations for 3D Molecule Generation
  4. 2026Towards Automated Discovery: A Review of Generative Models, Multimodal Learning and Closed-Loop Workflows in Inverse Materials Design
  5. 2025MODA: A Unified 3D Diffusion Framework for Multi-Task Target-Aware Molecular Generation
  6. 2025NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation
  7. 2026SinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems
  8. 2026Fixed-Dimensional Latent Flow for Generating Variable-Size 3D Molecules