mlsanityData to 14 Oct 2026

Zatom-2: Multitask Pretraining on Atomistic Data for Generative Modeling across Domains

arXiv 2610.11454 ↗First posted 8 Oct 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Unified atomistic modeling has the potential to accelerate discovery in chemistry, materials science, and biology by bridging data-rich chemical domains and data-scarce biological contexts. However, existing generative approaches to atomistic modeling remain highly specialized to scientific disciplines (chemistry vs. biology) or do not leverage both high-volume organic (molecule) and inorganic (material) data for general-purpose pretraining. To this end, we introduce Zatom-2, an atomistic generative model pretrained on approximately five million structures from the OMol25 and OMat24 electronic structure datasets. Zatom-2 features a multiscale Transformer architecture coupled with conditional flow matching that supports force conditioning and foundational pretraining tasks such as generation, structure prediction, and prediction of molecular and material energies and forces. Empirically, Zatom-2 achieves better molecular distribution fidelity than Zatom-1 and achieves strong performance on existing molecule and material generation benchmarks. Zatom-2 demonstrates the ability to control sample generation across low- and high-force regimes, and enhances protein generation in a low-data setting through joint generative-predictive pretraining and transfer learning, increasing protein backbone designability in a length extrapolation setting from 67.8% without pretraining to 74.8% after finetuning on 2,000 protein domains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 69 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

17 of 69 references.

References · 17

  1. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  2. 2025UMA: A Family of Universal Models for Atomscited by 105
  3. 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generationcited by 98
  4. 2024Orb: A Fast, Scalable Neural Network Potentialcited by 66
  5. 2023Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Cloudscited by 54
  6. 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Modelscited by 52
  7. 2025LeMat-GenBench: A Unified Evaluation Framework for Crystal Generative Modelscited by 23
  8. 2025SimpleFold: Folding Proteins is Simpler than You Thinkcited by 16
  9. 2025Universally Converging Representations of Matter Across Scientific Foundation Modelscited by 14
  10. 2026Crystalite: A Lightweight Transformer for Efficient Crystal Modelingcited by 10
  11. 2025Learning Inter-Atomic Potentials without Explicit Equivariancecited by 5
  12. 2026Zatom-1: Towards a Multimodal Foundation Model for 3D Molecules and Materialscited by 5
5 more
  1. 2026Self-Conditioned Denoising for Atomistic Representation Learningcited by 4
  2. 2026Geometric Flow Matching for Molecular Conformation Generation via Manifold Decompositioncited by 3
  3. 2026CrystalREPA: Transferring Physical Priors from Universal MLIPs to Crystal Generative Modelscited by 2
  4. 2026Toward Better Geometric Representations for Molecule Generative Modelscited by 1
  5. 2026Emyx: Fast and efficient all-atom protein generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025All-atom Diffusion Transformers: Unified generative modelling of molecules and materials
  2. 2025ATOM: A Pretrained Neural Operator for Multitask Molecular Dynamics
  3. 2025LLM Meets Diffusion: A Hybrid Framework for Crystal Material Generation
  4. 2026Atomistic Language Models Understand and Generate Materials
  5. 2024Generative artificial intelligence for computational chemistry: a roadmap to predicting emergent phenomena
  6. 2026Generative structure search for efficient and diverse discovery of molecular and crystal structures
  7. 2025Introducing physics-informed generative models for targeting structural novelty in the exploration of chemical space
  8. 2025MarS-FM: Generative Modeling of Molecular Dynamics via Markov State Models