mlsanityData to 7 Oct 2026

QuantumCanvas: A Multimodal Benchmark for Visual Learning of Atomic Interactions

arXiv 2512.01519 ↗First posted 1 Dec 2025cs.CV cond-mat.mtrl-sci quant-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite rapid advances in molecular and materials machine learning, most models still lack physical transferability: they fit correlations across whole molecules or crystals rather than learning the quantum interactions between atomic pairs. Yet bonding, charge redistribution, orbital hybridization, and electronic coupling all emerge from these two-body interactions that define local quantum fields in many-body systems. We introduce QuantumCanvas, a large-scale multimodal benchmark that treats two-body quantum systems as foundational units of matter. The dataset spans 2,850 element-element pairs, each annotated with 18 electronic, thermodynamic, and geometric properties and paired with ten-channel image representations derived from l- and m-resolved orbital densities, angular field transforms, co-occupancy maps, and charge-density projections. These physically grounded images encode spatial, angular, and electrostatic symmetries without explicit coordinates, providing an interpretable visual modality for quantum learning. Benchmarking eight architectures across 18 targets, we report mean absolute errors of 0.201 eV on energy gap using GATv2, 0.265 eV on HOMO and 0.274 eV on LUMO using EGNN. For energy-related quantities, DimeNet attains 2.27 eV total-energy MAE and 0.132 eV repulsive-energy MAE, while a multimodal fusion model achieves a 2.15 eV Mermin free-energy MAE. Pretraining on QuantumCanvas further improves convergence stability and generalization when fine-tuned on larger datasets such as QM9, MD17, and CrysMTM. By unifying orbital physics with vision-based representation learning, QuantumCanvas provides a principled and interpretable basis for learning transferable quantum interactions through coupled visual and numerical modalities. Dataset and model implementations are available at https://github.com/KurbanIntelligenceLab/QuantumCanvas.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 70 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

15 of 70 references.

References · 15

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  3. 2021E(n) Equivariant Graph Neural Networkscited by 951
  4. 2021How Attentive are Graph Attention Networks?cited by 818
  5. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  6. 2020Directional Message Passing for Molecular Graphscited by 556
  7. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
  8. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  9. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
  10. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
  11. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
  12. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
3 more
  1. 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
  2. 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 72
  3. 2025xChemAgents: Agentic AI for Explainable Quantum Chemistrycited by 7

Built on by

Not cited yet.