Distributed Representations of Atoms and Materials for Machine Learning
Not on the map. Why?
Abstract (arXiv)
The use of machine learning is becoming increasingly common in computational materials science. To build effective models of the chemistry of materials, useful machine-based representations of atoms and their compounds are required. We derive distributed representations of compounds from their chemical formulas only, via pooling operations of distributed representations of atoms. These compound representations are evaluated on ten different tasks, such as the prediction of formation energy and band gap, and are found to be competitive with existing benchmarks that make use of structure, and even superior in cases where only composition is available. Finally, we introduce a new approach for learning distributed representations of atoms, named SkipAtom, which makes use of the growing information in materials structure databases.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 8 of its 56 references that are in the map. First posted on arXiv 30 Jul 2021.
Builds on
8 of 56 references.
References · 8
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2014Distributed Representations of Sentences and Documentscited by 677
- 2020OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Featurescited by 63
- 2019Predicting materials properties without crystal structure: Deep representation learning from stoichiometrycited by 60
- 2019Bayesian semi-supervised learning for uncertainty-calibrated prediction of molecular properties and active learningcited by 21
- 2016De-Conflated Semantic Representationscited by 12
- 2018Using J-K fold Cross Validation to Reduce Variance When Tuning NLP Modelscited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 2; 2024: 1; 2025: 2; 2026: 1.
8 papers.
- 2021Interpretable and Explainable Machine Learning for Materials Science and Chemistrycited by 26
- 2023Robust Concept Erasure via Kernelized Rate-Distortion Maximizationcited by 10
- 2022Formula graph self-attention network for representation-domain independent materials discoverycited by 7
- 2023Cached Operator Reordering: A Unified View for Fast GNN Trainingcited by 5
- 2024CrysAtom: Distributed Representation of Atoms for Crystal Property Predictioncited by 3
- 2025Data-driven approach to the design of complexing agents for trivalent transuranium elementscited by 0
- 2025Element2Vec: Build Chemical Element Representation from Text for Property Predictioncited by 0
- 2026Interpretation of Crystal Energy Landscapes with Kolmogorov-Arnold Networkscited by 0
- 2026Interpretation of Crystal Energy Landscapes with Kolmogorov-Arnold Networks6 Apr 2026
- 2025Element2Vec: Build Chemical Element Representation from Text for Property Prediction15 Oct 2025
- 2025Data-driven approach to the design of complexing agents for trivalent transuranium elements21 Sep 2025
- 2024CrysAtom: Distributed Representation of Atoms for Crystal Property Prediction7 Sep 2024
- 2023Robust Concept Erasure via Kernelized Rate-Distortion Maximization30 Nov 2023
- 2023Cached Operator Reordering: A Unified View for Fast GNN Training23 Aug 2023
- 2022Formula graph self-attention network for representation-domain independent materials discovery14 Jan 2022
- 2021Interpretable and Explainable Machine Learning for Materials Science and Chemistry1 Nov 2021