Deep Reinforcement Learning for Inverse Inorganic Materials Design
Not on the map. Why?
Abstract (arXiv)
A major obstacle to the realization of novel inorganic materials with desirable properties is the inability to perform efficient optimization across both materials properties and synthesis of those materials. In this work, we propose a reinforcement learning (RL) approach to inverse inorganic materials design, which can identify promising compounds with specified properties and synthesizability constraints. Our model learns chemical guidelines such as charge and electronegativity neutrality while maintaining chemical diversity and uniqueness. We demonstrate a multi-objective RL approach, which can generate novel compounds with targeted materials properties including formation energy and bulk/shear modulus alongside a lower sintering temperature synthesis objectives. Using this approach, the model can predict promising compounds of interest, while suggesting an optimized chemical design space for inorganic materials discovery.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 27 of its 119 references that are in the map. First posted on arXiv 21 Oct 2022.
Builds on
27 of 119 references.
References · 27
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 786
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
- 2017A Brief Survey of Deep Reinforcement Learningcited by 483
- 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 464
- 2017Deep Reinforcement Learning: An Overviewcited by 333
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 267
15 more
- 2018Optimization of Molecules via Deep Reinforcement Learningcited by 200
- 2017Deep Reinforcement Learning for De-Novo Drug Designcited by 161
- 2016Continuous Deep Q-Learning with Model-based Accelerationcited by 157
- 2015Inferring Algorithmic Patterns with Stack-Augmented Recurrent Netscited by 76
- 2018Molecular generative model based on conditional variational autoencoder for de novo molecular designcited by 73
- 2018Variance Reduction for Policy Gradient with Action-Dependent Factorized Baselinescited by 68
- 2019Predicting materials properties without crystal structure: Deep representation learning from stoichiometrycited by 62
- 2019Generative adversarial networks (GAN) based efficient sampling of chemical space for inverse design of inorganic materialscited by 46
- 2022Crystal structure prediction with machine learning-based element substitutioncited by 17
- 2022Fast Bayesian Optimization of Needle-in-a-Haystack Problems using Zooming Memory-Based Initialization (ZoMBI)cited by 14
- 2020Computational discovery of new 2D materials using deep learning generative modelscited by 10
- 2020Constrained Model-Free Reinforcement Learning for Process Optimizationcited by 9
- 2020CRYSPNet: Crystal Structure Predictions via Neural Networkcited by 7
- 2021Deep Reinforcement Learning Optimizes Graphene Nanopores for Efficient Desalinationcited by 6
- 2016Learning Operations on a Stack with Neural Turing Machinescited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 8; 2026: 8.
19 papers.
Sort:
By area:
- 2025Artificial Intelligence and Generative Models for Materials Discovery -- A Reviewcited by 8
- 2024Cross-Modal Learning for Chemistry Property Prediction: Large Language Models Meet Graph Machine Learningcited by 4
- 2025Generative Models for Crystalline Materialscited by 4
- 2026Towards Agentic Intelligence for Materials Sciencecited by 3
- 2023VAE for Modified 1-Hot Generative Materials Modeling, A Step Towards Inverse Material Designcited by 2
- 2025DiffSyn: A Generative Diffusion Approach to Materials Synthesis Planningcited by 2
- 2026MatMind: A Structure-Activity Knowledge-Driven Generative Foundation Model for Materials Sciencecited by 1
- 2024Adaptable Method for Crystal Design across Diverse Constraints and Objectives with Pretrained Property Predictorscited by 0
- 2025MACS: Multi-Agent Reinforcement Learning for Optimization of Crystal Structurescited by 0
- 2025AIMatDesign: Knowledge-Augmented Reinforcement Learning for Inverse Materials Design under Data Scarcitycited by 0
- 2025Unified machine-learning framework for property prediction and time-evolution simulation of strained alloy microstructurecited by 0
- 2025Extended Factorization Machine Annealing for Rapid Discovery of Transparent Conducting Materialscited by 0
7 more
- 2025Philosophy-informed Machine Learningcited by 0
- 2026Neural surrogates for crystal growth dynamics with variable supersaturation: explicit vs. implicit conditioningcited by 0
- 2026A Padding Method for Enhanced Encoding of Inorganic Structures with Varying Chemical Compositionscited by 0
- 2026Towards Automated Discovery: A Review of Generative Models, Multimodal Learning and Closed-Loop Workflows in Inverse Materials Designcited by 0
- 2026Let CSP Be Your ANCHOR: Adaptive Crystal Search over Frozen Structure Priorscited by 0
- 2026Riemannian Flow Models with Reinforcement Learning for Molecular Crystal Structure Predictioncited by 0
- 2026Reinforcement Learning on the Discrete Composition Channel of a Crystal Generator: Validated Gains and Reward Hackingcited by 0
- 2026Reinforcement Learning on the Discrete Composition Channel of a Crystal Generator: Validated Gains and Reward Hacking2 Oct 2026
- 2026Riemannian Flow Models with Reinforcement Learning for Molecular Crystal Structure Prediction30 Sep 2026
- 2026Let CSP Be Your ANCHOR: Adaptive Crystal Search over Frozen Structure Priors27 Sep 2026
- 2026MatMind: A Structure-Activity Knowledge-Driven Generative Foundation Model for Materials Science5 Jun 2026
- 2026Towards Automated Discovery: A Review of Generative Models, Multimodal Learning and Closed-Loop Workflows in Inverse Materials Design1 Jun 2026
- 2026A Padding Method for Enhanced Encoding of Inorganic Structures with Varying Chemical Compositions29 May 2026
- 2026Neural surrogates for crystal growth dynamics with variable supersaturation: explicit vs. implicit conditioning23 Apr 2026
- 2026Towards Agentic Intelligence for Materials Science29 Jan 2026
- 2025Generative Models for Crystalline Materials27 Nov 2025
- 2025DiffSyn: A Generative Diffusion Approach to Materials Synthesis Planning21 Sep 2025
- 2025Philosophy-informed Machine Learning18 Sep 2025
- 2025Artificial Intelligence and Generative Models for Materials Discovery -- A Review5 Aug 2025
7 more
- 2025Extended Factorization Machine Annealing for Rapid Discovery of Transparent Conducting Materials30 Jul 2025
- 2025Unified machine-learning framework for property prediction and time-evolution simulation of strained alloy microstructure29 Jul 2025
- 2025AIMatDesign: Knowledge-Augmented Reinforcement Learning for Inverse Materials Design under Data Scarcity17 Jun 2025
- 2025MACS: Multi-Agent Reinforcement Learning for Optimization of Crystal Structures4 Jun 2025
- 2024Adaptable Method for Crystal Design across Diverse Constraints and Objectives with Pretrained Property Predictors11 Oct 2024
- 2024Cross-Modal Learning for Chemistry Property Prediction: Large Language Models Meet Graph Machine Learning27 Aug 2024
- 2023VAE for Modified 1-Hot Generative Materials Modeling, A Step Towards Inverse Material Design25 Dec 2023
- 2026Towards Agentic Intelligence for Materials Sciencecited by 3
- 2026Towards Agentic Intelligence for Materials Science29 Jan 2026
- 2025Artificial Intelligence and Generative Models for Materials Discovery -- A Reviewcited by 8
- 2024Cross-Modal Learning for Chemistry Property Prediction: Large Language Models Meet Graph Machine Learningcited by 4
- 2025Generative Models for Crystalline Materialscited by 4
- 2023VAE for Modified 1-Hot Generative Materials Modeling, A Step Towards Inverse Material Designcited by 2
- 2025DiffSyn: A Generative Diffusion Approach to Materials Synthesis Planningcited by 2
- 2024Adaptable Method for Crystal Design across Diverse Constraints and Objectives with Pretrained Property Predictorscited by 0
- 2025MACS: Multi-Agent Reinforcement Learning for Optimization of Crystal Structurescited by 0
- 2025Unified machine-learning framework for property prediction and time-evolution simulation of strained alloy microstructurecited by 0
- 2025Extended Factorization Machine Annealing for Rapid Discovery of Transparent Conducting Materialscited by 0
- 2025Philosophy-informed Machine Learningcited by 0
- 2026Neural surrogates for crystal growth dynamics with variable supersaturation: explicit vs. implicit conditioningcited by 0
- 2026A Padding Method for Enhanced Encoding of Inorganic Structures with Varying Chemical Compositionscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Riemannian Flow Models with Reinforcement Learning for Molecular Crystal Structure Prediction30 Sep 2026
- 2026Let CSP Be Your ANCHOR: Adaptive Crystal Search over Frozen Structure Priors27 Sep 2026
- 2026Towards Automated Discovery: A Review of Generative Models, Multimodal Learning and Closed-Loop Workflows in Inverse Materials Design1 Jun 2026
- 2026A Padding Method for Enhanced Encoding of Inorganic Structures with Varying Chemical Compositions29 May 2026
- 2026Neural surrogates for crystal growth dynamics with variable supersaturation: explicit vs. implicit conditioning23 Apr 2026
- 2025Generative Models for Crystalline Materials27 Nov 2025
- 2025DiffSyn: A Generative Diffusion Approach to Materials Synthesis Planning21 Sep 2025
- 2025Philosophy-informed Machine Learning18 Sep 2025
- 2025Artificial Intelligence and Generative Models for Materials Discovery -- A Review5 Aug 2025
- 2025Extended Factorization Machine Annealing for Rapid Discovery of Transparent Conducting Materials30 Jul 2025
- 2025Unified machine-learning framework for property prediction and time-evolution simulation of strained alloy microstructure29 Jul 2025
- 2025MACS: Multi-Agent Reinforcement Learning for Optimization of Crystal Structures4 Jun 2025
12 newest of 15 All 15 (JSON)