Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Deep Reinforcement Learning (DRL) is employed to develop autonomously optimized and custom-designed heat-treatment processes that are both, microstructure-sensitive and energy efficient. Different from conventional supervised machine learning, DRL does not rely on static neural network training from data alone, but a learning agent autonomously develops optimal solutions, based on reward and penalty elements, with reduced or no supervision. In our approach, a temperature-dependent Allen-Cahn model for phase transformation is used as the environment for the DRL agent, serving as the model world in which it gains experience and takes autonomous decisions. The agent of the DRL algorithm is controlling the temperature of the system, as a model furnace for heat-treatment of alloys. Microstructure goals are defined for the agent based on the desired microstructure of the phases. After training, the agent can generate temperature-time profiles for a variety of initial microstructure states to reach the final desired microstructure state. The agent's performance and the physical meaning of the heat-treatment profiles generated are investigated in detail. In particular, the agent is capable of controlling the temperature to reach the desired microstructure starting from a variety of initial conditions. This capability of the agent in handling a variety of conditions paves the way for using such an approach also for recycling-oriented heat treatment process design where the initial composition can vary from batch to batch, due to impurity intrusion, and also for the design of energy-efficient heat treatments. For testing this hypothesis, an agent without penalty on the total consumed energy is compared with one that considers energy costs. The energy cost penalty is imposed as an additional criterion on the agent for finding the optimal temperature-time profile.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 53 references that are in the map. First posted on arXiv 22 Sep 2022.
Builds on
21 of 53 references.
References · 21
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2015Prioritized Experience Replaycited by 1,070
- 2016HyperNetworkscited by 1,003
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 774
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2017A Distributional Perspective on Reinforcement Learningcited by 743
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
- 2017Deep Reinforcement Learning: An Overviewcited by 327
- 2017Noisy Networks for Explorationcited by 262
- 2018Parametrized Deep Q-Networks Learning: Reinforcement Learning with Discrete-Continuous Hybrid Action Spacecited by 54
9 more
- 2019Discrete and Continuous Action Representation for Practical RL in Video Gamescited by 34
- 2019Multi-Pass Q-Networks for Deep Reinforcement Learning with Parameterised Action Spacescited by 22
- 2020Overview: Computer vision and machine learning for microstructural characterization and analysiscited by 22
- 2021Lossless Multi-Scale Constitutive Elastic Relations with Artificial Intelligencecited by 17
- 2020Unsupervised machine learning via transfer learning and k-means clustering to classify materials image datacited by 10
- 2021Predicting Mechanically Driven Full-Field Quantities of Interest with Deep Learning-Based Metamodelscited by 10
- 2022Enhancing Mechanical Metamodels with a Generative Model-Based Augmented Training Datasetcited by 7
- 2022Learning Mechanically Driven Emergent Behavior with Message Passing Neural Networkscited by 6
- 2020Deep Reinforcement Learning Methods for Structure-Guided Processing Path Optimizationcited by 4
Built on by
Not cited yet.