Autonomous Diffractometry Enabled by Visual Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Automation underpins progress across scientific and industrial disciplines. Yet, automating tasks requiring interpretation of abstract visual information remain challenging. For example, crystal alignment strongly relies on humans with the ability to comprehend diffraction patterns. Here we introduce an autonomous system that aligns single crystals without access to crystallography and diffraction theory. Using a model-free reinforcement learning framework, an agent learns to identify and navigate towards high-symmetry orientations directly from Laue diffraction patterns. Despite the absence of human supervision, the agent develops human-like strategies to achieve time-efficient alignment across different crystal symmetry classes. With this, we provide a computational framework for intelligent diffractometers. As such, our approach advances the development of automated experimental workflows in materials science.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 49 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
16 of 49 references.
References · 16
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2018DeepMind Control Suitecited by 956
- 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 585
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
- 2020Reinforcement Learning with Augmented Datacited by 468
- 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
- 2021Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learningcited by 372
- 2019Improving Sample Efficiency in Model-Free Reinforcement Learning from Imagescited by 274
4 more
- 2023The Dormant Neuron Phenomenon in Deep Reinforcement Learningcited by 174
- 2020Better Aggregation in Test-Time Augmentationcited by 122
- 2023DrM: Mastering Visual Reinforcement Learning through Dormant Ratio Minimizationcited by 47
- 2022Stabilizing Off-Policy Deep Reinforcement Learning from Pixelscited by 32
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Symmetry- and Property-Aware Crystal Generation with Reinforcement Learning for Inverse Materials Design
- 2026A self-learning scientific agent for X-ray diffraction
- 2026Autonomous Materials Exploration by Integrating Automated Phase Identification and AI-Assisted Human Reasoning
- 2026Reinforcement Learning on the Discrete Composition Channel of a Crystal Generator: Validated Gains and Reward Hacking
- 2026Towards Automated Discovery: A Review of Generative Models, Multimodal Learning and Closed-Loop Workflows in Inverse Materials Design
- 2026Optimizing Expert-Designed Crystal Graph Networks for Band-Gap Prediction with an Autonomous LLM Research Loop
- 2026AutoXRD: Autonomous LLM Agents and Comprehensive Evaluation for Powder Diffraction Analysis
- 2026Composable Crystals: Controllable Materials Discovery via Concept Learning