Reward driven discovery of the optimal microstructure representations with invariant variational autoencoders
Not on the map. Why?
Abstract (arXiv)
Microscopy techniques generate vast amounts of complex image data that in principle can be used to discover simpler, interpretable, and parsimonious forms to reveal the underlying physical structures, such as elementary building blocks in molecular systems or order parameters and phases in crystalline materials. Variational Autoencoders (VAEs) provide a powerful means of constructing such low-dimensional representations, but their performance heavily depends on multiple non-myopic design choices, which are often optimized through trial-and-error and empirical analysis. To enable automated and unbiased optimization of VAE workflows, we investigated reward-based strategies for evaluating latent space representations. Using Piezoresponse Force Microscopy data as a model system, we examined multiple policies and reward functions that can serve as a foundation for automated optimization. Our analysis shows that approximating the latent space with Gaussian Mixture Models (GMM) and Bayesian Gaussian Mixture Models (BGMM) provides a strong basis for constructing reward functions capable of estimating model efficiency and guiding the search for optimal parsimonious representations.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
16 of 37 references.
References · 16
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2015Deep Kernel Learningcited by 440
- 2018Neural Architecture Optimizationcited by 164
- 2022Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overviewcited by 37
- 2019Explicitly disentangling image content from translation and rotation with spatial-VAEcited by 28
- 2021A survey on multi-objective hyperparameter optimization algorithms for Machine Learningcited by 24
- 2020Overview: Computer vision and machine learning for microstructural characterization and analysiscited by 22
- 2023Deep Kernel Methods Learn Better: From Cards to Process Optimizationcited by 7
- 2023Physics and Chemistry from Parsimonious Representations: Image Analysis via Invariant Variational Autoencoderscited by 7
- 2021Robust Feature Disentanglement in Imaging Data via Joint Invariant Variational Autoencoders: from Cards to Atomscited by 6
- 2024Unraveling the Impact of Initial Choices and In-Loop Interventions on Learning Dynamics in Autonomous Scanning Probe Microscopycited by 5
- 2025Learning Metal Microstructural Heterogeneity through Spatial Mapping of Diffraction Latent Space Featurescited by 5
4 more
- 2024Physics-based reward driven image analysis in microscopycited by 3
- 2024Unsupervised Reward-Driven Image Segmentation in Automated Scanning Transmission Electron Microscopy Experimentscited by 3
- 2025Rewards-based image analysis in microscopycited by 2
- 2025The Power of the Pareto Front: Balancing Uncertain Rewards for Adaptive Experimentation in scanning probe microscopycited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.