# Network architecture search of X-ray based scientific applications

arXiv: https://arxiv.org/abs/2404.10689 · HTML: https://mlsanity.com/paper/2404.10689/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 4 of its 19 references that are in the map.
- First posted on arXiv 16 Apr 2024.

## Builds on (most cited first, 4 of 4)

- [Optuna: A Next-generation Hyperparameter Optimization Framework](https://mlsanity.com/paper/1907.10902/) (2019)
- [Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization](https://mlsanity.com/paper/1603.06560/) (2016)
- [Autotune: A Derivative-free Optimization Framework for Hyperparameter Tuning](https://mlsanity.com/paper/1804.07824/) (2018)
- [BraggNN: Fast X-ray Bragg Peak Analysis Using Deep Learning](https://mlsanity.com/paper/2008.08198/) (2020)

## Abstract (arXiv)

X-ray and electron diffraction-based microscopy use bragg peak detection and ptychography to perform 3-D imaging at an atomic resolution. Typically, these techniques are implemented using computationally complex tasks such as a Psuedo-Voigt function or solving a complex inverse problem. Recently, the use of deep neural networks has improved the existing state-of-the-art approaches. However, the design and development of the neural network models depends on time and labor intensive tuning of the model by application experts. To that end, we propose a hyperparameter (HPS) and neural architecture search (NAS) approach to automate the design and optimization of the neural network models for model size, energy consumption and throughput. We demonstrate the improved performance of the auto-tuned models when compared to the manually tuned BraggNN and PtychoNN benchmark. We study and demonstrate the importance of the exploring the search space of tunable hyperparameters in enhancing the performance of bragg peak detection and ptychographic reconstruction. Our NAS and HPS of (1) BraggNN achieves a 31.03% improvement in bragg peak detection accuracy with a 87.57% reduction in model size, and (2) PtychoNN achieves a 16.77% improvement in model accuracy and a 12.82% reduction in model size when compared to the baseline PtychoNN model. When inferred on the Orin-AGX platform, the optimized Braggnn and Ptychonn models demonstrate a 10.51% and 9.47% reduction in inference latency and a 44.18% and 15.34% reduction in energy consumption when compared to their respective baselines, when inferred in the Orin-AGX edge platform.