# Intelligent sampling for surrogate modeling, hyperparameter optimization, and data analysis

arXiv: https://arxiv.org/abs/2306.04066 · HTML: https://mlsanity.com/paper/2306.04066/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 3 of its 63 references that are in the map.
- First posted on arXiv 6 Jun 2023.

## Builds on (most cited first, 3 of 3)

- [A Tutorial on Bayesian Optimization](https://mlsanity.com/paper/1807.02811/) (2018)
- [Fast and Eager k-Medoids Clustering: O(k) Runtime Improvement of the PAM, CLARA, and CLARANS Algorithms](https://mlsanity.com/paper/2008.05171/) (2020)
- [Spoke-Darts for High-Dimensional Blue-Noise Sampling](https://mlsanity.com/paper/1408.1118/) (2014)

## Built on by (most cited first, 6 of 6)

- [SMRS: advocating a unified reporting standard for surrogate models in the artificial intelligence era](https://mlsanity.com/paper/2502.06753/) (2025)
- [Spatio-Temporal Surrogates for Interaction of a Jet with High Explosives: Part I -- Analysis with a Small Sample Size](https://mlsanity.com/paper/2307.01393/) (2023)
- [Spatio-Temporal Surrogates for Interaction of a Jet with High Explosives: Part II -- Clustering Extremely High-Dimensional Grid-Based Data](https://mlsanity.com/paper/2307.01400/) (2023)
- [Data-Based Design of Multi-Model Inferential Sensors](https://mlsanity.com/paper/2308.02872/) (2023)
- [Open-Source High-Speed Flight Surrogate Modeling Framework](https://mlsanity.com/paper/2411.03598/) (2024)
- [AutoTandemML: Active Learning Enhanced Tandem Neural Networks for Inverse Design Problems](https://mlsanity.com/paper/2502.15643/) (2025)

## Abstract (arXiv)

Sampling techniques are used in many fields, including design of experiments, image processing, and graphics. The techniques in each field are designed to meet the constraints specific to that field such as uniform coverage of the range of each dimension or random samples that are at least a certain distance apart from each other. When an application imposes new constraints, for example, by requiring samples in a non-rectangular domain or the addition of new samples to an existing set, a common solution is to modify the algorithm currently in use, often with less than satisfactory results. As an alternative, we propose the concept of intelligent sampling, where we devise algorithms specifically tailored to meet our sampling needs, either by creating new algorithms or by modifying suitable algorithms from other fields. Surprisingly, both qualitative and quantitative comparisons indicate that some relatively simple algorithms can be easily modified to meet the many sampling requirements of surrogate modeling, hyperparameter optimization, and data analysis; these algorithms outperform their more sophisticated counterparts currently in use, resulting in better use of time and computer resources.