mlsanityData to 14 Oct 2026

Does Dimensionality Reduction via Random Projections Preserve Landscape Features?

arXiv 2604.13230 ↗First posted 14 Apr 2026cs.LG cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Exploratory Landscape Analysis (ELA) provides numerical features for characterizing black-box optimization problems. In high-dimensional settings, however, ELA suffers from sparsity effects, high estimator variance, and the prohibitive cost of computing several feature classes. Dimensionality reduction has therefore been proposed as a way to make ELA applicable in such settings, but it remains unclear whether features computed in reduced spaces still reflect intrinsic properties of the original landscape. In this work, we investigate the robustness of ELA features under dimensionality reduction via Random Gaussian Embeddings (RGEs). Starting from the same sampled points and objective values, we compute ELA features in projected spaces and compare them to those obtained in the original search space across multiple sample budgets and embedding dimensions. Our results show that linear random projections often alter the geometric and topological structure relevant to ELA, yielding feature values that are no longer representative of the original problem. While a small subset of features remains comparatively stable, most are highly sensitive to the embedding. Moreover, robustness under projection does not necessarily imply informativeness, as apparently robust features may still reflect projection-induced artifacts rather than intrinsic landscape characteristics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

12 of 27 references.

References · 12

  1. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  2. 2013Bayesian Optimization in a Billion Dimensions via Random Embeddingscited by 182
  3. 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 138
  4. 2018Automated Algorithm Selection: Survey and Perspectivescited by 114
  5. 2017Automated Algorithm Selection on Continuous Black-Box Problems By Combining Exploratory Landscape Analysis and Machine Learningcited by 33
  6. 2020Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategycited by 27
  7. 2021IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristicscited by 24
  8. 2022Per-run Algorithm Selection with Warm-starting using Trajectory-based Featurescited by 20
  9. 2020Landscape-Aware Fixed-Budget Performance Regression and Algorithm Selection for Modular CMA-ES Variantscited by 15
  10. 2021Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functionscited by 14
  11. 2022High Dimensional Bayesian Optimization with Kernel Principal Component Analysiscited by 7
  12. 2021Towards Exploratory Landscape Analysis for Large-scale Optimization: A Dimensionality Reduction Frameworkcited by 1

Built on by

Not cited yet.