# Solving Expensive Optimization Problems in Dynamic Environments with Meta-learning

arXiv: https://arxiv.org/abs/2310.12538 · HTML: https://mlsanity.com/paper/2310.12538/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Oct 2023.

## Built on by (most cited first, 4 of 4)

- [TRACE: A Generalizable Drift Detector for Streaming Data-Driven Optimization](https://mlsanity.com/paper/2512.07082/) (2025)
- [Improving Question Embeddings with Cognitive Representation Optimization for Knowledge Tracing](https://mlsanity.com/paper/2504.04121/) (2025)
- [Dynamic Programming Techniques for Enhancing Cognitive Representation in Knowledge Tracing](https://mlsanity.com/paper/2506.02949/) (2025)
- [GeM-EA: A Generative and Meta-learning Enhanced Evolutionary Algorithm for Streaming Data-Driven Optimization](https://mlsanity.com/paper/2604.12336/) (2026)

## Abstract (arXiv)

Dynamic environments pose great challenges for expensive optimization problems, as the objective functions of these problems change over time and thus require remarkable computational resources to track the optimal solutions. Although data-driven evolutionary optimization and Bayesian optimization (BO) approaches have shown promise in solving expensive optimization problems in static environments, the attempts to develop such approaches in dynamic environments remain rarely unexplored. In this paper, we propose a simple yet effective meta-learning-based optimization framework for solving expensive dynamic optimization problems. This framework is flexible, allowing any off-the-shelf continuously differentiable surrogate model to be used in a plug-in manner, either in data-driven evolutionary optimization or BO approaches. In particular, the framework consists of two unique components: 1) the meta-learning component, in which a gradient-based meta-learning approach is adopted to learn experience (effective model parameters) across different dynamics along the optimization process. 2) the adaptation component, where the learned experience (model parameters) is used as the initial parameters for fast adaptation in the dynamic environment based on few shot samples. By doing so, the optimization process is able to quickly initiate the search in a new environment within a strictly restricted computational budget. Experiments demonstrate the effectiveness of the proposed algorithm framework compared to several state-of-the-art algorithms on common benchmark test problems under different dynamic characteristics.
