mlsanityData to 14 Oct 2026

Adaptation to Unknown Situations as the Holy Grail of Learning-Based Self-Adaptive Systems: Research Directions

arXiv 2103.06908 ↗First posted 11 Mar 2021cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-adaptive systems continuously adapt to changes in their execution environment. Capturing all possible changes to define suitable behaviour beforehand is unfeasible, or even impossible in the case of unknown changes, hence human intervention may be required. We argue that adapting to unknown situations is the ultimate challenge for self-adaptive systems. Learning-based approaches are used to learn the suitable behaviour to exhibit in the case of unknown situations, to minimize or fully remove human intervention. While such approaches can, to a certain extent, generalize existing adaptations to new situations, there is a number of breakthroughs that need to be achieved before systems can adapt to general unknown and unforeseen situations. We posit the research directions that need to be explored to achieve unanticipated adaptation from the perspective of learning-based self-adaptive systems. At minimum, systems need to define internal representations of previously unseen situations on-the-fly, extrapolate the relationship to the previously encountered situations to evolve existing adaptations, and reason about the feasibility of achieving their intrinsic goals in the new set of conditions. We close discussing whether, even when we can, we should indeed build systems that define their own behaviour and adapt their goals, without involving a human supervisor.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 9 references that are in the map. First posted on arXiv 11 Mar 2021.

Builds on

2 of 9 references.

References · 2

  1. 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 274
  2. 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 259

Built on by

Not cited yet.