mlsanityData to 14 Oct 2026

Emergence of Goal-Directed Behaviors via Active Inference with Self-Prior

arXiv 2504.11075 ↗First posted 15 Apr 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Infants often exhibit goal-directed behaviors, such as reaching for a sensory stimulus, even when no external reward criterion is provided. These intrinsically motivated behaviors facilitate spontaneous exploration and learning of the body and environment during early developmental stages. Although computational modeling can offer insight into the mechanisms underlying such behaviors, many existing studies on intrinsic motivation focus primarily on how exploration contributes to acquiring external rewards. In this paper, we propose a novel density model for an agent's own multimodal sensory experiences, called the "self-prior," and investigate whether it can autonomously induce goal-directed behavior. Integrated within an active inference framework based on the free energy principle, the self-prior generates behavioral references purely from an intrinsic process that minimizes mismatches between average past sensory experiences and current observations. This mechanism is also analogous to the acquisition and utilization of a body schema through continuous interaction with the environment. We examine this approach in a simulated environment and confirm that the agent spontaneously reaches toward a tactile stimulus. Our study implements intrinsically motivated behavior shaped by the agent's own sensory experiences, demonstrating the spontaneous emergence of intentional behavior during early development.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 58 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

19 of 58 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  4. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  6. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  7. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
  8. 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
  9. 2019Neural Spline Flowscited by 596
  10. 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
  11. 2019Deep Active Inference as Variational Policy Gradientscited by 53
  12. 2020On the Relationship Between Active Inference and Control as Inferencecited by 42
7 more
  1. 2022An information-theoretic perspective on intrinsic motivation in reinforcement learning: a surveycited by 28
  2. 2019End-to-End Pixel-Based Deep Active Inference for Body Perception and Actioncited by 24
  3. 2021Contrastive Active Inferencecited by 21
  4. 2021Exploration and preference satisfaction trade-off in reward-free learningcited by 12
  5. 2018Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loopcited by 4
  6. 2022Goal-directed Planning and Goal Understanding by Active Inference: Evaluation Through Simulated and Physical Robot Experimentscited by 4
  7. 2020Body models in humans, animals, and robots: mechanisms and plasticitycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2018Emergence of Structured Behaviors from Curiosity-Based Intrinsic Motivation
  2. 2025Baby Sophia: A Developmental Approach to Self-Exploration through Self-Touch and Hand Regard
  3. 2023Developmental Curiosity and Social Interaction in Virtual Agents
  4. 2018Learning to Play with Intrinsically-Motivated Self-Aware Agents
  5. 2025Curiosity-Driven Development of Action and Language in Robots Through Self-Exploration
  6. 2025From Kicking to Causality: Simulating Infant Agency Detection with a Robust Intrinsic Reward
  7. 2025Intrinsic Goals for Autonomous Agents: Model-Based Exploration in Virtual Zebrafish Predicts Ethological Behavior and Whole-Brain Dynamics
  8. 2025From Sparse to Dense: Toddler-inspired Reward Transition in Goal-Oriented Reinforcement Learning