An Energy-Based Mechanism for Compositional Behavior
Not on the map. Why?
Abstract (arXiv)
Flexible intelligence relies on the ability to reuse previously acquired behaviors and combine them differently as circumstances change. In biological and artificial systems, this ability is often attributed to gating mechanisms that determine how much each available behavior should contribute at a given time. Yet these gating rules, the dynamics that compute them, and the neural circuits that may implement them are usually introduced separately, leaving unclear whether they reflect a common underlying principle. Here, we show that they can all be derived from a single variational principle for behavioral composition. The resulting mechanism naturally gives rise to softmax gating, evolves as an energy-based dynamical system with guaranteed convergence, and admits a recurrent neural network instantiation featuring context-dependent and local interactions. Across collective behavior, human decision-making, and layered control, the same mechanism reproduces characteristic behavioral patterns, provides interpretable accounts of how different behaviors are combined, and matches or outperforms established approaches. These results provide a unified account of how behavioral composition can emerge from a common principle, with implications for understanding flexible behavior in natural systems and for designing artificial agents that can adapt by recombining existing capabilities.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 106 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
26 of 106 references.
References · 26
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2024A Survey on Mixture of Experts in Large Language Modelscited by 233
- 2017On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learningcited by 136
- 2021Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Controlcited by 68
- 2021safe-control-gym: a Unified Benchmark Suite for Safe Learning-based Control and Reinforcement Learning in Roboticscited by 42
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Compositioncited by 27
- 2018Deep Neural Network Structures Solving Variational Inequalitiescited by 25
- 2021Maximum-Entropy Multi-Agent Dynamic Games: Forward and Inverse Solutionscited by 22
- 2021Contrastive Active Inferencecited by 21
- 2017Why do similarity matching objectives lead to Hebbian/anti-Hebbian networks?cited by 20
- 2023Collective behavior from surprise minimizationcited by 10
- 2020A biologically plausible neural network for Slow Feature Analysiscited by 8
14 more
- 2023A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functionscited by 8
- 2014Online Markov decision processes with Kullback-Leibler control costcited by 7
- 2019Diversity-enabled sweet spots in layered architectures and speed-accuracy trade-offs in sensorimotor controlcited by 7
- 2024Free-Energy Machine for Combinatorial Optimizationcited by 7
- 2022Probabilistic design of optimal sequential decision-making algorithms in learning and controlcited by 6
- 2022Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learningcited by 6
- 2023Time-Varying Convex Optimization: A Contraction and Equilibrium Tracking Approachcited by 6
- 2023Positive Competitive Networks for Sparse Reconstructioncited by 4
- 2025Distributionally Robust Free Energy Principle for Decision-Makingcited by 4
- 2017Network dynamics of innovation processescited by 2
- 2014Dynamical systems and forward-backward algorithms associated with the sum of a convex subdifferential and a monotone cocoercive operatorcited by 1
- 2023Learning with Delayed Payoffs in Population Games using Kullback-Leibler Divergence Regularizationcited by 1
- 2024Free-Gate: Planning, Control And Policy Composition via Free Energy Gatingcited by 1
- 2025What the flock knows that the birds do not: exploring the emergence of joint agency in multi-agent active inferencecited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.