Optimal foraging strategies can be learned
Not on the map. Why?
Abstract (arXiv)
The foraging behavior of animals is a paradigm of target search in nature. Understanding which foraging strategies are optimal and how animals learn them are central challenges in modeling animal foraging. While the question of optimality has wide-ranging implications across fields such as economy, physics, and ecology, the question of learnability is a topic of ongoing debate in evolutionary biology. Recognizing the interconnected nature of these challenges, this work addresses them simultaneously by exploring optimal foraging strategies through a reinforcement learning framework. To this end, we model foragers as learning agents. We first prove theoretically that maximizing rewards in our reinforcement learning model is equivalent to optimizing foraging efficiency. We then show with numerical experiments that, in the paradigmatic model of non-destructive search, our agents learn foraging strategies which outperform the efficiency of some of the best known strategies such as L'evy walks. These findings highlight the potential of reinforcement learning as a versatile framework not only for optimizing search strategies but also to model the learning process, thus shedding light on the role of learning in natural optimization processes.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 9 of its 57 references that are in the map. First posted on arXiv 10 Mar 2023.
Builds on
9 of 57 references.
References · 9
- 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
- 2023Emergence of Maps in the Memories of Blind Navigation Agentscited by 33
- 2013Projective simulation for classical learning agents: a comprehensive investigationcited by 6
- 2020On the role of theory and modeling in neurosciencecited by 5
- 2015Projective simulation with generalizationcited by 4
- 2020Development of swarm behavior in artificial learning agents that adapt to different foraging environmentscited by 4
- 2016Meta-learning within Projective Simulationcited by 3
- 2019On the convergence of projective-simulation-based reinforcement learning in Markov decision processescited by 3
- 2020Collective defense of honeybee colonies: experimental results and theoretical modelingcited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 2.
5 papers.
- 2025Reinforcement Learning for Active Mattercited by 4
- 2024Multi-Excitation Projective Simulation with a Many-Body Physics Inspired Inductive Biascited by 2
- 2025Learning to reset in target search problemscited by 2
- 2026Beyond Task Performance: A Metric-Based Analysis of Sequential Cooperation in Heterogeneous Multi-Agent Destructive Foragingcited by 0
- 2026Emergent aggregation from collective foragingcited by 0
- 2026Emergent aggregation from collective foraging28 Aug 2026
- 2026Beyond Task Performance: A Metric-Based Analysis of Sequential Cooperation in Heterogeneous Multi-Agent Destructive Foraging11 Feb 2026
- 2025Reinforcement Learning for Active Matter30 Mar 2025
- 2025Learning to reset in target search problems14 Mar 2025
- 2024Multi-Excitation Projective Simulation with a Many-Body Physics Inspired Inductive Bias15 Feb 2024