mlsanityData to 7 Oct 2026

Dissecting Larval Zebrafish Hunting using Deep Reinforcement Learning Trained RNN Agents

arXiv 2510.03699 ↗First posted 4 Oct 2025q-bio.NC cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Larval zebrafish hunting provides a tractable setting to study how ecological and energetic constraints shape adaptive behavior in both biological brains and artificial agents. Here we develop a minimal agent-based model, training recurrent policies with deep reinforcement learning in a bout-based zebrafish simulator. Despite its simplicity, the model reproduces hallmark hunting behaviors -- including eye vergence-linked pursuit, speed modulation, and stereotyped approach trajectories -- that closely match real larval zebrafish. Quantitative trajectory analyses show that pursuit bouts systematically reduce prey angle by roughly half before strike, consistent with measurements. Virtual experiments and parameter sweeps vary ecological and energetic constraints, bout kinematics (coupled vs. uncoupled turns and forward motion), and environmental factors such as food density, food speed, and vergence limits. These manipulations reveal how constraints and environments shape pursuit dynamics, strike success, and abort rates, yielding falsifiable predictions for neuroscience experiments. These sweeps identify a compact set of constraints -- binocular sensing, the coupling of forward speed and turning in bout kinematics, and modest energetic costs on locomotion and vergence -- that are sufficient for zebrafish-like hunting to emerge. Strikingly, these behaviors arise in minimal agents without detailed biomechanics, fluid dynamics, circuit realism, or imitation learning from real zebrafish data. Taken together, this work provides a normative account of zebrafish hunting as the optimal balance between energetic cost and sensory benefit, highlighting the trade-offs that structure vergence and trajectory dynamics. We establish a virtual lab that narrows the experimental search space and generates falsifiable predictions about behavior and neural coding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 34 references that are in the map. First posted on arXiv 4 Oct 2025.

Builds on

7 of 34 references.

References · 7

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  3. 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
  4. 2021Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPscited by 115
  5. 2016Recurrent Network Models Of Sequence Generation And Memorycited by 21
  6. 2025Deep RL Needs Deep Behavior Analysis: Exploring Implicit Planning by Model-Free Agents in Open-Ended Environmentscited by 4
  7. 2025Intrinsic Goals for Autonomous Agents: Model-Based Exploration in Virtual Zebrafish Predicts Ethological Behavior and Whole-Brain Dynamicscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Data-driven simulator of multi-animal behavior with unknown dynamics via offline and online reinforcement learning
  2. 2025World Models Unlock Optimal Foraging Strategies in Reinforcement Learning Agents
  3. 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discovery
  4. 2026Implementation of reinforcement learning in chemical reaction networks: application to phototaxis as curiosity-driven exploration
  5. 2026Intrinsic Motivation in Reinforcement Learning: A Research Agenda for Adaptive Self-Organisation
  6. 2022Combining imitation and deep reinforcement learning to accomplish human-level performance on a virtual foraging task
  7. 2025NLP4Neuro: Sequence-to-sequence learning for neural population decoding
  8. 2025Behavioral Exploration: Learning to Explore via In-Context Adaptation