Learning interaction rules from multi-animal trajectories via augmented behavioral models
Not on the map. Why?
Abstract (arXiv)
Extracting the interaction rules of biological agents from movement sequences pose challenges in various domains. Granger causality is a practical framework for analyzing the interactions from observed time-series data; however, this framework ignores the structures and assumptions of the generative process in animal behaviors, which may lead to interpretational problems and sometimes erroneous assessments of causality. In this paper, we propose a new framework for learning Granger causality from multi-animal trajectories via augmented theory-based behavioral models with interpretable data-driven models. We adopt an approach for augmenting incomplete multi-agent behavioral models described by time-varying dynamical systems with neural networks. For efficient and interpretable learning, our model leverages theory-based architectures separating navigation and motion processes, and the theory-guided regularization for reliable behavioral modeling. This can provide interpretable signs of Granger-causal effects over time, i.e., when specific others cause the approach or separation. In experiments using synthetic datasets, our method achieved better performance than various baselines. We then analyzed multi-animal datasets of mice, flies, birds, and bats, which verified our method and obtained novel biological insights.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 26 of its 98 references that are in the map. First posted on arXiv 12 Jul 2021.
Builds on
26 of 98 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 391
- 2018Neural Relational Inference for Interacting Systemscited by 339
- 2018Markerless tracking of user-defined features with deep learningcited by 203
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2019Multiple Futures Predictioncited by 178
- 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 169
- 2016Composing graphical models with neural networks for structured representations and fast inferencecited by 113
- 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 99
- 2017Coordinated Multi-Agent Imitation Learningcited by 70
14 more
- 2019Economy Statistical Recurrent Units For Inferring Nonlinear Granger Causalitycited by 55
- 2017VAIN: Attentional Multi-agent Predictive Modelingcited by 51
- 2021Interpretable Models for Granger Causality Using Self-explaining Neural Networkscited by 44
- 2019Social Attention for Autonomous Decision-Making in Dense Trafficcited by 39
- 2020SimGANs: Simulator-Based Generative Adversarial Networks for ECG Synthesis to Improve Deep ECG Classificationcited by 32
- 2017Generating Long-term Trajectories Using Deep Hierarchical Networkscited by 23
- 2018Neural Granger Causalitycited by 19
- 2016Learning recurrent representations for hierarchical behavior modelingcited by 16
- 2020Discovering Nonlinear Relations with Minimum Predictive Information Regularizationcited by 16
- 2017In reply to Faes et al. and Barnett et al. regarding "A study of problems encountered in Granger causality analysis from a neuroscience perspective"cited by 14
- 2014Scalable Matrix-valued Kernel Learning for High-dimensional Nonlinear Multivariate Regression and Granger Causalitycited by 13
- 2018Dynamic mode decomposition in vector-valued reproducing kernel Hilbert spaces for extracting dynamical structure among observablescited by 12
- 2018The Long Road to Computational Location Privacy: A Surveycited by 10
- 2015Validity of time reversal for testing Granger causalitycited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 0; 2025: 1.
5 papers.
- 2022Estimating counterfactual treatment outcomes over time in complex multiagent scenarioscited by 11
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 11
- 2023Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrationscited by 8
- 2023Relax, it doesn't matter how you get there: A new self-supervised approach for multi-timescale behavior analysiscited by 4
- 2022Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Networkcited by 3
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2023Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations22 May 2023
- 2023Relax, it doesn't matter how you get there: A new self-supervised approach for multi-timescale behavior analysis15 Mar 2023
- 2022Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Network28 Aug 2022
- 2022Estimating counterfactual treatment outcomes over time in complex multiagent scenarios4 Jun 2022