Neuroscience-inspired perception-action in robotics: applying active inference for state estimation, control and self-perception
Not on the map. Why?
Abstract (arXiv)
Unlike robots, humans learn, adapt and perceive their bodies by interacting with the world. Discovering how the brain represents the body and generates actions is of major importance for robotics and artificial intelligence. Here we discuss how neuroscience findings open up opportunities to improve current estimation and control algorithms in robotics. In particular, how active inference, a mathematical formulation of how the brain resists a natural tendency to disorder, provides a unified recipe to potentially solve some of the major challenges in robotics, such as adaptation, robustness, flexibility, generalization and safe interaction. This paper summarizes some experiments and lessons learned from developing such a computational model on real embodied platforms, i.e., humanoid and industrial robots. Finally, we showcase the limitations and challenges that we are still facing to give robots human-like perception
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 52 references that are in the map. First posted on arXiv 10 May 2021.
Builds on
15 of 52 references.
References · 15
- 2020Active inference on discrete state-spaces: a synthesiscited by 91
- 2017The free energy principle for action and perception: A mathematical reviewcited by 66
- 2020Whence the Expected Free Energy?cited by 40
- 2019End-to-End Pixel-Based Deep Active Inference for Body Perception and Actioncited by 24
- 2020Automatic structured variational inferencecited by 21
- 2021Multimodal VAE Active Inference Controllercited by 21
- 2020Deep Active Inference for Partially Observable MDPscited by 20
- 2018Adaptive robot body learning and estimation through predictive codingcited by 13
- 2021Predictive Processing in Cognitive Robotics: a Reviewcited by 13
- 2020Robot self/other distinction: active inference meets neural networks learning in a mirrorcited by 12
- 2019A Novel Adaptive Controller for Robot Manipulators based on Active Inferencecited by 11
- 2020A deep active inference model of the rubber-hand illusioncited by 7
3 more
- 2020Robot in the mirror: toward an embodied computational model of mirror self-recognitioncited by 5
- 2018Drifting perceptual patterns suggest prediction errors fusion rather than hypothesis selection: replicating the rubber-hand illusion on a robotcited by 3
- 2018A predictive processing model of perception and action for self-other distinctioncited by 3
Built on by
Citing papers per year: 2021: 4; 2022: 0; 2023: 0; 2024: 1.
5 papers.
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
- 2021Adaptation through prediction: multisensory active inference torque controlcited by 6
- 2021Deep Active Inference for Pixel-Based Discrete Control: Evaluation on the Car Racing Problemcited by 2
- 2024Object-centric proto-symbolic behavioural reasoning from pixelscited by 2
- 2021Robot Localization and Navigation through Predictive Processing using LiDARcited by 1
- 2024Object-centric proto-symbolic behavioural reasoning from pixels26 Nov 2024
- 2021Adaptation through prediction: multisensory active inference torque control13 Dec 2021
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challenges3 Dec 2021
- 2021Deep Active Inference for Pixel-Based Discrete Control: Evaluation on the Car Racing Problem9 Sep 2021
- 2021Robot Localization and Navigation through Predictive Processing using LiDAR9 Sep 2021