Disentangled Representations for Causal Cognition
Not on the map. Why?
Abstract (arXiv)
Complex adaptive agents consistently achieve their goals by solving problems that seem to require an understanding of causal information, information pertaining to the causal relationships that exist among elements of combined agent-environment systems. Causal cognition studies and describes the main characteristics of causal learning and reasoning in human and non-human animals, offering a conceptual framework to discuss cognitive performances based on the level of apparent causal understanding of a task. Despite the use of formal intervention-based models of causality, including causal Bayesian networks, psychological and behavioural research on causal cognition does not yet offer a computational account that operationalises how agents acquire a causal understanding of the world. Machine and reinforcement learning research on causality, especially involving disentanglement as a candidate process to build causal representations, represent on the one hand a concrete attempt at designing causal artificial agents that can shed light on the inner workings of natural causal cognition. In this work, we connect these two areas of research to build a unifying framework for causal cognition that will offer a computational perspective on studies of animal cognition, and provide insights in the development of new algorithms for causal reinforcement learning in AI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 125 of its 311 references that are in the map. First posted on arXiv 30 Jun 2024.
Builds on
125 of 311 references.
References · 125
- 2017Attention Is All You Needcited by 59,932
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2019Invariant Risk Minimizationcited by 1,832
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2018World Modelscited by 1,444
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
38 more
- 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,406
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2017Hindsight Experience Replaycited by 1,096
- 2019An Introduction to Variational Autoencoderscited by 997
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2016Deep Variational Information Bottleneckcited by 915
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2018Disentangling by Factorisingcited by 614
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2017Learning Robust Rewards with Adversarial Inverse Reinforcement Learningcited by 485
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 424
- 2016Tutorial on Variational Autoencoderscited by 404
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2019Causal Confusion in Imitation Learningcited by 286
- 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
- 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 268
- 2020The Risks of Invariant Risk Minimizationcited by 262
- 2020Weakly-Supervised Disentanglement Without Compromisescited by 237
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
- 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
- 2019Recurrent Independent Mechanismscited by 219
- 2015Maximum Entropy Deep Inverse Reinforcement Learningcited by 173
- 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 164
- 2017DARLA: Improving Zero-Shot Transfer in Reinforcement Learningcited by 147
- 2021Discovering and Achieving Goals via World Modelscited by 131
- 2018Deep Variational Reinforcement Learning for POMDPscited by 122
- 2021Does Invariant Risk Minimization Capture Invariance?cited by 116
- 2020CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learningcited by 109
- 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
- 2022Causal Machine Learning: A Survey and Open Problemscited by 107
- 2020Invariant Causal Prediction for Block MDPscited by 104
50 most cited of 125 All 125 (JSON)
Built on by
Not cited yet.