mlsanityData to 7 Oct 2026

Disentangled Representations for Causal Cognition

arXiv 2407.00744 ↗First posted 30 Jun 2024cs.AI cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Complex adaptive agents consistently achieve their goals by solving problems that seem to require an understanding of causal information, information pertaining to the causal relationships that exist among elements of combined agent-environment systems. Causal cognition studies and describes the main characteristics of causal learning and reasoning in human and non-human animals, offering a conceptual framework to discuss cognitive performances based on the level of apparent causal understanding of a task. Despite the use of formal intervention-based models of causality, including causal Bayesian networks, psychological and behavioural research on causal cognition does not yet offer a computational account that operationalises how agents acquire a causal understanding of the world. Machine and reinforcement learning research on causality, especially involving disentanglement as a candidate process to build causal representations, represent on the one hand a concrete attempt at designing causal artificial agents that can shed light on the inner workings of natural causal cognition. In this work, we connect these two areas of research to build a unifying framework for causal cognition that will offer a computational perspective on studies of animal cognition, and provide insights in the development of new algorithms for causal reinforcement learning in AI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 125 of its 311 references that are in the map. First posted on arXiv 30 Jun 2024.

Builds on

125 of 311 references.

References · 125

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  5. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  6. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
  7. 2019Invariant Risk Minimizationcited by 1,832
  8. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  9. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  10. 2016Generative Adversarial Imitation Learningcited by 1,576
  11. 2018World Modelscited by 1,444
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
38 more
  1. 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,406
  2. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  3. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  4. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  5. 2017Hindsight Experience Replaycited by 1,096
  6. 2019An Introduction to Variational Autoencoderscited by 997
  7. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  8. 2016Deep Variational Information Bottleneckcited by 915
  9. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  10. 2015Deep Learning and the Information Bottleneck Principlecited by 793
  11. 2018Disentangling by Factorisingcited by 614
  12. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
  13. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
  14. 2017Learning Robust Rewards with Adversarial Inverse Reinforcement Learningcited by 485
  15. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  16. 2017A Brief Survey of Deep Reinforcement Learningcited by 466
  17. 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 424
  18. 2016Tutorial on Variational Autoencoderscited by 404
  19. 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
  20. 2018Towards a Definition of Disentangled Representationscited by 294
  21. 2019Causal Confusion in Imitation Learningcited by 286
  22. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
  23. 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 268
  24. 2020The Risks of Invariant Risk Minimizationcited by 262
  25. 2020Weakly-Supervised Disentanglement Without Compromisescited by 237
  26. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
  27. 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
  28. 2019Recurrent Independent Mechanismscited by 219
  29. 2015Maximum Entropy Deep Inverse Reinforcement Learningcited by 173
  30. 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 164
  31. 2017DARLA: Improving Zero-Shot Transfer in Reinforcement Learningcited by 147
  32. 2021Discovering and Achieving Goals via World Modelscited by 131
  33. 2018Deep Variational Reinforcement Learning for POMDPscited by 122
  34. 2021Does Invariant Risk Minimization Capture Invariance?cited by 116
  35. 2020CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learningcited by 109
  36. 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
  37. 2022Causal Machine Learning: A Survey and Open Problemscited by 107
  38. 2020Invariant Causal Prediction for Block MDPscited by 104

50 most cited of 125 All 125 (JSON)

Built on by

Not cited yet.