mlsanityData to 7 Oct 2026

Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of others

arXiv 2102.11938 ↗First posted 23 Feb 2021cs.AI cs.LGcited by 39

Not on the map. Why?

Abstract (arXiv)

To achieve human-like common sense about everyday life, machine learning systems must understand and reason about the goals, preferences, and actions of other agents in the environment. By the end of their first year of life, human infants intuitively achieve such common sense, and these cognitive achievements lay the foundation for humans' rich and complex understanding of the mental states of others. Can machines achieve generalizable, commonsense reasoning about other agents like human infants? The Baby Intuitions Benchmark (BIB) challenges machines to predict the plausibility of an agent's behavior based on the underlying causes of its actions. Because BIB's content and paradigm are adopted from developmental cognitive science, BIB allows for direct comparison between human and machine performance. Nevertheless, recently proposed, deep-learning-based agency reasoning models fail to show infant-like reasoning, leaving BIB an open challenge.

Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 13 of its 83 references that are in the map. First posted on arXiv 23 Feb 2021.

Builds on

13 of 83 references.

References · 13

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
  3. 2016Generative Adversarial Imitation Learningcited by 1,576
  4. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  5. 2019Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variablescited by 372
  6. 2018Maximum a Posteriori Policy Optimisationcited by 318
  7. 2020Decoupling Representation Learning from Reinforcement Learningcited by 263
  8. 2018Machine Theory of Mindcited by 222
  9. 2020Keep Doing What Worked: Behavioral Modelling Priors for Offline Reinforcement Learningcited by 213
  10. 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 126
  11. 2018Modeling Others using Oneself in Multi-Agent Reinforcement Learningcited by 64
  12. 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variablescited by 50
1 more
  1. 2018Learning a Prior over Intent via Meta-Inverse Reinforcement Learningcited by 36

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 3; 2023: 10; 2024: 12; 2025: 8; 2026: 2.

39 papers.

Sort:

By area:

  1. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
  2. 2023Understanding Social Reasoning in Language Models with Language Modelscited by 166
  3. 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 84
  4. 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 57
  5. 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
  6. 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
  7. 2022Contrastive language and vision learning of general fashion conceptscited by 41
  8. 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
  9. 2024Core Knowledge Deficits in Multi-Modal Language Modelscited by 38
  10. 2023Towards A Holistic Landscape of Situated Theory of Mind in Large Language Modelscited by 32
  11. 2024Language Models Represent Beliefs of Self and Otherscited by 29
  12. 2025Theory of Mind in Large Language Models: Assessment and Enhancementcited by 24
27 more
  1. 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
  2. 2024TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mindcited by 20
  3. 2024A Notion of Complexity for Theory of Mind via Discrete World Modelscited by 16
  4. 2025SoMi-ToM: Evaluating Multi-Perspective Theory of Mind in Embodied Social Interactionscited by 16
  5. 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
  6. 2024Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisitioncited by 10
  7. 2024EgoSocialArena: Benchmarking the Social Intelligence of Large Language Models from a First-person Perspectivecited by 10
  8. 2025EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric Videoscited by 10
  9. 2025PLAICraft: Large-Scale Time-Aligned Vision-Speech-Action Dataset for Embodied AIcited by 10
  10. 2022Solving the Baby Intuitions Benchmark with a Hierarchically Bayesian Theory of Mindcited by 9
  11. 2023A Review on Machine Theory of Mindcited by 9
  12. 2023Comparing Machines and Children: Using Developmental Psychology Experiments to Assess the Strengths and Weaknesses of LaMDA Responsescited by 9
  13. 2021A Benchmark for Modeling Violation-of-Expectation in Physical Reasoning Across Event Categoriescited by 8
  14. 2023Neural Reasoning About Agents' Goals, Preferences, and Actionscited by 8
  15. 2023Memory-Augmented Theory of Mind Networkcited by 6
  16. 2024Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactionscited by 6
  17. 2022Learning Theory of Mind via Dynamic Traits Attributioncited by 5
  18. 2024BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mindcited by 5
  19. 2024MARPLE: A Benchmark for Long-Horizon Inferencecited by 5
  20. 2025ToM-SSI: Evaluating Theory of Mind in Situated Social Interactionscited by 5
  21. 2021AVoE: A Synthetic 3D Dataset on Understanding Violation of Expectation for Artificial Cognitioncited by 4
  22. 2025The Yokai Learning Environment: Tracking Beliefs Over Space and Timecited by 3
  23. 2026YoCausal: How Far is Video Generation from World Model? A Causality Perspectivecited by 3
  24. 2023Compositional Learning of Visually-Grounded Concepts Using Reinforcementcited by 2
  25. 2025Concepts Learned Visually by Infants Can Contribute to Visual Learning and Understanding in AI Modelscited by 0
  26. 2025Brain-Inspired Perspective on Configurations: Unsupervised Similarity and Early Cognitioncited by 0
  27. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligencecited by 0