mlsanityData to 7 Oct 2026

Towards aligned body representations in vision models

arXiv 2512.00365 ↗First posted 29 Nov 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Human physical reasoning relies on internal "body" representations - coarse, volumetric approximations that capture an object's extent and support intuitive predictions about motion and physics. While psychophysical evidence suggests humans use such coarse representations, their internal structure remains largely unknown. Here we test whether vision models trained for segmentation develop comparable representations. We adapt a psychophysical experiment conducted with 50 human participants to a semantic segmentation task and test a family of seven segmentation networks, varying in size. We find that smaller models naturally form human-like coarse body representations, whereas larger models tend toward overly detailed, fine-grain encodings. Our results demonstrate that coarse representations can emerge under limited computational resources, and that machine representations can provide a scalable path toward understanding the structure of physical reasoning in the brain.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 28 references that are in the map. First posted on arXiv 29 Nov 2025.

Builds on

10 of 28 references.

References · 10

  1. 2020End-to-End Object Detection with Transformerscited by 7,384
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  3. 2017Deep Learning Scaling is Predictable, Empiricallycited by 556
  4. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  5. 2022Compute Trends Across Three Eras of Machine Learningcited by 161
  6. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 145
  7. 2025Measuring AI Ability to Complete Long Software Taskscited by 142
  8. 2018IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoningcited by 72
  9. 2025Intuitive physics understanding emerges from self-supervised pretraining on natural videoscited by 66
  10. 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physicscited by 20

Built on by

Not cited yet.