mlsanityData to 14 Oct 2026

Proprioceptive-visual correspondence enables self-other distinction in humanoid robots

arXiv 2606.13222 ↗First posted 11 Jun 2026cs.RO cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Distinguishing self from others is a prerequisite for social intelligence, yet humanoid robots that increasingly share workspaces with humans still lack this ability. Here we show that a humanoid robot can learn self-other distinction from proprioceptive-visual correspondence, without any identity labels or kinematic models. Once established, this distinction bootstraps a predictive self-model that maps joint configurations to three-dimensional body occupancy, capturing how the robot's body changes with action. In multi-agent scenes involving humans or morphologically identical robots, the system reliably identifies itself, learns a 3D self-model, and supports downstream tasks including target reaching, collision-aware motion planning, and human-to-robot motion retargeting. Together, these results outline a route toward bodily self-representation in robots that act and coordinate alongside others in shared physical environments. Project page: https://euron-zc.github.io/humanoid-self-model/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 37 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

14 of 37 references.

References · 14

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  5. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  6. 2025SAM 3: Segment Anything with Conceptscited by 906
  7. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
  8. 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 75
  9. 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 61
  10. 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 32
  11. 2020Robot self/other distinction: active inference meets neural networks learning in a mirrorcited by 12
  12. 2023Teaching Robots to Build Simulations of Themselvescited by 6
2 more
  1. 2022Egocentric Visual Self-Modeling for Autonomous Robot Dynamics Prediction and Adaptationcited by 5
  2. 2023High-Degrees-of-Freedom Dynamic Neural Fields for Robot Self-Modeling and Motion Planningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.