mlsanityData to 7 Oct 2026

Emergent Object Binding Has a Finite Spatial Horizon

arXiv 2610.00006 ↗First posted 9 Jul 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Pretrained Vision Transformers encode whether two image patches belong to the same object. This IsSameObject signal is decodable from frozen patch embeddings at high accuracy, which suggests that object binding emerges from self-supervised pretraining alone. We show that this single accuracy number hides the structure of the signal. Binding is local: the probability that two patches of the same object are decoded as bound falls off monotonically with the distance between them and levels off at a nonzero floor, a falloff well described by an exponential with a finite length scale. This decay holds across object sizes, across three families of probe, on both ADE20K and COCO, and across DINO and CLIP backbones, which indicates that it is a property of the representation rather than of the decoder. Reading binding as local spatial coherence with a finite range accounts for a set of behaviors that the aggregate score leaves unexplained: binding weakens on large objects, separates distinct objects of the same class less reliably than objects of different classes, and groups object parts with their wholes. It is, by contrast, unaffected by occlusion once object size is controlled. We map each behavior with confounds controlled. As a preliminary observation, the horizon and its floor are organized at different depths in DINOv2 and DINOv3, which we report as suggestive given the small number of layers probed and the confound between the two models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 13 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

12 of 13 references.

References · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2025DINOv3cited by 1,297
  7. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  8. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  9. 2020Object-Centric Learning with Slot Attentioncited by 865
  10. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  11. 2020On the Binding Problem in Artificial Neural Networkscited by 230
  12. 2025Does Object Binding Naturally Emerge in Large Pretrained Vision Transformers?cited by 19

Built on by

Not cited yet.