mlsanityData to 14 Oct 2026

Two Global Crops Suffice: Locating Semantic Emergence in DINO-Style Self-Supervised Learning

arXiv 2609.28187 ↗First posted 23 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised vision transformers trained with DINO-style objectives exhibit striking emergent semantic representation quality across visual tasks, yet the mechanisms underlying this behavior remain unclear. We present a systematic empirical dissection of the DINO family and show that semantic representations arise primarily from enforcing consistency between geometrically distinct global views of the same image instance. This instance-specific global alignment acts as the semantic anchor of DINO-style learning. Across controlled retraining experiments evaluated on semantic correspondence and a diverse suite of 2D and 3D downstream tasks, we find that patch-level masking objectives enhance semantics only when trained jointly with this global alignment, indicating that the iBOT objective refines and densifies existing semantic structure rather than creating it independently. In contrast, local-to-global view alignment does not substantially improve semantic qualities at fixed compute beyond a purely global alignment. Beyond training design, we revisit how semantic representation quality should be evaluated: while classification accuracy is the standard validation score, semantic correspondence provides a complementary axis that more reliably predicts downstream task performance. Together, these findings provide a functional decomposition of DINO-style learning and represent an important step toward understanding how semantic representations emerge in self-supervised vision models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 35 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

32 of 35 references.

References · 32

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  9. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  10. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  11. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  12. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
20 more
  1. 2025DINOv3cited by 1,414
  2. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  3. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
  4. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  5. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
  6. 2023Emergent Correspondence from Image Diffusioncited by 446
  7. 2021Deep ViT Features as Dense Visual Descriptorscited by 330
  8. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
  9. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  10. 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
  11. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 177
  12. 2019SPair-71k: A Large-scale Benchmark for Semantic Correspondencecited by 146
  13. 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Taskscited by 72
  14. 2022Zero-Shot Category-Level Object Pose Estimationcited by 57
  15. 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
  16. 2024ImageNet3D: Towards General-Purpose Object-Level 3D Understandingcited by 25
  17. 2025Simplifying DINO via Coding Rate Regularizationcited by 21
  18. 2024You Don't Need Domain-Specific Data Augmentations When Scaling Self-Supervised Learningcited by 16
  19. 2024Near, far: Patch-ordering enhances vision foundation models' scene understandingcited by 15
  20. 2024Can Visual Foundation Models Achieve Long-term Point Tracking?cited by 14

Built on by

Not cited yet.