Multi-hop Relational Contrastive Learning: Extending Spatial Contrastive Pre-training Beyond Pairwise Relations
Not on the map. Why?
Abstract (arXiv)
Understanding how objects relate to each other in space is fundamental to scene understanding, yet most contrastive pre-training approaches only model pairwise relationships, leaving richer compositional and multi-hop interactions largely unexplored. We introduce Multi-Hop Relational Contrastive Learning (MRCL), a framework that extends spatial contrastive learning to graph-structured scene representations. By tracing k-hop paths through scene graphs built from detected objects, MRCL captures implicit spatial dependencies that go well beyond what direct object pairs can express. We define a multi-level contrastive objective spanning nodes, edges, and multi-hop paths, encouraging embeddings that remain stable across object semantics while staying responsive to spatial layout. On a GQA subset, MRCL produces spatially-aware representations that improve content-based graph retrieval (NDCG@5 = 0.748) and consistently benefit downstream tasks, including spatial relationship recognition and graph-based question answering. Together, these results suggest that multi-hop relational supervision offers substantially richer structural guidance than pairwise-only methods, leading to visual representations that are more robust, compositional, and geometry-aware.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
10 of 16 references.
References · 10
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2016Visual Relationship Detection with Language Priorscited by 334
- 2018Graph R-CNN for Scene Graph Generationcited by 298
- 2019SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognitioncited by 55
Built on by
Not cited yet.