Relation Networks for Object Detection
Not on the map. Why?
Abstract (arXiv)
Although it is well believed for years that modeling relations between objects would help object recognition, there has not been evidence that the idea is working in the deep learning era. All state-of-the-art object detection systems still rely on recognizing object instances individually, without exploiting their relations during learning. This work proposes an object relation module. It processes a set of objects simultaneously through interaction between their appearance feature and geometry, thus allowing modeling of their relations. It is lightweight and in-place. It does not require additional supervision and is easy to embed in existing networks. It is shown effective on improving object recognition and duplicate removal steps in the modern object detection pipeline. It verifies the efficacy of modeling object relations in CNN based detection. It gives rise to the first fully end-to-end object detector.
Key facts. Cited by 305 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 110; 2022: 101; 2023: 33; 2024: 30; 2025: 14; 2026: 17.
305 papers.
Sort:
By area:
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2021Video Swin Transformercited by 1,090
- 2021Multiscale Vision Transformerscited by 896
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2021Bottleneck Transformers for Visual Recognitioncited by 364
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
38 more
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2022Visual Attention Networkcited by 210
- 2021Learning to Enhance Low-Light Image via Zero-Reference Deep Curve Estimationcited by 192
- 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
- 2021You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detectioncited by 170
- 2023Towards Open Vocabulary Learning: A Surveycited by 165
- 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
- 2021Focal and Global Knowledge Distillation for Detectorscited by 138
- 2021Cross-Domain Adaptive Teacher for Object Detectioncited by 125
- 2021A Survey of Visual Transformerscited by 117
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021General Instance Distillation for Object Detectioncited by 113
- 2021Instant-Teaching: An End-to-End Semi-Supervised Object Detection Frameworkcited by 112
- 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
- 2021LambdaNetworks: Modeling Long-Range Interactions Without Attentioncited by 107
- 2021Distilling Object Detectors via Decoupled Featurescited by 105
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
- 2022Global Context Vision Transformerscited by 98
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021CAT: Cross Attention in Vision Transformercited by 92
- 2021An Image is Worth 16x16 Words, What is a Video Worth?cited by 87
- 2021TVT: Transferable Vision Transformer for Unsupervised Domain Adaptationcited by 81
- 2022Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognitioncited by 81
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 20213D-MAN: 3D Multi-frame Attention Network for Object Detectioncited by 73
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2022Video Transformers: A Surveycited by 63
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
50 most cited of 305 All 305 (JSON)
- 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection26 Sep 2026
- 2026SRPR-Net: Semantic and Relational Prompt Refinement for Automated SAM-based Instance Segmentation21 Sep 2026
- 2026AcroMELD: Recovering Interactive PDF Forms with Structure-Aware Graph Set Transformers23 Aug 2026
- 2026FD-CanKD: Frequency-Decoupled Cross-Attention Distillation as a Refinement Prior for Compact Object Detectors19 Aug 2026
- 2026Topology-Aware Query Selection for Surgical Instrument Instance Segmentation12 Aug 2026
- 2026Match One, Learn with Graph: One-to-Graph Query Collaboration with Backward Sharing for Object Detection6 Aug 2026
- 2026RF-HOI: Recognize Human-Object Interaction with Radio Frequency Signals31 Jul 2026
- 2026A Smart Classroom Behavior Analysis Framework with a New Highly Congested Classroom Dataset19 Jun 2026
- 2026Context-Aware Feature-Fusion for Co-occurring Object Detection in Autonomous Driving10 Jun 2026
- 2026Learned Non-Maximum Suppression for 3D Object Detection2 Jun 2026
- 2026MDS-DETR: DETR with Masked Duplicate Suppressor22 May 2026
- 2026Learned Suppression for 3D Keypoint Detection with a Graph-Transformer Backbone14 May 2026
38 more
- 2026CRISP: Compositional Relations as Invariant Structural Priors for Domain Generalization7 May 2026
- 2026RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models26 Mar 2026
- 2026SPRINT: Semi-supervised Prototypical Representation for Few-Shot Class-Incremental Tabular Learning4 Mar 2026
- 2026DINOv3 Visual Representations for Blueberry Perception Toward Robotic Harvesting2 Mar 2026
- 2026Small Object Detection Model with Spatial Laplacian Pyramid Attention and Multi-Scale Features Enhancement in Aerial Images26 Feb 2026
- 2025Holi-DETR: Holistic Fashion Item Detection Leveraging Contextual Information29 Dec 2025
- 2025MKSNet: Advanced Small Object Detection in Remote Sensing Imagery with Multi-Kernel and Dual Attention Mechanisms3 Dec 2025
- 2025CanKD: Cross-Attention-based Non-local operation for Feature-based Knowledge Distillation26 Nov 2025
- 2025Data-Augmented Quantization-Aware Knowledge Distillation4 Sep 2025
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors29 Jul 2025
- 2025CSDN: A Context-Gated Self-Adaptive Detection Network for Real-Time Object Detection21 Jun 2025
- 2025DFEN: Dual Feature Equalization Network for Medical Image Segmentation9 May 2025
- 2025R-Sparse R-CNN: SAR Ship Detection Based on Background-Aware Sparse Learnable Proposals26 Apr 2025
- 2025Density-based Object Detection in Crowded Scenes14 Apr 2025
- 2025PolygoNet: Leveraging Simplified Polygonal Representation for Effective Image Classification1 Apr 2025
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interaction27 Mar 2025
- 2025Robust Computer-Vision based Construction Site Detection for Assistive-Technology Applications6 Mar 2025
- 2025CLoCKDistill: Consistent Location-and-Context-aware Knowledge Distillation for DETRs15 Feb 2025
- 2025LP-DETR: Layer-wise Progressive Relations for Object Detection7 Feb 2025
- 2024Interacted Object Grounding in Spatio-Temporal Human-Object Interactions27 Dec 2024
- 2024Visual-Linguistic Agent: Towards Collaborative Contextual Object Reasoning15 Nov 2024
- 2024SIRA: Scalable Inter-frame Relation and Association for Radar Perception4 Nov 2024
- 2024Polar R-CNN: End-to-End Lane Detection with Fewer Anchors3 Nov 2024
- 2024Learning to rumble: Automated elephant call classification, detection and endpointing using deep architectures15 Oct 2024
- 2024SLAck: Semantic, Location, and Appearance Aware Open-Vocabulary Tracking17 Sep 2024
- 2024Infra-YOLO: Efficient Neural Network Structure with Model Compression for Real-Time Infrared Small Object Detection14 Aug 2024
- 2024Practical Video Object Detection via Feature Selection and Aggregation29 Jul 2024
- 2024A Survey on Cell Nuclei Instance Segmentation and Classification: Leveraging Context and Attention26 Jul 2024
- 2024Relation DETR: Exploring Explicit Position Relation Prior for Object Detection16 Jul 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers11 Jul 2024
- 2024YOLOv10: Real-Time End-to-End Object Detection23 May 2024
- 2024Better Sampling, towards Better End-to-end Small Object Detection17 May 2024
- 2024Open-Vocabulary Object Detection via Neighboring Region Attention Alignment14 May 2024
- 2024From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks9 May 2024
- 2024Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion2 May 2024
- 2024New Benchmark Dataset and Fine-Grained Cross-Modal Fusion Framework for Vietnamese Multimodal Aspect-Category Sentiment Analysis1 May 2024
- 2024An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Training18 Apr 2024
- 2024Neural-Symbolic VideoQA: Learning Compositional Spatio-Temporal Reasoning for Real-world Video Question Answering5 Apr 2024
50 newest of 305 All 305 (JSON)
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
- 2022Automatic Relation-aware Graph Network Proliferationcited by 6
- 2024Neural-Symbolic VideoQA: Learning Compositional Spatio-Temporal Reasoning for Real-world Video Question Answeringcited by 6
- 2024Visual-Linguistic Agent: Towards Collaborative Contextual Object Reasoningcited by 2
- 2024Visual-Linguistic Agent: Towards Collaborative Contextual Object Reasoning15 Nov 2024
- 2024Neural-Symbolic VideoQA: Learning Compositional Spatio-Temporal Reasoning for Real-world Video Question Answering5 Apr 2024
- 2022Automatic Relation-aware Graph Network Proliferation31 May 2022
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matrices28 Jan 2022
- 2022Deep Learning Approaches on Image Captioning: A Reviewcited by 43
- 2022Deep Learning Approaches on Image Captioning: A Review31 Jan 2022
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2021Video Swin Transformercited by 1,090
- 2021Multiscale Vision Transformerscited by 896
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2021Bottleneck Transformers for Visual Recognitioncited by 364
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
12 most cited of 297 All 297 (JSON)
- 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection26 Sep 2026
- 2026SRPR-Net: Semantic and Relational Prompt Refinement for Automated SAM-based Instance Segmentation21 Sep 2026
- 2026AcroMELD: Recovering Interactive PDF Forms with Structure-Aware Graph Set Transformers23 Aug 2026
- 2026FD-CanKD: Frequency-Decoupled Cross-Attention Distillation as a Refinement Prior for Compact Object Detectors19 Aug 2026
- 2026Topology-Aware Query Selection for Surgical Instrument Instance Segmentation12 Aug 2026
- 2026Match One, Learn with Graph: One-to-Graph Query Collaboration with Backward Sharing for Object Detection6 Aug 2026
- 2026RF-HOI: Recognize Human-Object Interaction with Radio Frequency Signals31 Jul 2026
- 2026A Smart Classroom Behavior Analysis Framework with a New Highly Congested Classroom Dataset19 Jun 2026
- 2026Context-Aware Feature-Fusion for Co-occurring Object Detection in Autonomous Driving10 Jun 2026
- 2026Learned Non-Maximum Suppression for 3D Object Detection2 Jun 2026
- 2026MDS-DETR: DETR with Masked Duplicate Suppressor22 May 2026
- 2026Learned Suppression for 3D Keypoint Detection with a Graph-Transformer Backbone14 May 2026
12 newest of 297 All 297 (JSON)