mlsanityData to 7 Oct 2026

DRG: Dual Relation Graph for Human-Object Interaction Detection

arXiv 2008.11714 ↗First posted 26 Aug 2020cs.CVcited by 117

Not on the map. Why?

Abstract (arXiv)

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features. In this paper, we leverage an abstract spatial-semantic representation to describe each human-object pair and aggregate the contextual information of the scene via a dual relation graph (one human-centric and one object-centric). Our proposed dual relation graph effectively captures discriminative cues from the scene to resolve ambiguity from local predictions. Our model is conceptually simple and leads to favorable results compared to the state-of-the-art HOI detection algorithms on two large-scale benchmark datasets.

Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 28; 2023: 31; 2024: 15; 2025: 12; 2026: 8.

117 papers.

Sort:

By area:

  1. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  2. 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
  3. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
  4. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 119
  5. 2022Panoptic Scene Graph Generationcited by 114
  6. 2021Mining the Benefits of Two-stage and One-stage HOI Detectioncited by 103
  7. 2021Reformulating HOI Detection as Adaptive Set Predictioncited by 95
  8. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  9. 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
  10. 2021Affordance Transfer Learning for Human-Object Interaction Detectioncited by 79
  11. 2021Object-Region Video Transformerscited by 73
  12. 2023Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Modelscited by 72
38 more
  1. 2022Teaching Structured Vision&Language Concepts to Vision&Language Modelscited by 71
  2. 2021Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detectioncited by 58
  3. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  4. 2022Multimodal learning with graphscited by 54
  5. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 46
  6. 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 44
  7. 2021Spatio-Temporal Dynamic Inference Network for Group Activity Recognitioncited by 42
  8. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  9. 2022Interactiveness Field in Human-Object Interactionscited by 40
  10. 2022Human-Object Interaction Detection via Disentangled Transformercited by 40
  11. 2023Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphscited by 39
  12. 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
  13. 2022Interaction Region Visual Transformer for Egocentric Action Anticipationcited by 36
  14. 2022What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactionscited by 35
  15. 2023Relational Context Learning for Human-Object Interaction Detectioncited by 35
  16. 2022MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detectioncited by 34
  17. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  18. 2021Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queriescited by 31
  19. 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
  20. 2021QAHOI: Query-Based Anchors for Human-Object Interaction Detectioncited by 28
  21. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  22. 2023Neural-Logic Human-Object Interaction Detectioncited by 25
  23. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  24. 2022Is an Object-Centric Video Representation Beneficial for Transfer?cited by 24
  25. 2022Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semanticscited by 22
  26. 2022Category-Aware Transformer Network for Better Human-Object Interaction Detectioncited by 22
  27. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  28. 2023Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Modelcited by 21
  29. 2023Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captionscited by 21
  30. 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
  31. 2022Iwin: Human-Object Interaction Detection via Transformer with Irregular Windowscited by 19
  32. 2022Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detectioncited by 16
  33. 2021Improving Human-Object Interaction Detection via Phrase Learning and Label Compositioncited by 15
  34. 2024Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Modelscited by 15
  35. 2022PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Datacited by 14
  36. 2024Nonverbal Interaction Detectioncited by 14
  37. 2022Video-based Human-Object Interaction Detection from Tubelet Tokenscited by 13
  38. 2023Unified Visual Relationship Detection with Vision and Language Modelscited by 13

50 most cited of 117 All 117 (JSON)