mlsanityData to 7 Oct 2026

VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutions

arXiv 2003.05541 ↗First posted 11 Mar 2020cs.CVcited by 115

Not on the map. Why?

Abstract (arXiv)

Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually. This is the main objective in Human-Object Interaction (HOI) detection task. In particular, relative spatial reasoning and structural connections between objects are essential cues for analyzing interactions, which is addressed by the proposed Visual-Spatial-Graph Network (VSGNet) architecture. VSGNet extracts visual features from the human-object pairs, refines the features with spatial configurations of the pair, and utilizes the structural connections between the pair via graph convolutions. The performance of VSGNet is thoroughly evaluated using the Verbs in COCO (V-COCO) and HICO-DET datasets. Experimental results indicate that VSGNet outperforms state-of-the-art solutions by 8% or 4 mAP in V-COCO and 16% or 3 mAP in HICO-DET.

Key facts. Cited by 115 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Mar 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 22; 2022: 26; 2023: 31; 2024: 16; 2025: 13; 2026: 7.

115 papers.

Sort:

By area:

  1. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  2. 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
  3. 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 139
  4. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
  5. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 119
  6. 2021Mining the Benefits of Two-stage and One-stage HOI Detectioncited by 103
  7. 2021Reformulating HOI Detection as Adaptive Set Predictioncited by 95
  8. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  9. 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
  10. 2021Affordance Transfer Learning for Human-Object Interaction Detectioncited by 79
  11. 2023HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Modelscited by 60
  12. 2021Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detectioncited by 58
38 more
  1. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  2. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  3. 2022Multimodal learning with graphscited by 54
  4. 2021Decoupled Dynamic Filter Networkscited by 52
  5. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 46
  6. 2022Webly Supervised Concept Expansion for General Purpose Vision Modelscited by 45
  7. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  8. 2022Interactiveness Field in Human-Object Interactionscited by 40
  9. 2022Human-Object Interaction Detection via Disentangled Transformercited by 40
  10. 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translationcited by 35
  11. 2022What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactionscited by 35
  12. 2023Relational Context Learning for Human-Object Interaction Detectioncited by 35
  13. 2022MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detectioncited by 34
  14. 2022Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detectioncited by 34
  15. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  16. 2024WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collectionscited by 33
  17. 2021In Defense of Scene Graphs for Image Captioningcited by 31
  18. 2021Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queriescited by 31
  19. 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
  20. 2021QAHOI: Query-Based Anchors for Human-Object Interaction Detectioncited by 28
  21. 2024Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detectioncited by 26
  22. 2023Neural-Logic Human-Object Interaction Detectioncited by 25
  23. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  24. 2021Exploiting Scene Graphs for Human-Object Interaction Detectioncited by 22
  25. 2022Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semanticscited by 22
  26. 2022Category-Aware Transformer Network for Better Human-Object Interaction Detectioncited by 22
  27. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  28. 2021ST-HOI: A Spatial-Temporal Baseline for Human-Object Interaction Detection in Videoscited by 20
  29. 2022Iwin: Human-Object Interaction Detection via Transformer with Irregular Windowscited by 19
  30. 2023Vision Relation Transformer for Unbiased Scene Graph Generationcited by 18
  31. 2022Geometric Features Informed Multi-person Human-object Interaction Recognition in Videoscited by 17
  32. 2022Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detectioncited by 16
  33. 2021Improving Human-Object Interaction Detection via Phrase Learning and Label Compositioncited by 15
  34. 2023Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detectioncited by 15
  35. 2024Nonverbal Interaction Detectioncited by 14
  36. 2022Video-based Human-Object Interaction Detection from Tubelet Tokenscited by 13
  37. 2023Unified Visual Relationship Detection with Vision and Language Modelscited by 13
  38. 2023Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detectioncited by 13

50 most cited of 115 All 115 (JSON)