mlsanityData to 14 Oct 2026

Learning Human-Object Interactions by Graph Parsing Neural Networks

arXiv 1808.07962 ↗First posted 23 Aug 2018cs.CVcited by 176

Not on the map. Why?

Abstract (arXiv)

This paper addresses the task of detecting and recognizing human-object interactions (HOI) in images and videos. We introduce the Graph Parsing Neural Network (GPNN), a framework that incorporates structural knowledge while being differentiable end-to-end. For a given scene, GPNN infers a parse graph that includes i) the HOI graph structure represented by an adjacency matrix, and ii) the node labels. Within a message passing inference framework, GPNN iteratively computes the adjacency matrices and node labels. We extensively evaluate our model on three HOI detection benchmarks on images and videos: HICO-DET, V-COCO, and CAD-120 datasets. Our approach significantly outperforms state-of-art methods, verifying that GPNN is scalable to large datasets and applies to spatial-temporal settings. The code is available at https://github.com/SiyuanQi/gpnn.

Key facts. Cited by 176 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 46; 2022: 49; 2023: 37; 2024: 17; 2025: 18; 2026: 9.

176 papers.

Sort:

By area:

  1. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  2. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
  3. 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
  4. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 135
  5. 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
  6. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 120
  7. 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 115
  8. 2021Mining the Benefits of Two-stage and One-stage HOI Detectioncited by 103
  9. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 102
  10. 2021Reformulating HOI Detection as Adaptive Set Predictioncited by 95
  11. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  12. 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
38 more
  1. 2022Full-Body Articulated Human-Object Interactioncited by 78
  2. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  3. 2021Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detectioncited by 58
  4. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  5. 2022RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detectioncited by 55
  6. 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
  7. 2022Multimodal learning with graphscited by 54
  8. 2023DECO: Dense Estimation of 3D Human-Scene Contact In The Wildcited by 54
  9. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 47
  10. 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 45
  11. 2022Discovering Objects that Can Movecited by 44
  12. 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
  13. 2021Spatio-Temporal Dynamic Inference Network for Group Activity Recognitioncited by 42
  14. 2021Accelerating Large Scale Real-Time GNN Inference using Channel Pruningcited by 41
  15. 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
  16. 2023Detecting Human-Object Contact in Imagescited by 41
  17. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  18. 2022Interactiveness Field in Human-Object Interactionscited by 40
  19. 2022Human-Object Interaction Detection via Disentangled Transformercited by 40
  20. 2021Unified Graph Structured Models for Video Understandingcited by 38
  21. 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentationcited by 38
  22. 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
  23. 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 37
  24. 2022MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domaincited by 36
  25. 2023Relational Context Learning for Human-Object Interaction Detectioncited by 36
  26. 2022What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactionscited by 35
  27. 2023Video-Mined Task Graphs for Keystep Recognition in Instructional Videoscited by 35
  28. 2022MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detectioncited by 34
  29. 2022Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detectioncited by 34
  30. 2023Affordance Grounding from Demonstration Video to Target Imagecited by 34
  31. 2021Differentiable Multi-Granularity Human Representation Learning for Instance-Aware Human Semantic Parsingcited by 31
  32. 2021Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queriescited by 31
  33. 2023UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detectioncited by 31
  34. 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
  35. 2022Skeleton-Parted Graph Scattering Networks for 3D Human Motion Predictioncited by 29
  36. 2021Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspectivecited by 28
  37. 2021QAHOI: Query-Based Anchors for Human-Object Interaction Detectioncited by 28
  38. 2022HAKE: A Knowledge Engine Foundation for Human Activity Understandingcited by 28

50 most cited of 176 All 176 (JSON)