mlsanityData to 14 Oct 2026

Spatially Conditioned Graphs for Detecting Human-Object Interactions

arXiv 2012.06060 ↗First posted 11 Dec 2020cs.CV cs.AI cs.LGcited by 93

Not on the map. Why?

Abstract (arXiv)

We address the problem of detecting human-object interactions in images using graphical neural networks. Unlike conventional methods, where nodes send scaled but otherwise identical messages to each of their neighbours, we propose to condition messages between pairs of nodes on their spatial relationships, resulting in different messages going to neighbours of the same node. To this end, we explore various ways of applying spatial conditioning under a multi-branch structure. Through extensive experimentation we demonstrate the advantages of spatial conditioning for the computation of the adjacency structure, messages and the refined graph features. In particular, we empirically show that as the quality of the bounding boxes increases, their coarse appearance features contribute relatively less to the disambiguation of interactions compared to the spatial information. Our method achieves an mAP of 31.33% on HICO-DET and 54.2% on V-COCO, significantly outperforming state-of-the-art on fine-tuned detections.

Key facts. Cited by 93 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 5; 2022: 11; 2023: 27; 2024: 24; 2025: 18; 2026: 8.

93 papers.

Sort:

By area:

  1. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 120
  2. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  3. 2023HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Modelscited by 61
  4. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  5. 2022Multimodal learning with graphscited by 54
  6. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 47
  7. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  8. 2022Interactiveness Field in Human-Object Interactionscited by 40
  9. 2022Human-Object Interaction Detection via Disentangled Transformercited by 40
  10. 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
  11. 2024Knowledge Composition using Task Vectors with Learned Anisotropic Scalingcited by 37
  12. 2023Relational Context Learning for Human-Object Interaction Detectioncited by 36
38 more
  1. 2022What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactionscited by 35
  2. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  3. 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
  4. 2021QAHOI: Query-Based Anchors for Human-Object Interaction Detectioncited by 28
  5. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  6. 2024EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detectioncited by 28
  7. 2024Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detectioncited by 26
  8. 2023Neural-Logic Human-Object Interaction Detectioncited by 25
  9. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  10. 2023Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Modelcited by 22
  11. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  12. 2023Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captionscited by 21
  13. 2022Iwin: Human-Object Interaction Detection via Transformer with Irregular Windowscited by 19
  14. 2022Collaborative Transformers for Grounded Situation Recognitioncited by 19
  15. 2024Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognitioncited by 17
  16. 2023Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detectioncited by 15
  17. 2024Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Modelscited by 15
  18. 2023Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detectioncited by 13
  19. 2025Locality-Aware Zero-Shot Human-Object Interaction Detectioncited by 12
  20. 2025HOLa: Zero-Shot HOI Detection with Low-Rank Decomposed VLM Feature Adaptationcited by 12
  21. 2023Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learningcited by 11
  22. 2023Diagnosing Human-object Interaction Detectorscited by 11
  23. 2021Dyadic Human Motion Predictioncited by 9
  24. 2022Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detectioncited by 9
  25. 2021The Overlooked Classifier in Human-Object Interaction Recognitioncited by 8
  26. 2022Distance Matters in Human-Object Interaction Detectioncited by 8
  27. 2023Agglomerative Transformer for Human-Object Interaction Detectioncited by 8
  28. 2024Instrument-tissue Interaction Detection Framework for Surgical Video Understandingcited by 8
  29. 2025Open-Vocabulary HOI Detection with Interaction-aware Prompt and Concept Calibrationcited by 8
  30. 2024Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detectioncited by 7
  31. 2023Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priorscited by 6
  32. 2024A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gapcited by 6
  33. 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Predictioncited by 6
  34. 2023Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple Levelscited by 5
  35. 2024CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generationcited by 5
  36. 2024A Review of Human-Object Interaction Detectioncited by 5
  37. 2025CrossHOI-Bench: A Unified Benchmark for HOI Evaluation across Vision-Language Models and HOI-Specific Methodscited by 5
  38. 2025Learning Human-Object Interaction as Groupscited by 5

50 most cited of 93 All 93 (JSON)