mlsanityData to 14 Oct 2026

Detecting Human-Object Interactions via Functional Generalization

arXiv 1904.03181 ↗First posted 5 Apr 2019cs.CVcited by 53

Not on the map. Why?

Abstract (arXiv)

We present an approach for detecting human-object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data, visual features of the human, relative spatial orientation of the human and the object, and the knowledge that functionally similar objects take part in similar interactions with humans. We provide extensive experimental validation for our approach and demonstrate state-of-the-art results for HOI detection. On the HICO-Det dataset our method achieves a gain of over 2.5% absolute points in mean average precision (mAP) over state-of-the-art. We also show that our approach leads to significant performance gains for zero-shot HOI detection in the seen object setting. We further demonstrate that using a generic object detector, our model can generalize to interactions involving previously unseen objects.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 11; 2022: 10; 2023: 14; 2024: 9; 2025: 7; 2026: 2.

53 papers.

Sort:

By area:

  1. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  2. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 135
  3. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 120
  4. 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
  5. 2023HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Modelscited by 61
  6. 2022MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detectioncited by 34
  7. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  8. 2021Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queriescited by 31
  9. 2023UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detectioncited by 31
  10. 2022End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillationcited by 30
  11. 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
  12. 2021QAHOI: Query-Based Anchors for Human-Object Interaction Detectioncited by 28
38 more
  1. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  2. 2024EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detectioncited by 28
  3. 2024Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detectioncited by 26
  4. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  5. 2022Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semanticscited by 22
  6. 2023Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Modelcited by 22
  7. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  8. 2023From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understandingcited by 19
  9. 2023MOST: Multiple Object localization with Self-supervised Transformers for object discoverycited by 17
  10. 2021Improving Human-Object Interaction Detection via Phrase Learning and Label Compositioncited by 15
  11. 2022Discovering Human-Object Interaction Concepts via Self-Compositional Learningcited by 15
  12. 2023Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detectioncited by 13
  13. 2025HOLa: Zero-Shot HOI Detection with Low-Rank Decomposed VLM Feature Adaptationcited by 12
  14. 2021ACP++: Action Co-occurrence Priors for Human-Object Interaction Detectioncited by 11
  15. 2024Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detectioncited by 11
  16. 2022Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detectioncited by 9
  17. 2022Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detectioncited by 9
  18. 2023HODN: Disentangling Human-Object Feature for HOI Detectioncited by 9
  19. 2021GTNet:Guided Transformer Network for Detecting Human-Object Interactionscited by 8
  20. 2021The Overlooked Classifier in Human-Object Interaction Recognitioncited by 8
  21. 2025Open-Vocabulary HOI Detection with Interaction-aware Prompt and Concept Calibrationcited by 8
  22. 2024A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gapcited by 6
  23. 2023Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple Levelscited by 5
  24. 2025An Image-like Diffusion Method for Human-Object Interaction Detectioncited by 5
  25. 2024Towards Zero-shot Human-Object Interaction Detection via Vision-Language Integrationcited by 4
  26. 2023Enhancing HOI Detection with Contextual Cues from Large Vision-Language Modelscited by 3
  27. 2025No More Sibling Rivalry: Debiasing Human-Object Interaction Detectioncited by 3
  28. 2022Effective Actor-centric Human-object Interaction Detectioncited by 2
  29. 2023Parallel Reasoning Network for Human-Object Interaction Detectioncited by 2
  30. 2023Compositional Learning in Transformer-Based Human-Object Interaction Detectioncited by 2
  31. 2024Towards Flexible Visual Relationship Segmentationcited by 2
  32. 2021Distillation of Human-Object Interaction Contexts for Action Recognitioncited by 1
  33. 2026Zero-shot HOI Detection with MLLM-based Detector-agnostic Interaction Recognitioncited by 1
  34. 2021Put the Bear on the Chair! Intelligent Robot Interaction with Previously Unseen Chairs via Robot Imaginationcited by 0
  35. 2022The Overlooked Classifier in Human-Object Interaction Recognitioncited by 0
  36. 2022Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detectioncited by 0
  37. 2024Efficient Human-Object-Interaction (EHOI) Detection via Interaction Label Coding and Conditional Decisioncited by 0
  38. 2025Generalized Visual Relation Detection with Diffusion Modelscited by 0

50 most cited of 53 All 53 (JSON)