mlsanityData to 7 Oct 2026

Interactiveness Field in Human-Object Interactions

arXiv 2204.07718 ↗First posted 16 Apr 2022cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

Human-Object Interaction (HOI) detection plays a core role in activity understanding. Though recent two/one-stage methods have achieved impressive results, as an essential step, discovering interactive human-object pairs remains challenging. Both one/two-stage methods fail to effectively extract interactive pairs instead of generating redundant negative pairs. In this work, we introduce a previously overlooked interactiveness bimodal prior: given an object in an image, after pairing it with the humans, the generated pairs are either mostly non-interactive, or mostly interactive, with the former more frequent than the latter. Based on this interactiveness bimodal prior we propose the "interactiveness field". To make the learned field compatible with real HOI image considerations, we propose new energy constraints based on the cardinality and difference in the inherent "interactiveness field" underlying interactive versus non-interactive pairs. Consequently, our method can detect more precise pairs and thus significantly boost HOI detection performance, which is validated on widely-used benchmarks where we achieve decent improvements over state-of-the-arts. Our code is available at https://github.com/Foruck/Interactiveness-Field.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 16 Apr 2022.

Builds on

37 of 50 references.

References · 37

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2019Objects as Pointscited by 1,172
  4. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  5. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
  6. 2017Learning to Detect Human-Object Interactionscited by 238
  7. 2017Detecting and Recognizing Human-Object Interactionscited by 199
  8. 2015Visual Semantic Role Labelingcited by 188
  9. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  10. 2018Learning Human-Object Interactions by Graph Parsing Neural Networkscited by 176
  11. 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
  12. 2019PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detectioncited by 143
25 more
  1. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
  2. 2020Visual Compositional Learning for Human-Object Interaction Detectioncited by 129
  3. 2018iCAN: Instance-Centric Attention Network for Human-Object Interaction Detectioncited by 126
  4. 2020DRG: Dual Relation Graph for Human-Object Interaction Detectioncited by 117
  5. 2020VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutionscited by 115
  6. 2020Learning Human-Object Interaction Detection using Interaction Pointscited by 108
  7. 2021Mining the Benefits of Two-stage and One-stage HOI Detectioncited by 103
  8. 2021Reformulating HOI Detection as Adaptive Set Predictioncited by 95
  9. 2020Detailed 2D-3D Joint Representation for Human-Object Interactioncited by 93
  10. 2020Spatially Conditioned Graphs for Detecting Human-Object Interactionscited by 93
  11. 2019Pose-aware Multi-level Feature Network for Human Object Interaction Detectioncited by 88
  12. 2020HOI Analysis: Integrating and Decomposing Human-Object Interactioncited by 81
  13. 2020PaStaNet: Toward Human Activity Knowledge Enginecited by 79
  14. 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
  15. 2021Affordance Transfer Learning for Human-Object Interaction Detectioncited by 79
  16. 2020Detecting Human-Object Interactions with Action Co-occurrence Priorscited by 72
  17. 2021Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detectioncited by 58
  18. 2020Contextual Heterogeneous Graph Network for Human-Object Interaction Detectioncited by 50
  19. 2019HAKE: Human Activity Knowledge Enginecited by 32
  20. 2022HAKE: A Knowledge Engine Foundation for Human Activity Understandingcited by 28
  21. 2020LSD-C: Linearly Separable Deep Clusterscited by 16
  22. 2016Beyond Holistic Object Recognition: Enriching Image Understanding with Part Statescited by 13
  23. 2022Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detectioncited by 9
  24. 2018No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training Techniquescited by 8
  25. 2018Detecting unseen visual relations using analogiescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 18; 2024: 12; 2025: 5; 2026: 2.

40 papers.

Sort:

By area:

  1. 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 44
  2. 2022Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detectioncited by 34
  3. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  4. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  5. 2024EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detectioncited by 28
  6. 2024Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detectioncited by 26
  7. 2023Neural-Logic Human-Object Interaction Detectioncited by 25
  8. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  9. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  10. 2023Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Modelcited by 21
  11. 2023From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understandingcited by 19
  12. 2024Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Modelscited by 15
28 more
  1. 2023Unified Visual Relationship Detection with Vision and Language Modelscited by 13
  2. 2023Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detectioncited by 13
  3. 2022Beyond Object Recognition: A New Benchmark towards Object Concept Learningcited by 11
  4. 2023Diagnosing Human-object Interaction Detectorscited by 11
  5. 2024CYCLO: Cyclic Graph Transformer Approach to Multi-Object Relationship Modeling in Aerial Videoscited by 11
  6. 2023Agglomerative Transformer for Human-Object Interaction Detectioncited by 8
  7. 2024Simultaneous Detection and Interaction Reasoning for Object-Centric Action Recognitioncited by 8
  8. 2023Primitive-based 3D Human-Object Interaction Modelling and Programmingcited by 7
  9. 2025Open-Vocabulary HOI Detection with Interaction-aware Prompt and Concept Calibrationcited by 7
  10. 2022Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactionscited by 6
  11. 2024A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gapcited by 6
  12. 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generationcited by 6
  13. 2023Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple Levelscited by 5
  14. 2024CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generationcited by 5
  15. 2023Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisorcited by 4
  16. 2023Improving Human-Object Interaction Detection via Virtual Image Learningcited by 4
  17. 2024UAHOI: Uncertainty-aware Robust Interaction Learning for HOI Detectioncited by 4
  18. 2023Enhancing HOI Detection with Contextual Cues from Large Vision-Language Modelscited by 3
  19. 2023Few-Shot Learning from Augmented Label-Uncertain Queries in Bongard-HOIcited by 3
  20. 2024Towards Zero-shot Human-Object Interaction Detection via Vision-Language Integrationcited by 3
  21. 2025SGC-Net: Stratified Granular Comparison Network for Open-Vocabulary HOI Detectioncited by 3
  22. 2025DQEN: Dual Query Enhancement Network for DETR-based HOI Detectioncited by 1
  23. 2025Mitigating Long-Tail Bias in HOI Detection via Adaptive Diversity Cachecited by 1
  24. 2023Mining Conditional Part Semantics with Occluded Extrapolation for Human-Object Interaction Detectioncited by 0
  25. 2023Disentangled Interaction Representation for One-Stage Human-Object Interaction Detectioncited by 0
  26. 2024An analysis of HOI: using a training-free method with multimodal visual foundation models when only the test set is available, without the training setcited by 0
  27. 2025Contextualized Representation Learning for Effective Human-Object Interaction Detectioncited by 0
  28. 2026A Study of Failure Modes in Two-Stage Human-Object Interaction Detectioncited by 0