mlsanityData to 14 Oct 2026

HOI Analysis: Integrating and Decomposing Human-Object Interaction

arXiv 2010.16219 ↗First posted 30 Oct 2020cs.CV cs.LG eess.IVcited by 81

Not on the map. Why?

Abstract (arXiv)

Human-Object Interaction (HOI) consists of human, object and implicit interaction/verb. Different from previous methods that directly map pixels to HOI semantics, we propose a novel perspective for HOI learning in an analytical manner. In analogy to Harmonic Analysis, whose goal is to study how to represent the signals with the superposition of basic waves, we propose the HOI Analysis. We argue that coherent HOI can be decomposed into isolated human and object. Meanwhile, isolated human and object can also be integrated into coherent HOI again. Moreover, transformations between human-object pairs with the same HOI can also be easier approached with integration and decomposition. As a result, the implicit verb will be represented in the transformation function space. In light of this, we propose an Integration-Decomposition Network (IDN) to implement the above transformations and achieve state-of-the-art performance on widely-used HOI detection benchmarks. Code is available at https://github.com/DirtyHarryLYL/HAKE-Action-Torch/tree/IDN-(Integrating-Decomposing-Network).

Key facts. Cited by 81 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 8; 2022: 22; 2023: 25; 2024: 21; 2025: 5.

81 papers.

Sort:

By area:

  1. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  2. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 120
  3. 2021Mining the Benefits of Two-stage and One-stage HOI Detectioncited by 103
  4. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  5. 2021TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrievalcited by 81
  6. 2023HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Modelscited by 61
  7. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  8. 2022RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detectioncited by 55
  9. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 47
  10. 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 45
  11. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  12. 2022Interactiveness Field in Human-Object Interactionscited by 40
38 more
  1. 2022Human-Object Interaction Detection via Disentangled Transformercited by 40
  2. 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
  3. 2023Relational Context Learning for Human-Object Interaction Detectioncited by 36
  4. 2022What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactionscited by 35
  5. 2022MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detectioncited by 34
  6. 2022Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detectioncited by 34
  7. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  8. 2022HAKE: A Knowledge Engine Foundation for Human Activity Understandingcited by 28
  9. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  10. 2024EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detectioncited by 28
  11. 2024Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detectioncited by 26
  12. 2022TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillationcited by 25
  13. 2023Neural-Logic Human-Object Interaction Detectioncited by 25
  14. 2022Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semanticscited by 22
  15. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  16. 2023From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understandingcited by 19
  17. 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Fieldcited by 17
  18. 2022Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detectioncited by 16
  19. 2022Discovering Human-Object Interaction Concepts via Self-Compositional Learningcited by 15
  20. 2023Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detectioncited by 15
  21. 2024Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Modelscited by 15
  22. 2023Unified Visual Relationship Detection with Vision and Language Modelscited by 13
  23. 2023Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detectioncited by 13
  24. 2023MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervisioncited by 12
  25. 2025Locality-Aware Zero-Shot Human-Object Interaction Detectioncited by 12
  26. 2022Beyond Object Recognition: A New Benchmark towards Object Concept Learningcited by 11
  27. 2023Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learningcited by 11
  28. 2024Groupwise Query Specialization and Quality-Aware Multi-Assignment for Transformer-based Visual Relationship Detectioncited by 11
  29. 2024Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detectioncited by 11
  30. 2022Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detectioncited by 9
  31. 2022Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detectioncited by 9
  32. 2023HODN: Disentangling Human-Object Feature for HOI Detectioncited by 9
  33. 2021GTNet:Guided Transformer Network for Detecting Human-Object Interactionscited by 8
  34. 2021Learning Single/Multi-Attribute of Object with Symmetry and Groupcited by 8
  35. 2021The Overlooked Classifier in Human-Object Interaction Recognitioncited by 8
  36. 2022SOS! Self-supervised Learning Over Sets Of Handled Objects In Egocentric Action Recognitioncited by 8
  37. 2022Distance Matters in Human-Object Interaction Detectioncited by 8
  38. 2022Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactionscited by 6

50 most cited of 81 All 81 (JSON)