mlsanityData to 14 Oct 2026

ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection

arXiv 2109.04047 ↗First posted 9 Sep 2021cs.CV cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to low classification accuracy for these classes. Towards addressing this issue, we observe that there exist natural correlations and anti-correlations among human-object interactions. In this paper, we model the correlations as action co-occurrence matrices and present techniques to learn these priors and leverage them for more effective training, especially on rare classes. The efficacy of our approach is demonstrated experimentally, where the performance of our approach consistently improves over the state-of-the-art methods on both of the two leading HOI detection benchmark datasets, HICO-Det and V-COCO.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 56 of its 102 references that are in the map. First posted on arXiv 9 Sep 2021.

Builds on

56 of 102 references.

References · 56

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  6. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  7. 2016Learning without Forgettingcited by 2,496
  8. 2017Non-local Neural Networkscited by 2,293
  9. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  10. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  11. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 414
  12. 2020Unbiased Scene Graph Generation from Biased Trainingcited by 356
38 more
  1. 2016Visual Relationship Detection with Language Priorscited by 334
  2. 2018Graph R-CNN for Scene Graph Generationcited by 298
  3. 2017Learning to Detect Human-Object Interactionscited by 240
  4. 2018Exploring Visual Relationship for Image Captioningcited by 215
  5. 2017Detecting and Recognizing Human-Object Interactionscited by 199
  6. 2015Visual Semantic Role Labelingcited by 190
  7. 2018Learning Human-Object Interactions by Graph Parsing Neural Networkscited by 176
  8. 2017Scene Graph Generation from Objects, Phrases and Region Captionscited by 154
  9. 2019PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detectioncited by 143
  10. 2016Harnessing Deep Neural Networks with Logic Rulescited by 135
  11. 2020Visual Compositional Learning for Human-Object Interaction Detectioncited by 130
  12. 2018iCAN: Instance-Centric Attention Network for Human-Object Interaction Detectioncited by 127
  13. 2020DRG: Dual Relation Graph for Human-Object Interaction Detectioncited by 117
  14. 2020VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutionscited by 115
  15. 2017Visual Translation Embedding Network for Visual Relation Detectioncited by 112
  16. 2020Learning Human-Object Interaction Detection using Interaction Pointscited by 108
  17. 2020Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learningcited by 105
  18. 2019Scene Graph Generation with External Knowledge and Image Reconstructioncited by 102
  19. 2017Detecting Visual Relationships with Deep Relational Networkscited by 97
  20. 2020Detailed 2D-3D Joint Representation for Human-Object Interactioncited by 93
  21. 2019Pose-aware Multi-level Feature Network for Human Object Interaction Detectioncited by 88
  22. 2018Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generationcited by 78
  23. 2018Attentive Relational Networks for Mapping Images to Scene Graphscited by 73
  24. 2020Detecting Human-Object Interactions with Action Co-occurrence Priorscited by 72
  25. 2018Object Level Visual Reasoning in Videoscited by 67
  26. 2017Visual Relationship Detection with Internal and External Linguistic Knowledge Distillationcited by 61
  27. 2019Deep Contextual Attention for Human-Object Interaction Detectioncited by 54
  28. 2019Detecting Human-Object Interactions via Functional Generalizationcited by 53
  29. 2020Contextual Heterogeneous Graph Network for Human-Object Interaction Detectioncited by 50
  30. 2018LinkNet: Relational Embedding for Scene Graphcited by 45
  31. 2018Zoom-Net: Mining Deep Feature Interactions for Visual Relationship Recognitioncited by 41
  32. 2019Dense Relational Captioning: Triple-Stream Networks for Relationship-Based Captioningcited by 35
  33. 2018Interact as You Intend: Intention-Driven Human-Object Interaction Detectioncited by 30
  34. 2019Image Captioning with Very Scarce Supervised Data: Adversarial Semi-Supervised Learning Approachcited by 30
  35. 2019On Exploring Undetermined Relationships for Visual Relationship Detectioncited by 26
  36. 2017Towards Context-aware Interaction Recognitioncited by 20
  37. 2018Disjoint Multi-task Learning between Heterogeneous Human-centric Taskscited by 16
  38. 2021Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillationcited by 14

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 4; 2023: 2; 2024: 3; 2025: 1.

11 papers.

  1. 2022Generative Bias for Robust Visual Question Answeringcited by 12
  2. 2023Self-Sufficient Framework for Continuous Sign Language Recognitioncited by 11
  3. 2022Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detectioncited by 9
  4. 2022Distance Matters in Human-Object Interaction Detectioncited by 8
  5. 2022Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognitioncited by 8
  6. 2021Single-Modal Entropy based Active Learning for Visual Question Answeringcited by 6
  7. 2024Precision-Enhanced Human-Object Contact Detection via Depth-Aware Perspective Interaction and Object Texture Restorationcited by 5
  8. 2024Geometric Features Enhanced Human-Object Interaction Detectioncited by 2
  9. 2023Human Action Co-occurrence in Lifestyle Vlogs using Graph Link Predictioncited by 0
  10. 2024FreeA: Human-object Interaction Detection using Free Annotation Labelscited by 0
  11. 2025Funnel-HOI: Top-Down Perception for Zero-Shot HOI Detectioncited by 0