mlsanityData to 14 Oct 2026

No More Sibling Rivalry: Debiasing Human-Object Interaction Detection

arXiv 2509.00760 ↗First posted 31 Aug 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Detection transformers have been applied to human-object interaction (HOI) detection, enhancing the localization and recognition of human-action-object triplets in images. Despite remarkable progress, this study identifies a critical issue-"Toxic Siblings" bias-which hinders the interaction decoder's learning, as numerous similar yet distinct HOI triplets interfere with and even compete against each other both input side and output side to the interaction decoder. This bias arises from high confusion among sibling triplets/categories, where increased similarity paradoxically reduces precision, as one's gain comes at the expense of its toxic sibling's decline. To address this, we propose two novel debiasing learning objectives-"contrastive-then-calibration" and "merge-then-split"-targeting the input and output perspectives, respectively. The former samples sibling-like incorrect HOI triplets and reconstructs them into correct ones, guided by strong positional priors. The latter first learns shared features among sibling categories to distinguish them from other groups, then explicitly refines intra-group differentiation to preserve uniqueness. Experiments show that we significantly outperform both the baseline (+9.18% mAP on HICO-Det) and the state-of-the-art (+3.59% mAP) across various settings.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 68 of its 82 references that are in the map. First posted on arXiv 31 Aug 2025.

Builds on

68 of 82 references.

References · 68

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2023Segment Anythingcited by 8,234
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  8. 2020End-to-End Object Detection with Transformerscited by 7,414
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  10. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  11. 2015VQA: Visual Question Answeringcited by 2,506
  12. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
38 more
  1. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  2. 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
  3. 2017Learning to Detect Human-Object Interactionscited by 240
  4. 2017Detecting and Recognizing Human-Object Interactionscited by 199
  5. 2015Visual Semantic Role Labelingcited by 190
  6. 2018Learning Human-Object Interactions by Graph Parsing Neural Networkscited by 176
  7. 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
  8. 2019PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detectioncited by 143
  9. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
  10. 2020Visual Compositional Learning for Human-Object Interaction Detectioncited by 130
  11. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 128
  12. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 120
  13. 2020DRG: Dual Relation Graph for Human-Object Interaction Detectioncited by 117
  14. 2020VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutionscited by 115
  15. 2020Learning Human-Object Interaction Detection using Interaction Pointscited by 108
  16. 2020Detailed 2D-3D Joint Representation for Human-Object Interactioncited by 93
  17. 2020Spatially Conditioned Graphs for Detecting Human-Object Interactionscited by 93
  18. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  19. 2019Pose-aware Multi-level Feature Network for Human Object Interaction Detectioncited by 88
  20. 2023Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animatorcited by 74
  21. 2020Detecting Human-Object Interactions with Action Co-occurrence Priorscited by 72
  22. 2023HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Modelscited by 61
  23. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  24. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  25. 2022RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detectioncited by 55
  26. 2019Detecting Human-Object Interactions via Functional Generalizationcited by 53
  27. 2020Contextual Heterogeneous Graph Network for Human-Object Interaction Detectioncited by 50
  28. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 47
  29. 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 45
  30. 2023EdaDet: Open-Vocabulary Object Detection Using Early Dense Alignmentcited by 44
  31. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  32. 2020Cascaded Human-Object Interaction Recognitioncited by 40
  33. 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
  34. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  35. 2018Multi-Evidence Filtering and Fusion for Multi-Label Classification, Object Detection and Semantic Segmentation Based on Weakly Supervised Learningcited by 33
  36. 2019Cubic LSTMs for Video Predictioncited by 32
  37. 2020DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detectioncited by 31
  38. 2023UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detectioncited by 31

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

  1. 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generationcited by 2
  2. 2026Mining Instance-Centric Vision-Language Contexts for Human-Object Interaction Detectioncited by 1
  3. 2025Multimodal Graph Network Modeling for Human-Object Interaction Detection with PDE Graph Diffusioncited by 0