UniHOI: Unified Human-Object Interaction Understanding via Unified Token Space
Not on the map. Why?
Abstract (arXiv)
In the field of human-object interaction (HOI), detection and generation are two dual tasks that have traditionally been addressed separately, hindering the development of comprehensive interaction understanding. To address this, we propose UniHOI, which jointly models HOI detection and generation via a unified token space, thereby effectively promoting knowledge sharing and enhancing generalization. Specifically, we introduce a symmetric interaction-aware attention module and a unified semi-supervised learning paradigm, enabling effective bidirectional mapping between images and interaction semantics even under limited annotations. Extensive experiments demonstrate that UniHOI achieves state-of-the-art performance in both HOI detection and generation. Specifically, UniHOI improves accuracy by 4.9% on long-tailed HOI detection and boosts interaction metrics by 42.0% on open-vocabulary generation tasks.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 19 Nov 2025.
Builds on
20 of 34 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
8 more
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
- 2020Visual Compositional Learning for Human-Object Interaction Detectioncited by 130
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
- 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
- 2024LAION-SG: An Enhanced Large-Scale Dataset for Training Complex Image-Text Models with Structural Annotationscited by 12
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Modelscited by 21
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
- 2026GaitProtector: Impersonation-Driven Gait De-Identification via Training-Free Diffusion Latent Optimizationcited by 1
- 2026SynGR: Unleashing the Potential of Cross-Modal Synergy for Generative Recommendationcited by 1
- 2026Grounding Multi-Hop Reasoning in Structural Causal Models via Group Relative Policy Optimizationcited by 0
- 2026Demystifying the Optimal Fair Classifier in Multi-Class Classificationcited by 0
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoningcited by 0
- 2026UniJEPA: A Unified Joint-Embedding Predictive Architecture for Task-Agnostic Visual World Modelingcited by 0
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policiescited by 0
- 2026HEIR: Learning Human-Entity Interactions with Functional Rolescited by 0
- 2026HEIR: Learning Human-Entity Interactions with Functional Roles28 Sep 2026
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies15 Aug 2026
- 2026UniJEPA: A Unified Joint-Embedding Predictive Architecture for Task-Agnostic Visual World Modeling7 Aug 2026
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning1 Aug 2026
- 2026Demystifying the Optimal Fair Classifier in Multi-Class Classification30 May 2026
- 2026SynGR: Unleashing the Potential of Cross-Modal Synergy for Generative Recommendation18 May 2026
- 2026GaitProtector: Impersonation-Driven Gait De-Identification via Training-Free Diffusion Latent Optimization12 May 2026
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality7 May 2026
- 2026Grounding Multi-Hop Reasoning in Structural Causal Models via Group Relative Policy Optimization2 May 2026
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Models7 Jan 2026