Unleashing Guidance Without Classifiers for Human-Object Interaction Animation
Not on the map. Why?
Abstract (arXiv)
Generating realistic human-object interaction (HOI) animations remains challenging because it requires jointly modeling dynamic human actions and diverse object geometries. Prior diffusion-based approaches often rely on hand-crafted contact priors or human-imposed kinematic constraints to improve contact quality. We propose LIGHT, a data-driven alternative in which guidance emerges from the denoising pace itself, reducing dependence on manually designed priors. Building on diffusion forcing, we factor the representation into modality-specific components and assign individualized noise levels with asynchronous denoising schedules. In this paradigm, cleaner components guide noisier ones through cross-attention, yielding guidance without auxiliary classifiers. We find that this data-driven guidance is inherently contact-aware, and can be enhanced when training is augmented with a broad spectrum of synthetic object geometries, encouraging invariance of contact semantics to geometric diversity. Extensive experiments show that pace-induced guidance more effectively mirrors the benefits of contact priors than conventional classifier-free guidance, while achieving higher contact fidelity, more realistic HOI generation, and stronger generalization to unseen objects and tasks.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 80 of its 88 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
80 of 88 references.
References · 80
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
38 more
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2023Object Motion Guided Human Motion Synthesiscited by 212
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
- 2021Stochastic Scene-Aware Motion Predictioncited by 203
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2020Long-term Human Motion Prediction with Scene Contextcited by 192
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
- 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 144
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
- 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
- 2023Controllable Human-Object Interaction Synthesiscited by 109
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
- 2019Efficient Learning on Point Clouds with Basis Point Setscited by 103
- 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 93
- 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 93
- 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 91
- 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 86
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026HandX: Scaling Bimanual Motion and Interaction Generationcited by 2
- 2026Dex2HOI: Dexterous Bimanual Two-Object Interaction Generationcited by 2
- 2026HOIMask: Towards Generative Masked Modeling for Human Object Interaction Generationcited by 2
- 2026Harnessing Coupled Stream Completion For Human-Object Interaction Modelingcited by 0
- 2026PAMI: Part Anchored Motion for Text to Human-Object Interaction Generationcited by 0
- 2026Scalable Multi-Human Cooperative Manipulation via Commander-Executor Coordinationcited by 0
- 2026Scalable Multi-Human Cooperative Manipulation via Commander-Executor Coordination10 Oct 2026
- 2026PAMI: Part Anchored Motion for Text to Human-Object Interaction Generation29 Sep 2026
- 2026Harnessing Coupled Stream Completion For Human-Object Interaction Modeling26 Sep 2026
- 2026HOIMask: Towards Generative Masked Modeling for Human Object Interaction Generation15 Aug 2026
- 2026Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation28 May 2026
- 2026HandX: Scaling Bimanual Motion and Interaction Generation30 Mar 2026