mlsanityData to 7 Oct 2026

COUCH: Towards Controllable Human-Chair Interactions

arXiv 2205.00541 ↗First posted 1 May 2022cs.CVcited by 134

Not on the map. Why?

Cited by 22 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interactions in a controllable manner. Existing works on synthesizing human scene interaction focus on the high-level control of action but do not consider the fine-grained control of motion. In this work, we study the problem of synthesizing scene interactions conditioned on different contact positions on the object. As a testbed to investigate this new problem, we focus on human-chair interaction as one of the most common actions which exhibit large variability in terms of contacts. We propose a novel synthesis framework COUCH that plans ahead the motion by predicting contact-aware control signals of the hands, which are then used to synthesize contact-conditioned interactions. Furthermore, we contribute a large human-chair interaction dataset with clean annotations, the COUCH Dataset. Our method shows significant quantitative and qualitative improvements over existing methods for human-object interactions. More importantly, our method enables control of the motion through user-specified or automatically predicted contacts.

Key facts. Cited by 134 papers in the map (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 1 May 2022.

Builds on

39 of 65 references.

References · 39

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  6. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  7. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  8. 2017On human motion prediction using recurrent neural networkscited by 336
  9. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  10. 2013Learning Factored Representations in a Deep Mixture of Expertscited by 275
  11. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  12. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
27 more
  1. 2018Unity: A General Platform for Intelligent Agentscited by 232
  2. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  3. 2020Long-term Human Motion Prediction with Scene Contextcited by 191
  4. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
  5. 2021Character Controllers Using Motion VAEscited by 182
  6. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  7. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  8. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
  9. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
  10. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
  11. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  12. 2020Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenescited by 135
  13. 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
  14. 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
  15. 2019Generating 3D People in Scenes without Peoplecited by 127
  16. 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
  17. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
  18. 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
  19. 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
  20. 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
  21. 2019Context-aware Human Motion Predictioncited by 83
  22. 2019Putting Humans in a Scene: Learning Affordance in 3D Indoor Environmentscited by 72
  23. 2017Learning Human Motion Models for Long-term Predictionscited by 67
  24. 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
  25. 2019Learning to Sit: Synthesizing Human-Chair Interactions via Hierarchical Controlcited by 39
  26. 2020Hierarchical Style-based Networks for Motion Synthesiscited by 23
  27. 2021Pose2Room: Understanding 3D Scenes from Human Activitiescited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 32; 2024: 44; 2025: 36; 2026: 15.

134 papers.

Sort:

By area:

  1. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  2. 2023Object Motion Guided Human Motion Synthesiscited by 206
  3. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  4. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
  5. 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
  6. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
  7. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  8. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
  9. 2023Controllable Human-Object Interaction Synthesiscited by 107
  10. 2023Synthesizing Physical Character-Scene Interactionscited by 102
  11. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  12. 2023Human Motion Generation: A Surveycited by 95
38 more
  1. 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 91
  2. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 89
  3. 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
  4. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  5. 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
  6. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  7. 2022Full-Body Articulated Human-Object Interactioncited by 76
  8. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 72
  9. 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 69
  10. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
  11. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  12. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  13. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  14. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  15. 2024Human-Object Interaction from Human-Level Instructionscited by 62
  16. 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptionscited by 60
  17. 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
  18. 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 54
  19. 2024ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactionscited by 54
  20. 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
  21. 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
  22. 2023ContactGen: Generative Contact Modeling for Grasp Generationcited by 52
  23. 2023Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environmentscited by 51
  24. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  25. 2023Synthesizing Physically Plausible Human Motions in 3D Scenescited by 47
  26. 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
  27. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
  28. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
  29. 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
  30. 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamicscited by 43
  31. 2023I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactionscited by 42
  32. 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
  33. 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
  34. 2023Object pop-up: Can we infer 3D objects and their poses from human interactions alone?cited by 36
  35. 2024HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objectscited by 34
  36. 2024LaserHuman: Language-guided Scene-aware Human Motion Generation in Free Environmentcited by 33
  37. 2024Beyond the Contact: Discovering Comprehensive Affordance for 3D Objects from Pre-trained 2D Diffusion Modelscited by 32
  38. 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 31

50 most cited of 134 All 134 (JSON)