Learning to Sit: Synthesizing Human-Chair Interactions via Hierarchical Control
Not on the map. Why?
Abstract (arXiv)
Recent progress on physics-based character animation has shown impressive breakthroughs on human motion synthesis, through imitating motion capture data via deep reinforcement learning. However, results have mostly been demonstrated on imitating a single distinct motion pattern, and do not generalize to interactive tasks that require flexible motion patterns due to varying human-object spatial configurations. To bridge this gap, we focus on one class of interactive tasks -- sitting onto a chair. We propose a hierarchical reinforcement learning framework which relies on a collection of subtask controllers trained to imitate simple, reusable mocap motions, and a meta controller trained to execute the subtasks properly to complete the main task. We experimentally demonstrate the strength of our approach over different non-hierarchical and hierarchical baselines. We also show that our approach can be applied to motion prediction given an image input. A supplementary video can be found at https://youtu.be/3CeN0OGz2cA.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 2; 2023: 10; 2024: 11; 2025: 7; 2026: 3.
39 papers.
Sort:
By area:
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2021Stochastic Scene-Aware Motion Predictioncited by 203
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
- 2023Synthesizing Physical Character-Scene Interactionscited by 102
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2021From Motor Control to Team Play in Simulated Humanoid Footballcited by 87
- 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
- 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordancecited by 79
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
27 more
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
- 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
- 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
- 2023Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environmentscited by 51
- 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
- 2023Synthesizing Physically Plausible Human Motions in 3D Scenescited by 47
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamicscited by 43
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 31
- 2023GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistencycited by 26
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
- 2021Pose2Room: Understanding 3D Scenes from Human Activitiescited by 22
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Imagecited by 20
- 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactionscited by 18
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 14
- 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policycited by 10
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
- 2024FORCE: Physics-aware Human-object Interactioncited by 7
- 20253D Human Interaction Generation: A Surveycited by 6
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 4
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 2
- 2025Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoningcited by 2
- 2025CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitivescited by 0
- 2026Policy-Induced Hand Priors in Humanoid Dual-Arm Manipulation: Diagnosing and Mitigating Initial-Pose Dependencecited by 0
- 2026Policy-Induced Hand Priors in Humanoid Dual-Arm Manipulation: Diagnosing and Mitigating Initial-Pose Dependence12 Aug 2026
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size9 Mar 2026
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions5 Feb 2026
- 2025CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitives16 Dec 2025
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation11 Sep 2025
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization25 Mar 2025
- 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policy24 Mar 2025
- 20253D Human Interaction Generation: A Survey17 Mar 2025
- 2025Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoning10 Mar 2025
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions27 Feb 2025
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking23 Dec 2024
- 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactions9 Dec 2024
27 more
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Model9 Oct 2024
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models30 Sep 2024
- 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics20 Jun 2024
- 2024Generating Human Motion in 3D Scenes from Text Descriptions13 May 2024
- 2024Generating Human Interaction Motions in Scenes with Text Control16 Apr 2024
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction28 Mar 2024
- 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance26 Mar 2024
- 2024FORCE: Physics-aware Human-object Interaction17 Mar 2024
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Intervention17 Mar 2024
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct 2023
- 2023Object Motion Guided Human Motion Synthesis28 Sep 2023
- 2023Physically Plausible Full-Body Hand-Object Interaction Synthesis14 Sep 2023
- 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation7 Sep 2023
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion31 Aug 2023
- 2023GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency22 Aug 2023
- 2023Synthesizing Physically Plausible Human Motions in 3D Scenes17 Aug 2023
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis14 Jul 2023
- 2023Synthesizing Physical Character-Scene Interactions2 Feb 2023
- 2023Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments9 Jan 2023
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes18 Oct 2022
- 2022COUCH: Towards Controllable Human-Chair Interactions1 May 2022
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping21 Dec 2021
- 2021Pose2Room: Understanding 3D Scenes from Human Activities1 Dec 2021
- 2021Stochastic Scene-Aware Motion Prediction18 Aug 2021
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation10 Jun 2021
- 2021From Motor Control to Team Play in Simulated Humanoid Football25 May 2021
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image20 May 2021
- 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
- 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordancecited by 79
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 2
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Model9 Oct 2024
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models30 Sep 2024
- 2024Generating Human Interaction Motions in Scenes with Text Control16 Apr 2024
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction28 Mar 2024
- 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance26 Mar 2024
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Intervention17 Mar 2024
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct 2023
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis14 Jul 2023
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2021Stochastic Scene-Aware Motion Predictioncited by 203
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
- 2023Synthesizing Physical Character-Scene Interactionscited by 102
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2021From Motor Control to Team Play in Simulated Humanoid Footballcited by 87
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
- 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
- 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
12 most cited of 29 All 29 (JSON)
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size9 Mar 2026
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions5 Feb 2026
- 2025CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitives16 Dec 2025
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation11 Sep 2025
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization25 Mar 2025
- 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policy24 Mar 2025
- 20253D Human Interaction Generation: A Survey17 Mar 2025
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions27 Feb 2025
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking23 Dec 2024
- 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactions9 Dec 2024
- 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics20 Jun 2024
- 2024Generating Human Motion in 3D Scenes from Text Descriptions13 May 2024
12 newest of 29 All 29 (JSON)