mlsanityData to 7 Oct 2026

SemGeoMo: Dynamic Contextual Human Motion Generation with Semantic and Geometric Guidance

arXiv 2503.01291 ↗First posted 3 Mar 2025cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

Generating reasonable and high-quality human interactive motions in a given dynamic environment is crucial for understanding, modeling, transferring, and applying human behaviors to both virtual and physical robots. In this paper, we introduce an effective method, SemGeoMo, for dynamic contextual human motion generation, which fully leverages the text-affordance-joint multi-level semantic and geometric guidance in the generation process, improving the semantic rationality and geometric correctness of generative motions. Our method achieves state-of-the-art performance on three datasets and demonstrates superior generalization capability for diverse interaction scenarios. The project page and code can be found at https://4dvlab.github.io/project_page/semgeomo/.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 3 Mar 2025.

Builds on

40 of 48 references.

References · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2022Human Motion Diffusion Modelcited by 1,062
  7. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  8. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  9. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  10. 2023Human Motion Diffusion as a Generative Priorcited by 354
  11. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
  12. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
28 more
  1. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  2. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 237
  3. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  4. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  5. 2023Object Motion Guided Human Motion Synthesiscited by 206
  6. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  7. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  8. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
  9. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
  10. 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
  11. 2020Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenescited by 135
  12. 2023Controllable Human-Object Interaction Synthesiscited by 107
  13. 2019Efficient Learning on Point Clouds with Basis Point Setscited by 101
  14. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  15. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 93
  16. 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 91
  17. 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
  18. 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
  19. 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordancecited by 79
  20. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  21. 2022Full-Body Articulated Human-Object Interactioncited by 76
  22. 2022NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactionscited by 67
  23. 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 66
  24. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  25. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  26. 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
  27. 2023I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactionscited by 42
  28. 2024LaserHuman: Language-guided Scene-aware Human Motion Generation in Free Environmentcited by 33

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 10.

16 papers.

Sort:

By area:

  1. 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 10
  2. 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
  3. 2025GenHOI: Generalizing Text-driven 4D Human-Object Interaction Synthesis for Unseen Objectscited by 7
  4. 2025EgoReAct: Egocentric Video-Driven 3D Human Reaction Generationcited by 7
  5. 20253D Human Interaction Generation: A Surveycited by 6
  6. 2025Uni-Inter: Unifying 3D Human Motion Synthesis Across Diverse Interaction Contextscited by 4
  7. 2026InfBaGel: Human-Object-Scene Interaction Generation with Dynamic Perception and Iterative Refinementcited by 3
  8. 2025MoReact: Generating Reactive Motion from Textual Descriptionscited by 2
  9. 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generationcited by 2
  10. 2026ViHOI: Human-Object Interaction Synthesis with Visual Priorscited by 2
  11. 2026Uni-HOI:A Unified framework for Learning the Joint distribution of Text and Human-Object Interactioncited by 1
  12. 2026HOIMask: Towards Generative Masked Modeling for Human Object Interaction Generationcited by 1
4 more
  1. 2026Dynamic Full-body Motion Agent with Object Interaction via Blending Pre-trained Modular Controllerscited by 0
  2. 2026Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physicscited by 0
  3. 2026DeSeG: Decoupling Semantic Intent and Geometric Constraints for Physically Plausible Human-Scene Interactioncited by 0
  4. 2026Efficient Human-Contact Representation for Human-Scene Interactioncited by 0