Self-Intersection-Aware 3D Human Motion Generation Using an Efficient Human Sphere Proxy
Not on the map. Why?
Abstract (arXiv)
Human motion generation has made tremendous progress in recent years, with state-of-the-art approaches surpassing ground truth data in leading evaluation benchmarks. However, visual inspection of the generated motions paints a different picture. Even state-of-the-art approaches generate motions frequently containing self-intersections, i.e., body parts interpenetrating, which are strong artifacts, severely limiting the perceived motion quality. We introduce a novel loss, which explicitly penalizes self-intersections, to the training of human motion generation methods. We base our loss on a sphere proxy of human geometry, which allows us to calculate a self-intersection loss 98% faster and uses 83% less memory than comparable methods based on triangular meshes. The loss is agnostic to the specific approach, and we add it to the training of the recent human motion generation methods human motion diffusion model (MDM) and MoMask. Our extensive experiments show a reduction of self-intersections in generated motions of up to 49% while improving other evaluation metrics. The code is available at https://github.com/boschresearch/humansphereproxy .
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 55 of its 67 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
55 of 67 references.
References · 55
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2017Neural Discrete Representation Learningcited by 4,650
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022Human Motion Diffusion Modelcited by 1,062
38 more
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2017Learning from Synthetic Humanscited by 358
- 2023Human Motion Diffusion as a Generative Priorcited by 354
- 2016The KIT Motion-Language Datasetcited by 334
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 188
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
- 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 62
- 2022Implicit Neural Representations for Variable Length Human Motion Generationcited by 61
- 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
- 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
- 2024ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesiscited by 41
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Towards 3D-Aware Video Diffusion Models: Render-Free Human Motion Control with Mesh Tokenization
- 2025Unconditional Human Motion and Shape Generation via Balanced Score-Based Diffusion
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models
- 2026Riemannian Motion Generation: A Unified Framework for Human Motion Representation and Generation via Riemannian Flow Matching
- 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models
- 2023DiffMesh: A Motion-aware Diffusion Framework for Human Mesh Recovery from Videos
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition