A Deep Emulator for Secondary Motion of 3D Characters
Not on the map. Why?
Abstract (arXiv)
Fast and light-weight methods for animating 3D characters are desirable in various applications such as computer games. We present a learning-based approach to enhance skinning-based animations of 3D characters with vivid secondary motion effects. We design a neural network that encodes each local patch of a character simulation mesh where the edges implicitly encode the internal forces between the neighboring vertices. The network emulates the ordinary differential equations of the character dynamics, predicting new vertex positions from the current accelerations, velocities and positions. Being a local method, our network is independent of the mesh topology and generalizes to arbitrarily shaped 3D character meshes at test time. We further represent per-vertex constraints and material properties such as stiffness, enabling us to easily adjust the dynamics in different parts of the mesh. We evaluate our method on various character meshes and complex motion sequences. Our method can be over 30 times more efficient than ground-truth physically based simulation, and outperforms alternative solutions that provide fast approximations.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 10 of its 29 references that are in the map. First posted on arXiv 1 Mar 2021.
Builds on
10 of 29 references.
References · 10
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2018Graph networks as learnable physics engines for inference and controlcited by 242
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
- 2020SoftSMPL: Data-driven Modeling of Nonlinear Soft-tissue Dynamics for Parametric Humanscited by 17
- 2019Realtime Simulation of Thin-Shell Deformable Materials using CNN-Based Mesh Embeddingcited by 9
- 2020Complementary Dynamicscited by 8
- 2020Alternating ConvLSTM: Learning Force Propagation with Alternate State Updatescited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 2; 2024: 5; 2025: 1; 2026: 2.
16 papers.
Sort:
- 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
- 2022Thermodynamics-informed graph neural networkscited by 31
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2023Data-Free Learning of Reduced-Order Kinematicscited by 19
- 2024A review of graph neural network applications in mechanics-related domainscited by 14
- 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformationcited by 11
- 2024Temporal Residual Jacobians For Rig-free Motion Transfercited by 6
- 2025PoissonNet: A Local-Global Approach for Learning on Surfacescited by 6
- 2021Active Learning of Neural Collision Handler for Complex 3D Mesh Deformationscited by 5
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animationcited by 5
- 2022AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modelingcited by 3
- 2022Analytically Integratable Zero-restlength Springs for Capturing Dynamic Modes unrepresented by Quasistatic Neural Networkscited by 2
4 more
- 2024A Neural-Network-Based Approach for Loose-Fitting Clothingcited by 2
- 2022Attention is All They Need: Exploring the Media Archaeology of the Computer Vision Research Papercited by 1
- 2026Momentum-Conserving Graph Neural Networks for Deformable Objectscited by 0
- 2026Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshescited by 0
- 2026Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshes27 Jul 2026
- 2026Momentum-Conserving Graph Neural Networks for Deformable Objects28 Apr 2026
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2024Temporal Residual Jacobians For Rig-free Motion Transfer20 Jul 2024
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animation15 Jul 2024
- 2024A review of graph neural network applications in mechanics-related domains10 Jul 2024
- 2024A Neural-Network-Based Approach for Loose-Fitting Clothing25 Apr 2024
- 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformation14 Mar 2024
- 2023Data-Free Learning of Reduced-Order Kinematics5 May 2023
- 2023TextDeformer: Geometry Manipulation using Text Guidance26 Apr 2023
- 2022Attention is All They Need: Exploring the Media Archaeology of the Computer Vision Research Paper22 Sep 2022
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshes5 May 2022
4 more
- 2022AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modeling25 Mar 2022
- 2022Thermodynamics-informed graph neural networks3 Mar 2022
- 2022Analytically Integratable Zero-restlength Springs for Capturing Dynamic Modes unrepresented by Quasistatic Neural Networks25 Jan 2022
- 2021Active Learning of Neural Collision Handler for Complex 3D Mesh Deformations8 Oct 2021
- 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
- 2022Thermodynamics-informed graph neural networkscited by 31
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2023Data-Free Learning of Reduced-Order Kinematicscited by 19
- 2024A review of graph neural network applications in mechanics-related domainscited by 14
- 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformationcited by 11
- 2024Temporal Residual Jacobians For Rig-free Motion Transfercited by 6
- 2025PoissonNet: A Local-Global Approach for Learning on Surfacescited by 6
- 2021Active Learning of Neural Collision Handler for Complex 3D Mesh Deformationscited by 5
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animationcited by 5
- 2022AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modelingcited by 3
- 2022Analytically Integratable Zero-restlength Springs for Capturing Dynamic Modes unrepresented by Quasistatic Neural Networkscited by 2
12 most cited of 16 All 16 (JSON)
- 2026Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshes27 Jul 2026
- 2026Momentum-Conserving Graph Neural Networks for Deformable Objects28 Apr 2026
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2024Temporal Residual Jacobians For Rig-free Motion Transfer20 Jul 2024
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animation15 Jul 2024
- 2024A review of graph neural network applications in mechanics-related domains10 Jul 2024
- 2024A Neural-Network-Based Approach for Loose-Fitting Clothing25 Apr 2024
- 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformation14 Mar 2024
- 2023Data-Free Learning of Reduced-Order Kinematics5 May 2023
- 2023TextDeformer: Geometry Manipulation using Text Guidance26 Apr 2023
- 2022Attention is All They Need: Exploring the Media Archaeology of the Computer Vision Research Paper22 Sep 2022
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshes5 May 2022
12 newest of 16 All 16 (JSON)