Active Learning of Neural Collision Handler for Complex 3D Mesh Deformations
Not on the map. Why?
Abstract (arXiv)
We present a robust learning algorithm to detect and handle collisions in 3D deforming meshes. Our collision detector is represented as a bilevel deep autoencoder with an attention mechanism that identifies colliding mesh sub-parts. We use a numerical optimization algorithm to resolve penetrations guided by the network. Our learned collision handler can resolve collisions for unseen, high-dimensional meshes with thousands of vertices. To obtain stable network performance in such large and unseen spaces, we progressively insert new collision data based on the errors in network inferences. We automatically label these data using an analytical collision detector and progressively fine-tune our detection networks. We evaluate our method for collision handling of complex, 3D meshes coming from several datasets with different shapes and topologies, including datasets corresponding to dressed and undressed human poses, cloth simulations, and human hand poses acquired using multiview capture systems. Our approach outperforms supervised learning methods and achieves 93.8-98.1% accuracy compared to the groundtruth by analytic methods. Compared to prior learning methods, our approach results in a 5.16%-25.50% lower false negative rate in terms of collision checking and a 9.65%-58.91% higher success rate in collision handling.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 8 Oct 2021.
Builds on
23 of 51 references.
References · 23
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 257
- 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 148
- 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2021On Self-Contact and Human Posecited by 88
- 2017Deep Active Learning over the Long Tailcited by 82
11 more
- 2017Variational Autoencoders for Deforming 3D Mesh Modelscited by 69
- 2018GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Drapingcited by 69
- 2019Active Learning for Deep Detection Neural Networkscited by 62
- 2019PartNet: A Recursive Part Decomposition Network for Fine-grained and Hierarchical Shape Segmentationcited by 44
- 2020Learning Complex 3D Human Self-Contactcited by 40
- 2017Sparse Data Driven Mesh Deformationcited by 21
- 2021A Deep Emulator for Secondary Motion of 3D Characterscited by 16
- 2020LCollision: Fast Generation of Collision-Free Human Poses using Learned Non-Penetration Constraintscited by 8
- 2017Mesh-based Autoencoders for Localized Deformation Component Analysiscited by 7
- 2020Multiscale Mesh Deformation Component Analysis with Attention-based Autoencoderscited by 7
- 2017Fastron: An Online Learning-Based Model and Active Learning Strategy for Proxy Collision Detectioncited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 0; 2025: 0; 2026: 1.
5 papers.
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2021N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networkscited by 14
- 2022A Repulsive Force Unit for Garment Collision Handling in Neural Networkscited by 7
- 2023CTSN: Predicting Cloth Deformation for Skeleton-based Characters with a Two-stream Skinning Networkcited by 1
- 2026PoseShield: Neural Collision Fields for Human Self-Collision Resolutioncited by 0
- 2026PoseShield: Neural Collision Fields for Human Self-Collision Resolution29 Jun 2026
- 2023CTSN: Predicting Cloth Deformation for Skeleton-based Characters with a Two-stream Skinning Network30 May 2023
- 2022A Repulsive Force Unit for Garment Collision Handling in Neural Networks28 Jul 2022
- 2022Human Trajectory Prediction via Neural Social Physics21 Jul 2022
- 2021N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networks13 Dec 2021