mlsanityData to 7 Oct 2026

Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research

arXiv 1911.05063 ↗First posted 12 Nov 2019cs.CV cs.LG cs.ROcited by 98

Not on the map. Why?

Abstract (arXiv)

We present Kaolin, a PyTorch library aiming to accelerate 3D deep learning research. Kaolin provides efficient implementations of differentiable 3D modules for use in deep learning systems. With functionality to load and preprocess several popular 3D datasets, and native functions to manipulate meshes, pointclouds, signed distance functions, and voxel grids, Kaolin mitigates the need to write wasteful boilerplate code. Kaolin packages together several differentiable graphics modules including rendering, lighting, shading, and view warping. Kaolin also supports an array of loss functions and evaluation metrics for seamless evaluation and provides visualization functionality to render the 3D results. Importantly, we curate a comprehensive model zoo comprising many state-of-the-art 3D deep learning architectures, to serve as a starting point for future research endeavours. Kaolin is available as open-source software at https://github.com/NVIDIAGameWorks/kaolin/.

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 17; 2023: 24; 2024: 19; 2025: 10; 2026: 14.

98 papers.

Sort:

By area:

  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  2. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  3. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  4. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  5. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  6. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
  7. 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
  8. 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
  9. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  10. 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
  11. 2022Variable Bitrate Neural Fieldscited by 116
  12. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
38 more
  1. 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
  2. 2023NerfAcc: Efficient Sampling Accelerates NeRFscited by 90
  3. 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
  4. 2022Full-Body Articulated Human-Object Interactioncited by 76
  5. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
  6. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  7. 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
  8. 2021DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderercited by 52
  9. 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
  10. 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 44
  11. 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
  12. 2022FWD: Real-time Novel View Synthesis with Forward Warping and Depthcited by 39
  13. 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
  14. 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
  15. 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
  16. 2022RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesiscited by 33
  17. 2023Zero-Shot 3D Shape Correspondencecited by 33
  18. 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
  19. 2022DiffCloud: Real-to-Sim from Point Clouds with Differentiable Simulation and Rendering of Deformable Objectscited by 29
  20. 2022PERGAMO: Personalized 3D Garments from Monocular Videocited by 22
  21. 2021Representing 3D Shapes with Probabilistic Directed Distance Fieldscited by 21
  22. 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 17
  23. 2023Breathing New Life into 3D Assets with Generative Repaintingcited by 17
  24. 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
  25. 2021Multi-person Implicit Reconstruction from a Single Imagecited by 13
  26. 2021Neural-IMLS: Self-supervised Implicit Moving Least-Squares Network for Surface Reconstructioncited by 13
  27. 2025InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsingcited by 13
  28. 2024Multi-GraspLLM: A Multimodal LLM for Multi-Hand Semantic Guided Grasp Generationcited by 12
  29. 2021Motion-from-Blur: 3D Shape and Motion Estimation of Motion-blurred Objects in Videoscited by 11
  30. 2023Diff-DOPE: Differentiable Deep Object Pose Estimationcited by 11
  31. 2021Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objectscited by 10
  32. 2024TexRO: Generating Delicate Textures of 3D Models by Recursive Optimizationcited by 9
  33. 2024DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generationcited by 9
  34. 2022Monocular 3D Object Reconstruction with GAN Inversioncited by 8
  35. 2023Advances in 3D Neural Stylization: A Surveycited by 8
  36. 2022Language-guided Semantic Style Transfer of 3D Indoor Scenescited by 7
  37. 2023Cloth2Tex: A Customized Cloth Texture Generation Pipeline for 3D Virtual Try-Oncited by 7
  38. 2023Translating Universal Scene Descriptions into Knowledge Graphs for Robotic Environmentcited by 7

50 most cited of 98 All 98 (JSON)