mlsanityData to 7 Oct 2026

LISA: Learning Implicit Shape and Appearance of Hands

arXiv 2204.01695 ↗First posted 4 Apr 2022cs.CVcited by 63

Not on the map. Why?

Abstract (arXiv)

This paper proposes a do-it-all neural model of human hands, named LISA. The model can capture accurate hand shape and appearance, generalize to arbitrary hand subjects, provide dense surface correspondences, be reconstructed from images in the wild and easily animated. We train LISA by minimizing the shape and appearance losses on a large set of multi-view RGB image sequences annotated with coarse 3D poses of the hand skeleton. For a 3D point in the hand local coordinate, our model predicts the color and the signed distance with respect to each hand bone independently, and then combines the per-bone predictions using predicted skinning weights. The shape, color and pose representations are disentangled by design, allowing to estimate or animate only selected parameters. We experimentally demonstrate that LISA can accurately reconstruct a dynamic hand from monocular or multi-view sequences, achieving a noticeably higher quality of reconstructed hand shapes compared to baseline approaches. Project page: https://www.iri.upc.edu/people/ecorona/lisa/.

Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Builds on 61 of its 74 references that are in the map. First posted on arXiv 4 Apr 2022.

Builds on

61 of 74 references.

References · 61

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Mask R-CNNcited by 7,259
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  6. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  8. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  9. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  10. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  11. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  12. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
38 more
  1. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  2. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  3. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  4. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  5. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  6. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  7. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  8. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  9. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  10. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  11. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  12. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
  13. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  14. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  15. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  16. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  17. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  18. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  19. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  20. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  21. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  22. 2021Neural Articulated Radiance Fieldcited by 196
  23. 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
  24. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  25. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  26. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  27. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  28. 2019NASA: Neural Articulated Shape Approximationcited by 149
  29. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  30. 2020Reconstructing Hand-Object Interactions in the Wildcited by 143
  31. 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
  32. 2020Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstructioncited by 139
  33. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  34. 2020SALD: Sign Agnostic Learning with Derivativescited by 115
  35. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  36. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  37. 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
  38. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 11; 2023: 23; 2024: 16; 2025: 9; 2026: 4.

63 papers.

Sort:

By area:

  1. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
  2. 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
  3. 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
  4. 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
  5. 2023X-Avatar: Expressive Human Avatarscited by 66
  6. 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
  7. 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
  8. 2023gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstructioncited by 49
  9. 2022Learned Vertex Descent: A New Direction for 3D Human Model Fittingcited by 37
  10. 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
  11. 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
  12. 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
38 more
  1. 2022HARP: Personalized Hand Reconstruction from a Monocular RGB Videocited by 28
  2. 2023HandNeRF: Neural Radiance Fields for Animatable Interacting Handscited by 27
  3. 2023Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapescited by 26
  4. 2023MANUS: Markerless Grasp Capture using Articulated 3D Gaussianscited by 26
  5. 2023RelightableHands: Efficient Neural Relighting of Articulated Hand Modelscited by 21
  6. 2023ActorsNeRF: Animatable Few-shot Human Rendering with Generalizable NeRFscited by 21
  7. 2022Structured 3D Features for Reconstructing Controllable Avatarscited by 19
  8. 2024OHTA: One-shot Hand Avatar via Data-driven Implicit Priorscited by 18
  9. 20233D Pose Estimation of Two Interacting Hands from a Monocular Event Cameracited by 17
  10. 2024URHand: Universal Relightable Handscited by 17
  11. 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
  12. 2023Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Viewscited by 16
  13. 2023SHOWMe: Benchmarking Object-agnostic Hand-Object 3D Reconstructioncited by 16
  14. 2023SlimmeRF: Slimmable Radiance Fieldscited by 15
  15. 2024Authentic Hand Avatar from a Phone Scan via Universal Hand Modelcited by 13
  16. 2022An Implicit Parametric Morphable Dental Modelcited by 12
  17. 2023Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfoldingcited by 10
  18. 2023FourierHandFlow: Neural 4D Hand Representation Using Fourier Query Flowcited by 10
  19. 20233D Points Splatting for Real-Time Dynamic Hand Reconstructioncited by 10
  20. 2022Canonical Fields: Self-Supervised Learning of Pose-Canonicalized Neural Fieldscited by 9
  21. 2023Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Imagescited by 9
  22. 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Imagecited by 8
  23. 2022PhoMoH: Implicit Photorealistic 3D Models of Human Headscited by 7
  24. 2023Human 3D Avatar Modeling with Implicit Neural Representation: A Brief Surveycited by 7
  25. 20243D Whole-body Grasp Synthesis with Directional Controllabilitycited by 6
  26. 2023PHRIT: Parametric Hand Representation with Implicit Templatecited by 5
  27. 20243D Visibility-aware Generalizable Neural Radiance Fields for Interacting Handscited by 4
  28. 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
  29. 2024Generalizable Neural Human Renderercited by 3
  30. 2024MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modelingcited by 3
  31. 2024Fine-Grained Multi-View Hand Reconstruction Using Inverse Renderingcited by 3
  32. 2024Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatarscited by 3
  33. 2025JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splattingcited by 3
  34. 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
  35. 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Priorcited by 3
  36. 2023HiFiHR: Enhancing 3D Hand Reconstruction from a Single Image via High-Fidelity Texturecited by 2
  37. 2024SiMA-Hand: Boosting 3D Hand-Mesh Reconstruction by Single-to-Multi-View Adaptationcited by 2
  38. 2024XHand: Real-time Expressive Hand Avatarcited by 2

50 most cited of 63 All 63 (JSON)