mlsanityData to 14 Oct 2026

Digital Twin Generation from Visual Data: A Survey

arXiv 2504.13159 ↗First posted 17 Apr 2025cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

This survey examines recent advances in generating digital twins from visual data. These digital twins - virtual 3D replicas of physical assets - can be applied to robotics, media content creation, design or construction workflows. We analyze a range of approaches, including 3D Gaussian Splatting, generative inpainting, semantic segmentation, and foundation models, highlighting their respective advantages and limitations. In addition, we discuss key challenges such as occlusions, lighting variations, and scalability, as well as identify gaps, trends, and directions for future research. Overall, this survey aims to provide a comprehensive overview of state-of-the-art methodologies and their implications for real-world applications. Awesome Digital Twin: https://awesomedigitaltwin.github.io

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 232 of its 317 references that are in the map. First posted on arXiv 17 Apr 2025.

Builds on

232 of 317 references.

References · 232

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  9. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  10. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
38 more
  1. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  2. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  3. 2024Depth Anything V2cited by 1,422
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  5. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  6. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  7. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  8. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  9. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  10. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  11. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  12. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  13. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  14. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  15. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  16. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  17. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  18. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  19. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  20. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  21. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  22. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  23. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  24. 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
  25. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  26. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  27. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  28. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  29. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
  30. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  31. 2018Invertible Residual Networkscited by 365
  32. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  33. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  34. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  35. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  36. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  37. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  38. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285

50 most cited of 232 All 232 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

  1. 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observationscited by 7
  2. 2025UrbanVerse: Scaling Urban Simulation by Watching City-Tour Videoscited by 5
  3. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
  4. 2025Grounding Language Models with Semantic Digital Twins for Robotic Planningcited by 2
  5. 2025Edit3r: Instant 3D Scene Editing from Sparse Unposed Imagescited by 2
  6. 2026HiFi-Mesh: High-Fidelity Efficient 3D Mesh Generation via Compact Autoregressive Dependencecited by 2
  7. 2026Spherical-GOF: Geometry-Aware Panoramic Gaussian Opacity Fields for 3D Scene Reconstructioncited by 0