mlsanityData to 13 Oct 2026

LucidFusion: Reconstructing 3D Gaussians with Arbitrary Unposed Images

arXiv 2410.15636 ↗First posted 21 Oct 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Recent large reconstruction models have made notable progress in generating high-quality 3D objects from single images. However, current reconstruction methods often rely on explicit camera pose estimation or fixed viewpoints, restricting their flexibility and practical applicability. We reformulate 3D reconstruction as image-to-image translation and introduce the Relative Coordinate Map (RCM), which aligns multiple unposed images to a main view without pose estimation. While RCM simplifies the process, its lack of global 3D supervision can yield noisy outputs. To address this, we propose Relative Coordinate Gaussians (RCG) as an extension to RCM, which treats each pixel's coordinates as a Gaussian center and employs differentiable rasterization for consistent geometry and pose recovery. Our LucidFusion framework handles an arbitrary number of unposed inputs, producing robust 3D reconstructions within seconds and paving the way for more flexible, pose-free 3D pipelines.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 21 Oct 2024.

Builds on

41 of 52 references.

References · 41

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,019
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,529
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,212
  6. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 931
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 843
  8. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 782
  9. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 738
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 732
  11. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  12. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 605
29 more
  1. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 557
  2. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 518
  3. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 424
  4. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 363
  5. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 362
  6. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 345
  7. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  8. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
  9. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  10. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  11. 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
  12. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  13. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 228
  14. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  15. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  16. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  17. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 164
  18. 2019Point-Based Multi-View Stereo Networkcited by 147
  19. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
  20. 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
  21. 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 68
  22. 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 62
  23. 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
  24. 2023Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstructioncited by 51
  25. 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
  26. 2022RC-MVSNet: Unsupervised Multi-View Stereo with Neural Renderingcited by 30
  27. 2023ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstructioncited by 30
  28. 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
  29. 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Viewscited by 14

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.