mlsanityData to 7 Oct 2026

Lightplane: Highly-Scalable Components for Neural 3D Fields

arXiv 2404.19760 ↗First posted 30 Apr 2024cs.CV cs.GRcited by 13

Not on the map. Why?

Abstract (arXiv)

Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing a significant bottleneck for existing methods and hindering new applications. In response, we propose a pair of highly scalable components for 3D neural fields: Lightplane Render and Splatter, which significantly reduce memory usage in 2D-3D mapping. These innovations enable the processing of vastly more and higher resolution images with small memory and computational costs. We demonstrate their utility in various applications, from benefiting single-scene optimization with image-level losses to realizing a versatile pipeline for dramatically scaling 3D reconstruction and generation. Code: urlhttps://github.com/facebookresearch/lightplane.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 88 of its 102 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

88 of 102 references.

References · 88

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  10. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  11. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  2. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  12. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  13. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  14. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  15. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  16. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  17. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  18. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  19. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  20. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  21. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  22. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  23. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  24. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  25. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  26. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  27. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  28. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  29. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  30. 2023LERF: Language Embedded Radiance Fieldscited by 538
  31. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  32. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
  33. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  34. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  35. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  36. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  37. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  38. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376

50 most cited of 88 All 88 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 7; 2026: 1.

13 papers.

Sort:

By area:

  1. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  2. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  3. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  4. 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
  5. 2024Images that Sound: Composing Images and Sounds on a Single Canvascited by 17
  6. 2025UnCommon Objects in 3Dcited by 17
  7. 2024Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Modelscited by 10
  8. 2025From Thousands to Billions: 3D Visual Language Grounding via Render-Supervised Distillation from 2D VLMscited by 7
  9. 20254D-Animal: Freely Reconstructing Animatable 3D Animals from Videoscited by 6
  10. 2025LIM: Large Interpolator Model for Dynamic Reconstructioncited by 5
  11. 2026GenAssets: Generating in-the-wild 3D Assets in Latent Spacecited by 4
  12. 2025Twinner: Shining Light on Digital Twins in a Few Snapscited by 2
1 more
  1. 2025EOPose : Exemplar-based object reposing using Generalized Pose Correspondencescited by 0