LaRa: Efficient Large-Baseline Radiance Fields
Not on the map. Why?
Abstract (arXiv)
Radiance field methods have achieved photorealistic novel view synthesis and geometry reconstruction. But they are mostly applied in per-scene optimization or small-baseline settings. While several recent works investigate feed-forward reconstruction with large baselines by utilizing transformers, they all operate with a standard global attention mechanism and hence ignore the local nature of 3D reconstruction. We propose a method that unifies local and global reasoning in transformer layers, resulting in improved quality and faster convergence. Our model represents scenes as Gaussian Volumes and combines this with an image encoder and Group Attention Layers for efficient feed-forward reconstruction. Experimental results demonstrate that our model, trained for two days on four GPUs, demonstrates high fidelity in reconstructing 360 deg radiance fields, and robustness to zero-shot and out-of-domain testing. Our project Page: https://apchenstu.github.io/LaRa/.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 59 of its 78 references that are in the map. First posted on arXiv 5 Jul 2024.
Builds on
59 of 78 references.
References · 59
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
38 more
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2019Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awarenesscited by 151
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2019Point-Based Multi-View Stereo Networkcited by 147
- 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2024: 14; 2025: 31; 2026: 9.
54 papers.
Sort:
By area:
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
- 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
- 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAEcited by 38
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025EVolSplat: Efficient Volume-based Gaussian Splatting for Urban View Synthesiscited by 20
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024Learning-based Multi-View Stereo: A Surveycited by 18
38 more
- 2024Generative Densification: Learning to Densify Gaussians for High-Fidelity Generalizable 3D Reconstructioncited by 18
- 2025iLRM: An Iterative Large 3D Reconstruction Modelcited by 18
- 2024Efficient Scene Modeling via Structure-Aware and Region-Prioritized 3D Gaussianscited by 14
- 2025SemanticSplat: Feed-Forward 3D Scene Understanding with Language-Aware Gaussian Fieldscited by 13
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curationcited by 12
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modelingcited by 12
- 2025QuickSplat: Fast 3D Surface Reconstruction via Learned Gaussian Initializationcited by 11
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
- 2025IGL-Nav: Incremental 3D Gaussian Localization for Image-goal Navigationcited by 10
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitizationcited by 9
- 2025HumanRAM: Feed-forward Human Reconstruction and Animation Model using Transformerscited by 9
- 2024SizeGS: Size-aware Compression of 3D Gaussian Splatting via Mixed Integer Programmingcited by 7
- 2025TinySplat: Feedforward Approach for Generating Compact 3D Scene Representationcited by 5
- 2025High-fidelity 3D Object Generation from Single Image with RGBN-Volume Gaussian Reconstruction Modelcited by 4
- 2025How Many Tokens Do 3D Point Cloud Transformer Architectures Really Need?cited by 4
- 2025Cyc3D: Fine-grained Controllable 3D Generation via Cycle Consistency Regularizationcited by 3
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Viewscited by 3
- 2025GaussianLens: Localized High-Resolution Reconstruction via On-Demand Gaussian Densificationcited by 3
- 2026EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesiscited by 3
- 2024Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Viewscited by 2
- 2025AlignCVC: Aligning Cross-View Consistency for Single-Image-to-3D Generationcited by 2
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splattingcited by 2
- 2025Large Material Gaussian Model for Relightable 3D Generationcited by 2
- 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metriccited by 2
- 2025HART: Human Aligned Reconstruction Transformercited by 2
- 2026Free-Range Gaussians: Non-Grid-Aligned Generative 3D Gaussian Reconstructioncited by 2
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windowscited by 2
- 2026PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generationcited by 2
- 2025Is there anything left? Measuring semantic residuals of objects removed from 3D Gaussian Splattingcited by 1
- 2025Pose-free 3D Gaussian splatting via shape-ray estimationcited by 1
- 2025From Volume Rendering to 3D Gaussian Splatting: Theory and Applicationscited by 1
- 2025Photo3D: Advancing Photorealistic 3D Generation through Structure-Aligned Detail Enhancementcited by 1
- 2025SplatBright: Generalizable Low-Light Scene Reconstruction from Sparse Views via Physically-Guided Gaussian Enhancementcited by 1
- 2026StdGEN++: A Comprehensive System for Semantic-Decomposed 3D Character Generationcited by 1
- 2024LiftRefine: Progressively Refined View Synthesis from 3D Lifting with Volume-Triplane Representationscited by 0
- 2025Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Controlcited by 0
- 2025DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generationcited by 0
50 most cited of 54 All 54 (JSON)
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting19 Sep 2026
- 2026VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views11 Sep 2026
- 2026SubSplat: High-Resolution Pixel-aligned 3DGS via Sub-pixel Gaussian Reparameterization23 Jul 2026
- 2026PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation2 Jul 2026
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows6 Apr 2026
- 2026Free-Range Gaussians: Non-Grid-Aligned Generative 3D Gaussian Reconstruction6 Apr 2026
- 2026ILV: Iterative Latent Volumes for Fast and Accurate Sparse-View CT Reconstruction16 Mar 2026
- 2026EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis22 Jan 2026
- 2026StdGEN++: A Comprehensive System for Semantic-Decomposed 3D Character Generation12 Jan 2026
- 2025SplatBright: Generalizable Low-Light Scene Reconstruction from Sparse Views via Physically-Guided Gaussian Enhancement21 Dec 2025
- 2025Photo3D: Advancing Photorealistic 3D Generation through Structure-Aligned Detail Enhancement9 Dec 2025
- 2025How Many Tokens Do 3D Point Cloud Transformer Architectures Really Need?7 Nov 2025
38 more
- 2025From Volume Rendering to 3D Gaussian Splatting: Theory and Applications20 Oct 2025
- 2025HART: Human Aligned Reconstruction Transformer30 Sep 2025
- 2025GaussianLens: Localized High-Resolution Reconstruction via On-Demand Gaussian Densification29 Sep 2025
- 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metric28 Sep 2025
- 2025Large Material Gaussian Model for Relightable 3D Generation26 Sep 2025
- 2025DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generation9 Sep 2025
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting15 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025IGL-Nav: Incremental 3D Gaussian Localization for Image-goal Navigation1 Aug 2025
- 2025iLRM: An Iterative Large 3D Reconstruction Model31 Jul 2025
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views30 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025AlignCVC: Aligning Cross-View Consistency for Single-Image-to-3D Generation29 Jun 2025
- 2025SemanticSplat: Feed-Forward 3D Scene Understanding with Language-Aware Gaussian Fields11 Jun 2025
- 2025TinySplat: Feedforward Approach for Generating Compact 3D Scene Representation11 Jun 2025
- 2025HumanRAM: Feed-forward Human Reconstruction and Animation Model using Transformers3 Jun 2025
- 2025Pose-free 3D Gaussian splatting via shape-ray estimation29 May 2025
- 2025QuickSplat: Fast 3D Surface Reconstruction via Learned Gaussian Initialization8 May 2025
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitization3 May 2025
- 2025Cyc3D: Fine-grained Controllable 3D Generation via Cycle Consistency Regularization21 Apr 2025
- 2025High-fidelity 3D Object Generation from Single Image with RGBN-Volume Gaussian Reconstruction Model2 Apr 2025
- 2025EVolSplat: Efficient Volume-based Gaussian Splatting for Urban View Synthesis26 Mar 2025
- 2025Is there anything left? Measuring semantic residuals of objects removed from 3D Gaussian Splatting21 Mar 2025
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modeling20 Mar 2025
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Images17 Mar 2025
- 2025Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Control23 Feb 2025
- 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation28 Jan 2025
- 2024LiftRefine: Progressively Refined View Synthesis from 3D Lifting with Volume-Triplane Representations19 Dec 2024
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstruction12 Dec 2024
- 2024Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Views11 Dec 2024
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec 2024
- 2024Generative Densification: Learning to Densify Gaussians for High-Fidelity Generalizable 3D Reconstruction9 Dec 2024
- 2024SizeGS: Size-aware Compression of 3D Gaussian Splatting via Mixed Integer Programming8 Dec 2024
- 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAE25 Nov 2024
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis25 Nov 2024
- 2024Efficient Scene Modeling via Structure-Aware and Region-Prioritized 3D Gaussians19 Nov 2024
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodings12 Nov 2024
50 newest of 54 All 54 (JSON)
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curationcited by 12
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
- 2024Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Viewscited by 2
- 2024LiftRefine: Progressively Refined View Synthesis from 3D Lifting with Volume-Triplane Representationscited by 0
- 2025DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generationcited by 0
- 2025DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generation9 Sep 2025
- 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation28 Jan 2025
- 2024LiftRefine: Progressively Refined View Synthesis from 3D Lifting with Volume-Triplane Representations19 Dec 2024
- 2024Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Views11 Dec 2024
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec 2024
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis25 Nov 2024
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodings12 Nov 2024
- 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curation1 Oct 2024
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
- 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025EVolSplat: Efficient Volume-based Gaussian Splatting for Urban View Synthesiscited by 20
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024Learning-based Multi-View Stereo: A Surveycited by 18
- 2024Generative Densification: Learning to Densify Gaussians for High-Fidelity Generalizable 3D Reconstructioncited by 18
- 2025iLRM: An Iterative Large 3D Reconstruction Modelcited by 18
- 2024Efficient Scene Modeling via Structure-Aware and Region-Prioritized 3D Gaussianscited by 14
- 2025SemanticSplat: Feed-Forward 3D Scene Understanding with Language-Aware Gaussian Fieldscited by 13
12 most cited of 45 All 45 (JSON)
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting19 Sep 2026
- 2026VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views11 Sep 2026
- 2026SubSplat: High-Resolution Pixel-aligned 3DGS via Sub-pixel Gaussian Reparameterization23 Jul 2026
- 2026PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation2 Jul 2026
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows6 Apr 2026
- 2026Free-Range Gaussians: Non-Grid-Aligned Generative 3D Gaussian Reconstruction6 Apr 2026
- 2026ILV: Iterative Latent Volumes for Fast and Accurate Sparse-View CT Reconstruction16 Mar 2026
- 2026EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis22 Jan 2026
- 2026StdGEN++: A Comprehensive System for Semantic-Decomposed 3D Character Generation12 Jan 2026
- 2025SplatBright: Generalizable Low-Light Scene Reconstruction from Sparse Views via Physically-Guided Gaussian Enhancement21 Dec 2025
- 2025Photo3D: Advancing Photorealistic 3D Generation through Structure-Aligned Detail Enhancement9 Dec 2025
- 2025How Many Tokens Do 3D Point Cloud Transformer Architectures Really Need?7 Nov 2025
12 newest of 45 All 45 (JSON)