VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Prediction
Not on the map. Why?
Abstract (arXiv)
Feed-forward 3D Gaussian Splatting (3DGS) has emerged as a highly effective solution for novel view synthesis. Existing methods predominantly rely on a pixel-aligned Gaussian prediction paradigm, where each 2D pixel is mapped to a 3D Gaussian. We rethink this widely adopted formulation and identify several inherent limitations: it renders the reconstructed 3D models heavily dependent on the number of input views, leads to view-biased density distributions, and introduces alignment errors, particularly when source views contain occlusions or low texture. To address these challenges, we introduce VolSplat, a new multi-view feed-forward paradigm that replaces pixel alignment with voxel-aligned Gaussians. By directly predicting Gaussians from a predicted 3D voxel grid, it overcomes pixel alignment's reliance on error-prone 2D feature matching, ensuring robust multi-view consistency. Furthermore, it enables adaptive control over density based on 3D scene complexity, yielding more faithful Gaussians, improved geometric consistency, and enhanced novel-view rendering quality. Experiments on widely used benchmarks demonstrate that VolSplat achieves state-of-the-art performance, while producing more plausible and view-consistent results. The video results, code and trained models are available on our project page: https://lhmd.top/volsplat.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). Builds on 50 of its 70 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
50 of 70 references.
References · 50
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2024Depth Anything V2cited by 1,422
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
38 more
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 116
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
- 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 100
- 2024FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenescited by 89
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 75
- 2024SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splattingcited by 42
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Viewscited by 40
- 2025WonderTurbo: Generating Interactive 3D World in 0.72 Secondscited by 32
- 2025ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGScited by 32
- 2023SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenescited by 30
- 2025Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Imagescited by 27
- 2025EVolSplat: Efficient Volume-based Gaussian Splatting for Urban View Synthesiscited by 21
- 2025iLRM: An Iterative Large 3D Reconstruction Modelcited by 19
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstructioncited by 15
- 2025Revisiting Depth Representations for Feed-Forward 3D Gaussian Splattingcited by 12
- 2025TranSplat: Surface Embedding-guided 3D Gaussian Splatting for Transparent Object Manipulationcited by 10
- 2025TransDiff: Diffusion-Based Method for Manipulating Transparent Objects Using a Single RGB-D Imagecited by 7
- 2025Learning Efficient Fuse-and-Refine for Feed-Forward 3D Gaussian Splattingcited by 5
- 2025FlexGS: Train Once, Deploy Everywhere with Many-in-One Flexible 3D Gaussian Splattingcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 45.
48 papers.
Sort:
By area:
- 2025C3G: Learning Compact 3D Representations with 2K Gaussianscited by 21
- 2026Latent Spatial Memory for Video World Modelscited by 17
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusioncited by 15
- 2026TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstructioncited by 14
- 2026GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokenscited by 12
- 2025Off The Grid: Detection of Primitives for Feed-Forward 3D Gaussian Splattingcited by 11
- 2026World-R1: Reinforcing 3D Constraints for Text-to-Video Generationcited by 11
- 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priorscited by 8
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Predictioncited by 7
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026AnyDepth: Depth Estimation Made Easycited by 5
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 4
36 more
- 2026EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesiscited by 3
- 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animationcited by 3
- 2026TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstructioncited by 3
- 2026Free-Range Gaussians: Non-Grid-Aligned Generative 3D Gaussian Reconstructioncited by 2
- 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
- 2026SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesiscited by 2
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstructioncited by 2
- 2026GSCompleter: A Distillation-Free Plugin for Metric-Aware 3D Gaussian Splatting Completion in Secondscited by 1
- 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splattingcited by 1
- 2026Learn2Splat: Extending the Horizon of Learned 3DGS Optimizationcited by 1
- 2026VG2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformercited by 1
- 2026HiReFF: High-Resolution Feedforward Human Reconstruction from Uncalibrated Sparse-View Videocited by 1
- 2026Bridging 3D Gaussians and Semantic Occupancy for Comprehensive Open-Vocabulary Scene Understanding from Unposed Imagescited by 1
- 2026ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansioncited by 1
- 2026S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputscited by 0
- 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generationcited by 0
- 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Modelscited by 0
- 2026Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latentscited by 0
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimationcited by 0
- 2026Learning Stable Canonical Worlds for Novel View Synthesis and Beyondcited by 0
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026Targeted Structure Completion for Sparse-View 3D Reconstruction in Autonomous Drivingcited by 0
- 2026Compact Feed-Forward 3D Gaussians via Saliency-Guided Primitive Mergingcited by 0
- 2026Physics-Integrated Operator Learning via Gaussian Splatting Representationscited by 0
- 2026Per-View Gaussian Predictions Enable Training-Free Distractor Filtering in Feed-Forward 3DGScited by 0
- 2026ParticleSplat: Self-supervised Object-centric Latent Particle Splattingcited by 0
- 2026PhGS: Post-Hoc Pruning and Refinement of Single-View Feed-Forward 3D Gaussian Reconstructionscited by 0
- 2026VoxelTTO: Voxel-Aligned Feed-Forward 3D Gaussian Splatting with Test-Time Optimizationcited by 0
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splattingcited by 0
- 2026FeCoSplat: Feedback-Guided Compression for Feed-Forward 3D Gaussian Splattingcited by 0
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoningcited by 0
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Givencited by 0
- 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstructioncited by 0
- 2026CoTL: Compact Token Learning for 3D Scene Representationcited by 0
- 2026InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Viewscited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generationcited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation14 Oct 2026
- 2026InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views14 Oct 2026
- 2026CoTL: Compact Token Learning for 3D Scene Representation13 Oct 2026
- 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstruction9 Oct 2026
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given6 Oct 2026
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning3 Oct 2026
- 2026FeCoSplat: Feedback-Guided Compression for Feed-Forward 3D Gaussian Splatting27 Sep 2026
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting19 Sep 2026
- 2026VoxelTTO: Voxel-Aligned Feed-Forward 3D Gaussian Splatting with Test-Time Optimization18 Sep 2026
- 2026PhGS: Post-Hoc Pruning and Refinement of Single-View Feed-Forward 3D Gaussian Reconstructions17 Sep 2026
- 2026ParticleSplat: Self-supervised Object-centric Latent Particle Splatting16 Sep 2026
- 2026Per-View Gaussian Predictions Enable Training-Free Distractor Filtering in Feed-Forward 3DGS27 Aug 2026
36 more
- 2026Physics-Integrated Operator Learning via Gaussian Splatting Representations25 Aug 2026
- 2026Compact Feed-Forward 3D Gaussians via Saliency-Guided Primitive Merging11 Aug 2026
- 2026ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansion22 Jul 2026
- 2026Targeted Structure Completion for Sparse-View 3D Reconstruction in Autonomous Driving6 Jul 2026
- 2026Bridging 3D Gaussians and Semantic Occupancy for Comprehensive Open-Vocabulary Scene Understanding from Unposed Images2 Jul 2026
- 2026HiReFF: High-Resolution Feedforward Human Reconstruction from Uncalibrated Sparse-View Video28 Jun 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
- 2026Learning Stable Canonical Worlds for Novel View Synthesis and Beyond22 Jun 2026
- 2026Latent Spatial Memory for Video World Models8 Jun 2026
- 2026VG2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformer1 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction25 May 2026
- 2026Learn2Splat: Extending the Horizon of Learned 3DGS Optimization15 May 2026
- 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splatting11 May 2026
- 2026SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis8 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026World-R1: Reinforcing 3D Constraints for Text-to-Video Generation27 Apr 2026
- 2026GSCompleter: A Distillation-Free Plugin for Metric-Aware 3D Gaussian Splatting Completion in Seconds22 Apr 2026
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 2026GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens16 Apr 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priors8 Apr 2026
- 2026Free-Range Gaussians: Non-Grid-Aligned Generative 3D Gaussian Reconstruction6 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latents26 Mar 2026
- 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Models24 Mar 2026
- 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generation17 Mar 2026
- 2026S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputs11 Mar 2026
- 2026TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstruction28 Feb 2026
- 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animation11 Feb 2026
- 2026EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis22 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025Off The Grid: Detection of Primitives for Feed-Forward 3D Gaussian Splatting17 Dec 2025
- 2025C3G: Learning Compact 3D Representations with 2K Gaussians3 Dec 2025
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion17 Oct 2025
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusioncited by 15
- 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generationcited by 0
- 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Modelscited by 0
- 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Models24 Mar 2026
- 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generation17 Mar 2026
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion17 Oct 2025
- 2026Latent Spatial Memory for Video World Modelscited by 17
- 2026Latent Spatial Memory for Video World Models8 Jun 2026
- 2025C3G: Learning Compact 3D Representations with 2K Gaussianscited by 21
- 2026TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstructioncited by 14
- 2026GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokenscited by 12
- 2025Off The Grid: Detection of Primitives for Feed-Forward 3D Gaussian Splattingcited by 11
- 2026World-R1: Reinforcing 3D Constraints for Text-to-Video Generationcited by 11
- 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priorscited by 8
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Predictioncited by 7
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026AnyDepth: Depth Estimation Made Easycited by 5
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 4
- 2026EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesiscited by 3
- 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animationcited by 3
12 most cited of 42 All 42 (JSON)
- 2026InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views14 Oct 2026
- 2026CoTL: Compact Token Learning for 3D Scene Representation13 Oct 2026
- 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstruction9 Oct 2026
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given6 Oct 2026
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning3 Oct 2026
- 2026FeCoSplat: Feedback-Guided Compression for Feed-Forward 3D Gaussian Splatting27 Sep 2026
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting19 Sep 2026
- 2026VoxelTTO: Voxel-Aligned Feed-Forward 3D Gaussian Splatting with Test-Time Optimization18 Sep 2026
- 2026PhGS: Post-Hoc Pruning and Refinement of Single-View Feed-Forward 3D Gaussian Reconstructions17 Sep 2026
- 2026ParticleSplat: Self-supervised Object-centric Latent Particle Splatting16 Sep 2026
- 2026Per-View Gaussian Predictions Enable Training-Free Distractor Filtering in Feed-Forward 3DGS27 Aug 2026
- 2026Physics-Integrated Operator Learning via Gaussian Splatting Representations25 Aug 2026
12 newest of 42 All 42 (JSON)