# Implicit Gaussian Splatting with Efficient Multi-Level Tri-Plane Representation

arXiv: https://arxiv.org/abs/2408.10041 · HTML: https://mlsanity.com/paper/2408.10041/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- Builds on 29 of its 39 references that are in the map.
- First posted on arXiv 19 Aug 2024.

## Builds on (most cited first, 29 of 29)

- [3D Gaussian Splatting for Real-Time Radiance Field Rendering](https://mlsanity.com/paper/2308.04079/) (2023)
- [Feature Pyramid Networks for Object Detection](https://mlsanity.com/paper/1612.03144/) (2016)
- [Instant Neural Graphics Primitives with a Multiresolution Hash Encoding](https://mlsanity.com/paper/2201.05989/) (2022)
- [Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields](https://mlsanity.com/paper/2111.12077/) (2021)
- [TensoRF: Tensorial Radiance Fields](https://mlsanity.com/paper/2203.09517/) (2022)
- [Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction](https://mlsanity.com/paper/2111.11215/) (2021)
- [PlenOctrees for Real-time Rendering of Neural Radiance Fields](https://mlsanity.com/paper/2103.14024/) (2021)
- [K-Planes: Explicit Radiance Fields in Space, Time, and Appearance](https://mlsanity.com/paper/2301.10241/) (2023)
- [Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering](https://mlsanity.com/paper/2312.00109/) (2023)
- [HexPlane: A Fast Representation for Dynamic Scenes](https://mlsanity.com/paper/2301.09632/) (2023)
- [Baking Neural Radiance Fields for Real-Time View Synthesis](https://mlsanity.com/paper/2103.14645/) (2021)
- [LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS](https://mlsanity.com/paper/2311.17245/) (2023)
- [Compact 3D Gaussian Representation for Radiance Field](https://mlsanity.com/paper/2311.13681/) (2023)
- [Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis](https://mlsanity.com/paper/2401.02436/) (2023)
- [Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians](https://mlsanity.com/paper/2403.17898/) (2024)
- [MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes](https://mlsanity.com/paper/2302.12249/) (2023)
- [HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression](https://mlsanity.com/paper/2403.14530/) (2024)
- [EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS](https://mlsanity.com/paper/2312.04564/) (2023)
- [Compact 3D Scene Representation via Self-Organizing Gaussian Grids](https://mlsanity.com/paper/2312.13299/) (2023)
- [GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering](https://mlsanity.com/paper/2402.10128/) (2024)
- [CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splatting](https://mlsanity.com/paper/2404.09458/) (2024)
- [Neural Residual Radiance Fields for Streamably Free-Viewpoint Videos](https://mlsanity.com/paper/2304.04452/) (2023)
- [Compressing Volumetric Radiance Fields to 1 MB](https://mlsanity.com/paper/2211.16386/) (2022)
- [Masked Wavelet Representation for Compact Neural Radiance Fields](https://mlsanity.com/paper/2212.09069/) (2022)
- [Compressing Explicit Voxel Grid Representations: fast NeRFs become also small](https://mlsanity.com/paper/2210.12782/) (2022)
- [How Far Can We Compress Instant-NGP-Based NeRF?](https://mlsanity.com/paper/2406.04101/) (2024)
- [VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams](https://mlsanity.com/paper/2312.01407/) (2023)
- [TeTriRF: Temporal Tri-Plane Radiance Fields for Efficient Free-Viewpoint Video](https://mlsanity.com/paper/2312.06713/) (2023)
- [PREF: Phasorial Embedding Fields for Compact Neural Representations](https://mlsanity.com/paper/2205.13524/) (2022)

## Built on by (most cited first, 21 of 21)

- [Fast Feedforward 3D Gaussian Splatting Compression](https://mlsanity.com/paper/2410.08017/) (2024)
- [MoDec-GS: Global-to-Local Motion Decomposition and Temporal Interval Adjustment for Compact Dynamic 3D Gaussian Splatting](https://mlsanity.com/paper/2501.03714/) (2025)
- [PCGS: Progressive Compression of 3D Gaussian Splatting](https://mlsanity.com/paper/2503.08511/) (2025)
- [3D Student Splatting and Scooping](https://mlsanity.com/paper/2503.10148/) (2025)
- [4D Scaffold Gaussian Splatting with Dynamic-Aware Anchor Growing for Efficient and High-Fidelity Dynamic Scene Reconstruction](https://mlsanity.com/paper/2411.17044/) (2024)
- [GoDe: Gaussians on Demand for Progressive Level of Detail and Scalable Compression](https://mlsanity.com/paper/2501.13558/) (2025)
- [GSCodec Studio: A Modular Framework for Gaussian Splat Compression](https://mlsanity.com/paper/2506.01822/) (2025)
- [SizeGS: Size-aware Compression of 3D Gaussian Splatting via Mixed Integer Programming](https://mlsanity.com/paper/2412.05808/) (2024)
- [D-FCGS: Feedforward Compression of Dynamic Gaussian Splatting for Free-Viewpoint Videos](https://mlsanity.com/paper/2507.05859/) (2025)
- [POTR: Post-Training 3DGS Compression](https://mlsanity.com/paper/2601.14821/) (2026)
- [Trick-GS: A Balanced Bag of Tricks for Efficient Gaussian Splatting](https://mlsanity.com/paper/2501.14534/) (2025)
- [HyRF: Hybrid Radiance Fields for Memory-efficient and High-quality Novel View Synthesis](https://mlsanity.com/paper/2509.17083/) (2025)
- [Learning Unified Representation of 3D Gaussian Splatting](https://mlsanity.com/paper/2509.22917/) (2025)
- [Enhancing 3D Gaussian Splatting Compression via Spatial Condition-based Prediction](https://mlsanity.com/paper/2503.23337/) (2025)
- [GSta: Efficient Training Scheme with Siestaed Gaussians for Monocular 3D Scene Reconstruction](https://mlsanity.com/paper/2504.06716/) (2025)
- [SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenes](https://mlsanity.com/paper/2505.17951/) (2025)
- [Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstruction](https://mlsanity.com/paper/2506.06988/) (2025)
- [Neural 4D Evolution under Large Topological Changes from 2D Images](https://mlsanity.com/paper/2411.15018/) (2024)
- [P-4DGS: Predictive 4D Gaussian Splatting with 90× Compression](https://mlsanity.com/paper/2510.10030/) (2025)
- [MesonGS++: Post-training Compression of 3D Gaussian Splatting with Hyperparameter Searching](https://mlsanity.com/paper/2604.26799/) (2026)
- [KISS-GS: 3D Gaussian Splatting Compression Kept Simple](https://mlsanity.com/paper/2608.26948/) (2026)

## Abstract (arXiv)

Recent advancements in photo-realistic novel view synthesis have been significantly driven by Gaussian Splatting (3DGS). Nevertheless, the explicit nature of 3DGS data entails considerable storage requirements, highlighting a pressing need for more efficient data representations. To address this, we present Implicit Gaussian Splatting (IGS), an innovative hybrid model that integrates explicit point clouds with implicit feature embeddings through a multi-level tri-plane architecture. This architecture features 2D feature grids at various resolutions across different levels, facilitating continuous spatial domain representation and enhancing spatial correlations among Gaussian primitives. Building upon this foundation, we introduce a level-based progressive training scheme, which incorporates explicit spatial regularization. This method capitalizes on spatial correlations to enhance both the rendering quality and the compactness of the IGS representation. Furthermore, we propose a novel compression pipeline tailored for both point clouds and 2D feature grids, considering the entropy variations across different levels. Extensive experimental evaluations demonstrate that our algorithm can deliver high-quality rendering using only a few MBs, effectively balancing storage efficiency and rendering fidelity, and yielding results that are competitive with the state-of-the-art.
