NeuroGauss4D-PCI: 4D Neural Fields and Gaussian Deformation Fields for Point Cloud Interpolation
Not on the map. Why?
Abstract (arXiv)
Point Cloud Interpolation confronts challenges from point sparsity, complex spatiotemporal dynamics, and the difficulty of deriving complete 3D point clouds from sparse temporal information. This paper presents NeuroGauss4D-PCI, which excels at modeling complex non-rigid deformations across varied dynamic scenes. The method begins with an iterative Gaussian cloud soft clustering module, offering structured temporal point cloud representations. The proposed temporal radial basis function Gaussian residual utilizes Gaussian parameter interpolation over time, enabling smooth parameter transitions and capturing temporal residuals of Gaussian distributions. Additionally, a 4D Gaussian deformation field tracks the evolution of these parameters, creating continuous spatiotemporal deformation fields. A 4D neural field transforms low-dimensional spatiotemporal coordinates (x,y,z,t) into a high-dimensional latent space. Finally, we adaptively and efficiently fuse the latent features from neural fields and the geometric features from Gaussian deformation fields. NeuroGauss4D-PCI outperforms existing methods in point cloud frame interpolation, delivering leading performance on both object-level (DHB) and large-scale autonomous driving datasets (NL-Drive), with scalability to auto-labeling and point cloud densification tasks. The source code is released at https://github.com/jiangchaokang/NeuroGauss4D-PCI.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 23 May 2024.
Builds on
45 of 58 references.
References · 45
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
33 more
- 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 109
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2021Neural Scene Flow Priorcited by 91
- 2023Implicit Neural Representation in Medical Imaging: A Comparative Surveycited by 90
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 78
- 2020PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Cloudscited by 74
- 2024Deblurring 3D Gaussian Splattingcited by 66
- 2023SNI-SLAM: Semantic Neural Implicit SLAMcited by 65
- 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 42
- 2023Fast Neural Scene Flowcited by 41
- 2022HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDARcited by 38
- 2022Bi-PointFlowNet: Bidirectional Learning for Point Cloud Based Scene Flow Estimationcited by 38
- 2023RegFormer: An Efficient Projection-Aware Transformer Network for Large-Scale Point Cloud Registrationcited by 37
- 2022Generalised Implicit Neural Representationscited by 31
- 2022SCOOP: Self-Supervised Correspondence and Optimization-Based Scene Flowcited by 28
- 2024DVLO: Deep Visual-LiDAR Odometry with Local-to-Global Feature Fusion and Bi-Directional Structure Alignmentcited by 26
- 2023Self-Supervised 3D Scene Flow Estimation Guided by Superpointscited by 24
- 2023Local Implicit Ray Function for Generalizable Radiance Field Representationcited by 19
- 2022Neural Implicit Surface Evolutioncited by 18
- 2023Neural Vector Fields: Implicit Representation by Explicit Learningcited by 16
- 20243DSFLabelling: Boosting 3D Scene Flow Estimation by Pseudo Auto-labellingcited by 16
- 2020MoNet: Motion-based Point Cloud Prediction Networkcited by 14
- 2023GMSF: Global Matching Scene Flowcited by 14
- 2023NeuralPCI: Spatio-temporal Neural Field for 3D Point Cloud Multi-frame Non-linear Interpolationcited by 13
- 2020PointINet: Point Cloud Frame Interpolation Networkcited by 12
- 2023DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Modelcited by 11
- 2022IDEA-Net: Dynamic 3D Point Cloud Interpolation via Deep Embedding Alignmentcited by 9
- 20223D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motioncited by 7
- 2022FFPA-Net: Efficient Feature Fusion with Projection Awareness for 3D Object Detectioncited by 3
- 2022Pseudo-LiDAR for Visual Odometrycited by 2
- 2022Unsupervised Learning of 3D Scene Flow with 3D Odometry Assistancecited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generationcited by 5
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformercited by 3
- 2026RoGS: Adaptive Meshgrid Gaussian for Large-Scale Road Surface Mappingcited by 0
- 2026RoGS: Adaptive Meshgrid Gaussian for Large-Scale Road Surface Mapping16 Jul 2026
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer15 Mar 2026
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generation10 Nov 2025