mlsanityData to 14 Oct 2026

Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting

arXiv 2603.06061 ↗First posted 6 Mar 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

The demand for large-scale digital twins is rapidly growing in robotics and autonomous driving. However, constructing these environments with 3D Gaussian Splatting (3DGS) usually requires expensive, purpose-built data collection. Meanwhile, deployed platforms routinely collect extensive omnidirectional RGB and LiDAR logs, but a significant portion of these sensor data is directly discarded or strictly underutilized due to transmission constraints and the lack of scalable reuse pipeline. In this paper, we present an omnidirectional RGB-LiDAR reuse pipeline that transforms these archived logs into robust initialization assets for 3DGS. Direct conversion of such raw logs introduces practical bottlenecks: inherent non-linear distortion leads to unreliable Structure-from-Motion (SfM) tracking, and dense, unorganized LiDAR clouds cause computational overhead during 3DGS optimization. To overcome these challenges, our pipeline strategically integrates an ERP-to-cubemap conversion module for deterministic spatial anchoring, alongside PRISM-a color stratified downsampling strategy. By bridging these multi-modal inputs via Fast Point Feature Histograms (FPFH) based global registration and Iterative Closest Point (ICP), our pipeline successfully repurposes a considerable fraction of discarded data into usable SfM geometry. Furthermore, our LiDAR-reinforced initialization consistently enhances the final 3DGS rendering fidelity in structurally complex scenes compared to vision-only baselines. Ultimately, this work provides a deterministic workflow for creating simulation-grade digital twins from standard archived sensor logs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

16 of 28 references.

References · 16

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  7. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  8. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  9. 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 188
  10. 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 183
  11. 2018The Double Sphere Camera Modelcited by 52
  12. 2024LiV-GS: LiDAR-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environmentscited by 15
4 more
  1. 2025GS-SDF: LiDAR-Augmented Gaussian Splatting and Neural SDF for Geometrically Consistent Rendering and Reconstructioncited by 8
  2. 2024LVI-GS: Tightly-coupled LiDAR-Visual-Inertial SLAM using 3D Gaussian Splattingcited by 7
  3. 2025MATT-GS: Masked Attention-based 3DGS for Robot Perception and Object Detectioncited by 3
  4. 2026PRISM: Color-Stratified Point Cloud Samplingcited by 1

Built on by

Not cited yet.