mlsanityData to 14 Oct 2026

Rendering 3D Gaussians on a Graph Processor

arXiv 2607.15951 ↗First posted 17 Jul 2026cs.GR cs.CV cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

We present the first implementation of a 3D Gaussian renderer on an Intelligence Processing Unit (IPU), comprising 1,472 independent tiles with only on-chip SRAM; constraints that approximate properties of efficient sensor-processor architectures. Our input scenes are 3D Gaussian maps from real-world sequences. Each tile 'owns' a screen-space region of the framebuffer; Gaussian primitives are routed to destination tiles via Manhattan-distance hops on a north-east-west-south (NEWS) grid, then distributed to overlapping neighbours in an expanding tree pattern. Computation follows the IPU's Bulk Synchronous Parallel (BSP) model, with inter-tile communication defined at compile time. We show this hardware allows us to exploit spatial and temporal locality by enabling local data transfer between cores. We evaluate the bottlenecks in this SRAM-only implementation: inter-tile bandwidth, per-tile SRAM capacity, and workload imbalance from non-uniform Gaussian density. We analyse how these constraints affect performance and render quality. This exploration raises broader questions for conventional GPUs and 3D representations, suggesting that direct inter-SM (streaming multiprocessor) communication might offer ways to reduce DRAM access in GPU kernels. We discuss these implications for the future of on-sensor and DRAM-free architectures. Project page: https://nmjfry.github.io/ipu-3dgs/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

15 of 31 references.

References · 15

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  3. 2023Gaussian Splatting SLAMcited by 415
  4. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  5. 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 239
  6. 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Imagescited by 36
  7. 2025Radiant Foam: Real-Time Differentiable Ray Tracingcited by 34
  8. 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
  9. 2025GCC: A 3DGS Inference Architecture with Gaussian-Wise and Cross-Stage Conditional Processingcited by 10
  10. 2019A Camera That CNNs: Towards Embedded Neural Networks on Pixel Processor Arrayscited by 9
  11. 2023PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensorscited by 6
  12. 2025Neo: Real-Time On-Device 3D Gaussian Splatting with Reuse-and-Update Sorting Accelerationcited by 5
3 more
  1. 2020BIT-VO: Visual Odometry at 300 FPS using Binary Features from the Focal Planecited by 4
  2. 2023Towards Neural Path Tracing in SRAMcited by 2
  3. 2026Radiant Foam Rendering on a Graph Processorcited by 1

Built on by

Not cited yet.