mlsanityData to 14 Oct 2026

PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction

arXiv 2605.10307 ↗First posted 11 May 2026cs.CV cs.GR cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Dynamic scene reconstruction represents a fundamental yet demanding challenge in computer vision and robotics. While recent progress in 3DGS-based methods has advanced dynamic scene modeling, obtaining high-fidelity rendering and accurate tracking in scenarios with substantial, intricate motions remains significantly challenging. To address these challenges, we propose PaMoSplat, a novel dynamic Gaussian splatting framework incorporating part awareness and motion priors. Our approach is grounded in two key observations: 1) Parts serve as primitives for scene deformation, and 2) Motion cues from optical flow can effectively guide part motion. Specifically, PaMoSplat initializes by lifting multi-view segmentation masks into 3D space via graph clustering, establishing coherent Gaussian parts. For subsequent timestamps, we leverage a differential evolutionary algorithm to estimate the rigid motion of these parts using multi-view optical flow cues, providing a robust warm-start for further optimization. Additionally, PaMoSplat introduces an adaptive iteration count mechanism, internal learnable rigidity, and flow-supervised rendering loss to accelerate and optimize the training process. Comprehensive evaluations across diverse scenes, including real-world environments, demonstrate that PaMoSplat delivers superior rendering quality, improved tracking precision, and faster convergence compared to existing methods. Furthermore, it enables multiple part-level downstream applications, such as 4D scene editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 75 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

58 of 75 references.

References · 58

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  8. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  9. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  10. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  11. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  12. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
38 more
  1. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  2. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  3. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  4. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  7. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  8. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  9. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  10. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  11. 2023Any-point Trajectory Modeling for Policy Learningcited by 215
  12. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
  13. 2023Robust Dynamic Radiance Fieldscited by 194
  14. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
  15. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
  16. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  17. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
  18. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
  19. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 127
  20. 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
  21. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  22. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  23. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  24. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
  25. 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
  26. 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 68
  27. 2023Im4D: High-Fidelity and Real-Time Novel View Synthesis for Dynamic Scenescited by 55
  28. 2024Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene Reconstructioncited by 45
  29. 2022Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesiscited by 43
  30. 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
  31. 2024Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Roboticscited by 40
  32. 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
  33. 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenescited by 37
  34. 2023Aleth-NeRF: Illumination Adaptive NeRF with Concealing Field Assumptioncited by 35
  35. 2022ParticleNeRF: A Particle-Based Encoding for Online Neural Radiance Fieldscited by 27
  36. 2024GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesiscited by 25
  37. 2023Dynamic Mesh-Aware Radiance Fieldscited by 21
  38. 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fieldscited by 17

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.