mlsanityData to 14 Oct 2026

Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations

arXiv 2609.03657 ↗First posted 3 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D scene representations like NeRF and 3D Gaussian Splatting (3DGS) suffer severe artifacts in sparse-view settings. Recent generative 3D artifact fixers attempt to address this, but rely on paired corrupted and clean renders requiring costly, per-scene reconstructions across varying view configurations. While 2D image augmentations act as instant regularizers, no explicit equivalents exist for 3D representations to preserve spatial consistency across views, an essential property for 3D-aware training. We propose 3D Morphological Perturbations as an optimization-free regularizer that preserves spatial consistency. Leveraging explicit 3DGS, we treat each Gaussian as a fundamental building block - analogous to a 2D pixel - and apply perturbations across its morphological parameter space via scale, rotation, and pruning. Our method eliminates per-scene 3DGS optimization loops from dataset curation while enabling models to learn stronger geometric priors than sparse-view baselines in diagnostic ablations conducted on a lightweight video diffusion sandbox. Scaled to a 14B-parameter video model via ControlNet, our approach maintains visual fidelity while reducing mean depth error by 12.5% over state-of-the-art image-to-image 3D artifact refiners, ultimately boosting downstream robotics policy success rates by up to 8.0% across 3 of 4 manipulation tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 62 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

55 of 62 references.

References · 55

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  11. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
38 more
  1. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  2. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  3. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  4. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  5. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  6. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  7. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  8. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  9. 2020Reinforcement Learning with Augmented Datacited by 468
  10. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  11. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  12. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  13. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
  14. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  15. 2024A Survey on 3D Gaussian Splattingcited by 224
  16. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  17. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
  18. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  19. 2021Vision-Only Robot Navigation in a Neural Radiance Worldcited by 155
  20. 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 116
  21. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  22. 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 104
  23. 2013Dropout Training as Adaptive Regularizationcited by 93
  24. 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
  25. 2022GraspNeRF: Multiview-based 6-DoF Grasp Detection for Transparent and Specular Objects Using Generalizable NeRFcited by 67
  26. 2024Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Mapscited by 55
  27. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
  28. 2022Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentationscited by 46
  29. 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
  30. 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
  31. 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
  32. 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
  33. 2023NeRFLiX: High-Quality Neural View Synthesis by Learning a Degradation-Driven Inter-viewpoint MiXercited by 29
  34. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
  35. 2025FlowR: Flowing from Sparse to Dense 3D Reconstructionscited by 28
  36. 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
  37. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  38. 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splattingcited by 18

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
  2. 2025OracleGS: Grounding Generative Priors for Sparse-View Gaussian Splatting
  3. 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
  4. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  5. 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
  6. 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors
  7. 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
  8. 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views