mlsanityData to 14 Oct 2026

3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models

arXiv 2604.05687 ↗First posted 7 Apr 2026cs.CVcited by 7

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Reconstructing 3D scenes from smoke-degraded multi-view images is particularly difficult because smoke introduces strong scattering effects, view-dependent appearance changes, and severe degradation of cross-view consistency. To address these issues, we propose a framework that integrates visual priors with efficient 3D scene modeling. We employ Nano-Banana-Pro to enhance smoke-degraded images and provide clearer visual observations for reconstruction and develop Smoke-GS, a medium-aware 3D Gaussian Splatting framework for smoke scene reconstruction and restoration-oriented novel view synthesis. Smoke-GS models the scene using explicit 3D Gaussians and introduces a lightweight view-dependent medium branch to capture direction-dependent appearance variations caused by smoke. Our method preserves the rendering efficiency of 3D Gaussian Splatting while improving robustness to smoke-induced degradation. Results demonstrate the effectiveness of our method for generating consistent and visually clear novel views in challenging smoke environments.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 38 of its 63 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

38 of 63 references.

References · 38

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  6. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  7. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  8. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 314
  9. 2022Vision Transformers for Single Image Dehazingcited by 260
  10. 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 230
  11. 2022Optimizing Prompts for Text-to-Image Generationcited by 207
  12. 2024One-Step Image Translation with Text-to-Image Modelscited by 116
26 more
  1. 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazingcited by 81
  2. 2022Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppressioncited by 73
  3. 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
  4. 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
  5. 2024WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splattingcited by 41
  6. 2024SeaSplat: Representing Underwater Scenes with 3D Gaussian Splatting and a Physically Grounded Image Formation Modelcited by 36
  7. 2023ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Renderingcited by 28
  8. 2024Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecturecited by 28
  9. 2023EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformercited by 27
  10. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  11. 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstructioncited by 19
  12. 2025I2-NeRF: Learning Neural Radiance Fields Under Physically-Grounded Media Interactionscited by 17
  13. 2022SnowFormer: Context Interaction Transformer with Scale-awareness for Single Image Desnowingcited by 13
  14. 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restorationcited by 13
  15. 2026GenSmoke-GS: A Multi-Stage Method for Novel View Synthesis from Smoke-Degraded Images Using a Generative Modelcited by 11
  16. 2026NTIRE 2026 3D Restoration and Reconstruction in Real-world Adverse Conditions: RealX3D Challenge Resultscited by 11
  17. 2026XInsight: Integrative Stage-Consistent Psychological Counseling Support Agents for Digital Well-Beingcited by 9
  18. 2025AquaNeRF: Neural Radiance Fields in Underwater Media with Distractor Removalcited by 8
  19. 2025Plenodium: UnderWater 3D Scene Reconstruction with Plenoptic Medium Representationcited by 7
  20. 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusioncited by 5
  21. 2023Dehazing-NeRF: Neural Radiance Fields from Hazy Imagescited by 4
  22. 2024NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Imagescited by 4
  23. 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotationscited by 4
  24. 2025Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamicscited by 3
  25. 2026Multimodal Protein Language Models for Enzyme Kinetic Parameters: From Substrate Recognition to Conformational Adaptationcited by 2
  26. 2024Joint Spatial-Temporal Modeling and Contrastive Learning for Self-supervised Heart Rate Measurementcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SmokeSVD: Smoke Reconstruction from A Single View via Progressive Novel View Synthesis and Refinement with Diffusion Models
  2. 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
  3. 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views
  4. 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
  5. 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
  6. 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
  7. 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
  8. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors